-- Logs begin at Fri 2022-08-05 01:08:59 UTC, end at Fri 2022-08-05 02:46:19 UTC. -- Aug 05 02:06:16.658664 dv-cinder-815582-13-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 05 02:06:16.666106 dv-cinder-815582-13-iscsi devstack@keystone.service[80428]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 05 02:06:16.668104 dv-cinder-815582-13-iscsi devstack@keystone.service[80428]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Aug 5 02:06:16 2022] *** Aug 05 02:06:16.668104 dv-cinder-815582-13-iscsi devstack@keystone.service[80428]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 05 02:06:16.668104 dv-cinder-815582-13-iscsi devstack@keystone.service[80428]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 05 02:06:16.668104 dv-cinder-815582-13-iscsi devstack@keystone.service[80428]: nodename: dv-cinder-815582-13-iscsi Aug 05 02:06:16.668104 dv-cinder-815582-13-iscsi devstack@keystone.service[80428]: machine: x86_64 Aug 05 02:06:16.668104 dv-cinder-815582-13-iscsi devstack@keystone.service[80428]: clock source: unix Aug 05 02:06:16.668104 dv-cinder-815582-13-iscsi devstack@keystone.service[80428]: pcre jit disabled Aug 05 02:06:16.668614 dv-cinder-815582-13-iscsi devstack@keystone.service[80428]: detected number of CPU cores: 4 Aug 05 02:06:16.668614 dv-cinder-815582-13-iscsi devstack@keystone.service[80428]: current working directory: / Aug 05 02:06:16.668614 dv-cinder-815582-13-iscsi devstack@keystone.service[80428]: detected binary path: /usr/bin/uwsgi-core Aug 05 02:06:16.668614 dv-cinder-815582-13-iscsi devstack@keystone.service[80428]: your processes number limit is 47680 Aug 05 02:06:16.668614 dv-cinder-815582-13-iscsi devstack@keystone.service[80428]: your memory page size is 4096 bytes Aug 05 02:06:16.668614 dv-cinder-815582-13-iscsi devstack@keystone.service[80428]: detected max file descriptor number: 2048 Aug 05 02:06:16.668614 dv-cinder-815582-13-iscsi devstack@keystone.service[80428]: lock engine: pthread robust mutexes Aug 05 02:06:16.668614 dv-cinder-815582-13-iscsi devstack@keystone.service[80428]: thunder lock: enabled Aug 05 02:06:16.671402 dv-cinder-815582-13-iscsi devstack@keystone.service[80428]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 05 02:06:16.671402 dv-cinder-815582-13-iscsi devstack@keystone.service[80428]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 05 02:06:16.709111 dv-cinder-815582-13-iscsi devstack@keystone.service[80428]: Python main interpreter initialized at 0x56170a0a19c0 Aug 05 02:06:16.709111 dv-cinder-815582-13-iscsi devstack@keystone.service[80428]: python threads support enabled Aug 05 02:06:16.709111 dv-cinder-815582-13-iscsi devstack@keystone.service[80428]: your server socket listen backlog is limited to 100 connections Aug 05 02:06:16.709111 dv-cinder-815582-13-iscsi devstack@keystone.service[80428]: your mercy for graceful operations on workers is 90 seconds Aug 05 02:06:16.709493 dv-cinder-815582-13-iscsi devstack@keystone.service[80428]: mapped 403077 bytes (393 KB) for 2 cores Aug 05 02:06:16.709568 dv-cinder-815582-13-iscsi devstack@keystone.service[80428]: *** Operational MODE: preforking *** Aug 05 02:06:16.709804 dv-cinder-815582-13-iscsi devstack@keystone.service[80428]: *** uWSGI is running in multiple interpreter mode *** Aug 05 02:06:16.709804 dv-cinder-815582-13-iscsi devstack@keystone.service[80428]: spawned uWSGI master process (pid: 80428) Aug 05 02:06:16.710005 dv-cinder-815582-13-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 05 02:06:16.710686 dv-cinder-815582-13-iscsi devstack@keystone.service[80428]: spawned uWSGI worker 1 (pid: 80442, cores: 1) Aug 05 02:06:16.710915 dv-cinder-815582-13-iscsi devstack@keystone.service[80428]: spawned uWSGI worker 2 (pid: 80443, cores: 1) Aug 05 02:06:16.716349 dv-cinder-815582-13-iscsi devstack@keystone.service[80428]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 05 02:06:22.205545 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 02:06:22.205545 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: from cryptography.utils import int_from_bytes Aug 05 02:06:22.206330 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 02:06:22.206330 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: from cryptography.utils import int_from_bytes Aug 05 02:06:22.207543 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 02:06:22.207543 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: from cryptography.utils import int_from_bytes Aug 05 02:06:22.207986 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 05 02:06:22.207986 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: from cryptography.utils import int_from_bytes Aug 05 02:06:22.256234 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 02:06:22.256426 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 02:06:22.256621 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] command line args: [] {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 02:06:22.256842 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 05 02:06:22.256924 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 02:06:22.257044 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 05 02:06:22.257129 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ================================================================================ {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 02:06:22.257239 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] command line args: [] {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 05 02:06:22.257324 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] admin_token = **** {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.257512 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 05 02:06:22.257591 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] config_dir = [] {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.257692 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ================================================================================ {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 05 02:06:22.257776 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.257857 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] config_source = [] {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.257954 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] admin_token = **** {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.258037 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] debug = True {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.258206 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] config_dir = [] {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.258282 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.258471 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.258595 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] config_source = [] {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.258692 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.258803 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] debug = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.258899 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.259002 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.259126 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.259236 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.259332 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.259424 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.259524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] list_limit = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.259624 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.259780 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] log_config_append = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.259780 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.259964 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.260063 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] log_dir = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.260173 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] list_limit = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.260269 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] log_file = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.260387 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] log_config_append = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.260509 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.260629 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.260629 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] log_dir = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.260822 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.260897 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] log_file = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.261010 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.261083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.261200 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.261282 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.261361 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.261361 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.261539 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.261651 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.261724 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.261846 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.261922 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.262047 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.262128 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.262204 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.262318 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.262437 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.262516 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.262675 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.262799 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.262947 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.263031 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.263136 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.263214 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.263415 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.263496 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.263851 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.264101 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.264194 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.264267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] publish_errors = False {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.264404 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.264482 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.264638 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.264816 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.264900 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.15/identity {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.265059 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.265147 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] publish_errors = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.265292 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.265377 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.265524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] standard_threads = False {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.265625 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.265705 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.265774 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.265936 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.266020 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.266140 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.266221 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.266342 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] use_journal = False {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.266421 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] standard_threads = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.266491 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] use_json = False {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.266625 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.266709 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] use_stderr = False {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.266787 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] use_syslog = False {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.266857 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.267010 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.267087 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.267202 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] use_journal = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.267278 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.267381 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] use_json = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.267488 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.267564 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] use_stderr = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.267722 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] use_syslog = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.267804 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.267958 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 05 02:06:22.268046 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.268200 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.268276 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.268461 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.268541 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.268708 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.268797 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.268941 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.269017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.269184 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.269261 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.269425 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.269511 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.269674 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.269750 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.269905 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.269981 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.270150 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.270237 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.270384 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.270461 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.270627 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.270713 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.270863 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.270950 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.271095 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.271177 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.271346 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.271428 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.271595 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.271747 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.271821 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.271890 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.272060 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.272136 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.272308 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.272418 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.272588 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.272671 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.272836 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.272912 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.273078 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.273164 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.273305 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.273387 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.273533 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.273609 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.273760 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.273845 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.273993 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.274077 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.274239 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.274317 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.274483 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.274566 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.274710 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.274786 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.274939 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.275016 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.275181 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.275258 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.275423 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.275506 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.275653 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.275729 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.275889 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.275967 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.276116 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.276191 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.276370 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.276450 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.276609 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.276689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.276839 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.276917 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.277068 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.277144 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.277293 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.277374 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.277513 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.277590 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.277747 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.277823 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.277980 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.278058 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.278208 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.278290 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.278439 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.278519 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.278665 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.278747 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.278898 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.279006 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.279198 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.279360 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.279475 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.279572 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.279672 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.279768 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.279867 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.279963 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.280065 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.280160 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.280297 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.280424 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.280556 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.280713 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.280802 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.280911 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.281030 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.281106 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.281240 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.281320 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.281475 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.281554 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.281709 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.281789 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.281938 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.282063 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.282188 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.282269 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.282420 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.282504 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.282650 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.282728 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.282881 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.282969 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.283098 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.283174 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.283364 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.283444 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.283600 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.283686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.283845 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.283924 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.284084 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.284202 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.284318 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.284469 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.284560 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.284687 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.284844 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.284923 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.285039 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.285160 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.285240 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.285401 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.285479 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.285640 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.285761 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.285878 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.285958 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.286127 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.286206 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.286359 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.286436 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.286595 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.286674 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.286828 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.286905 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.287067 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.287143 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.287307 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.287386 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.287544 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.287621 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.287778 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.287854 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.288014 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.288097 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.288247 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.288342 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.288505 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.288583 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.288730 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.288806 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.288956 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.289034 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.289183 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.289260 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.289411 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.289499 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.289649 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.289767 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.289889 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.289966 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.290124 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.290200 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.290358 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.290437 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.290592 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.290678 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.290825 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.290902 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.291055 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.291134 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.291298 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.291375 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.291536 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.291619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.291763 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] auth.external = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.291847 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.291992 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.292070 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.292251 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.292390 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.292527 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.292604 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.292759 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] auth.password = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.292836 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.292988 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] auth.token = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.293077 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] auth.external = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.293218 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.293303 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.293449 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.293526 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.293692 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.293777 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.293921 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.294007 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] auth.password = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.294164 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.294243 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] auth.token = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.294408 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.294492 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.295154 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.295290 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.295402 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] credential.caching = True {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.295536 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.295619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.295737 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.295846 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.295938 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.296091 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.296170 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.296343 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.296425 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.296583 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] credential.caching = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.296679 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.296816 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.296894 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.297072 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.297149 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.297321 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.297411 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.297557 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.297634 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.297804 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.297883 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.298044 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.298131 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.298308 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.298393 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.298564 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.298649 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.298802 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.298890 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.299056 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.299134 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.299287 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] federation.caching = True {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.299366 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.299520 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.299607 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.299762 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.299841 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.300004 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.300082 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.300235 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.300348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.300503 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.300583 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] federation.caching = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.300739 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.300818 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.300990 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.301087 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.301223 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.301301 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.301471 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.301557 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.301705 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.301792 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.301943 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.302020 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.302175 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] identity.caching = True {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.302254 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.302420 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.302507 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.302664 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.302743 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.302898 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.302976 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.303122 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.303197 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.303362 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.303447 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] identity.caching = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.303592 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.303671 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.303827 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.303907 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.304071 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.304148 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.304312 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.304413 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.304564 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.304644 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.304794 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.304872 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.305023 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.305103 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.305267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.305347 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.305510 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.305589 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.305743 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.305819 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.305976 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.306056 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.306211 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.306290 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.306459 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.306538 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.306696 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.306780 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.306931 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.307008 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.307160 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.307238 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.307394 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.307474 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.307623 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.307707 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.307856 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.307934 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.308093 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.308178 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.308358 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.308440 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.308608 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.308689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.308837 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.308917 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.309075 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.309152 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.309317 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.309394 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.309553 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.309633 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.309796 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.309874 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.310036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.310112 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.310898 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.310988 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.311144 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.311223 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.311376 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.311449 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.311615 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.311698 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.311849 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.311927 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.312088 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.312166 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.312341 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.312424 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.312583 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.312662 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.312822 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.312899 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.313064 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.313146 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.313299 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.313421 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.313525 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.313607 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.313763 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.313844 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.314005 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.314084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.314240 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.314318 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.314473 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.314551 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.314703 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.314779 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.314932 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.user = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.315016 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.315169 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.315249 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.315414 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.315491 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.315644 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.315728 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.315881 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.315958 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.316115 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.user = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.316193 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.316373 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.316468 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.316611 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.316690 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.316838 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.316917 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.317070 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.317155 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.317303 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.317382 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.317537 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.317615 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.317766 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.317852 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.318003 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.318079 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.318242 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.318319 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.318481 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.318566 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.318723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.318826 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.318960 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.319076 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.319211 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.319297 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.319543 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.319620 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.319780 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.319857 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.320015 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.320101 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.320254 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.320350 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.320511 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.320588 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.320753 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.320844 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.320999 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.321084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.321235 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.321320 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.321471 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.321555 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.321703 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.321780 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.321947 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.322023 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.322180 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.322264 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.322414 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.322498 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.322650 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.322727 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.322889 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.322973 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.323126 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.323204 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.323356 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.323439 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.323592 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.323677 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.323829 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] resource.caching = True {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.323906 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.324074 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.324151 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.324315 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.324423 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.324571 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.324650 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.324816 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.324892 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.325058 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] resource.caching = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.325146 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.325291 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.325373 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.325535 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.325613 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.325771 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.325923 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.326060 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.326210 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.326321 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] role.caching = True {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.326400 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.326538 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.326690 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] role.driver = sql {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.326788 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.326930 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.327029 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.327179 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.327257 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.327424 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.327505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] role.caching = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.327669 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.327747 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] role.driver = sql {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.327912 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.327991 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.328168 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.328249 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.328437 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.328519 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.328685 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.328776 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.328931 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.329010 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.329160 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.329238 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.329403 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.329490 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.329646 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.329725 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.329890 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.329968 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.330123 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.330209 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.330375 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.330525 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.330625 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.330760 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.330873 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.331006 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.331122 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.331251 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.331496 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.331573 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.331741 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.331827 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.331974 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.332053 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.332225 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.332303 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.332498 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.332590 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.332736 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.332815 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.332964 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.333043 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.333193 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.333280 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.333422 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.333500 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.333669 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.333754 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.333906 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.333986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.334143 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.334222 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.334375 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.334453 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.334610 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.334690 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.334839 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.334918 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.335071 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] token.caching = True {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.335149 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.335305 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.335384 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.335546 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.335625 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.335781 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.335859 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.336017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] token.caching = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.336096 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.336258 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.336354 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.336520 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.336597 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.336766 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.336847 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.337008 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.337086 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.337251 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.337329 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.337486 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.337565 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.337722 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.337804 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.337954 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.338032 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.338195 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.338275 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.338434 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.338511 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.338660 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.338737 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.338900 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.338980 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.339145 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.339222 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.339395 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.339473 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] database.connection = **** {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.339628 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.339721 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.339874 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.339955 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.340110 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.340188 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.340378 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.340461 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] database.connection = **** {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.340615 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.340707 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.340849 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.340929 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.341082 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.341160 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.341316 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.341402 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.342087 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.342160 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.342375 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.342474 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.342618 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.342735 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.342859 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.342941 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.343108 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.343187 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.343347 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.343475 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.343593 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.343673 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.343824 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.343900 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.344061 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.344148 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.344295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.344480 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.344552 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 02:06:22.344623 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.344783 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.345025 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.345268 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 05 02:06:22.345440 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80443) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 05 02:06:22.374172 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.374400 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.374623 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.375226 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.375463 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.375692 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.382903 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.384116 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.413181 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.413403 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.414337 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.414572 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.465384 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.465829 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.516510 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.516741 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.517927 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.518168 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.580413 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.580639 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.580860 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.580979 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.581062 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.581215 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.581298 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.581440 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.581522 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.581659 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.581875 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.582092 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.604293 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.604552 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.604641 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.604772 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.604869 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.604987 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.605068 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.605194 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.605275 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.605406 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.605534 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.605618 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.605695 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.605866 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.616571 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.617120 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.629711 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.629947 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.630168 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.630387 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.630490 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.630601 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.630686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.630809 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.630891 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.631017 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80442) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.631101 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.631268 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.631486 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.631701 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80443) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 05 02:06:22.647856 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.648062 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 05 02:06:22.648417 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.648530 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.648613 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 05 02:06:22.648743 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 05 02:06:22.648906 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.649082 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.649167 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.649287 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 05 02:06:22.649371 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.649557 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.649640 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.649818 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.650076 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.650334 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.659854 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.660123 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.660409 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.660576 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.660686 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.660851 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.661122 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.661404 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.667530 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80442) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:06:22.668314 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80443) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:06:22.672268 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80442) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:06:22.672561 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.672838 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.673112 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80443) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:06:22.673195 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.673390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.673474 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.673644 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.673726 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.673909 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.673992 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.674179 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.674269 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.674439 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.674520 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.674703 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.674783 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.674961 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.675044 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.675226 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.675497 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.675763 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.697769 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.699128 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.699240 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80442) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:06:22.699513 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.700651 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80443) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:06:22.701456 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.704907 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80442) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:06:22.705186 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.705464 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.706098 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80443) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:06:22.706377 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.706661 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.712053 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80442) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:06:22.712454 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.713342 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80443) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:06:22.713638 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.716653 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80442) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:06:22.717085 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.717453 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.717752 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.717886 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80443) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:06:22.718037 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.718174 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.718325 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.718459 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.718591 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.718743 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.718865 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.719029 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.719309 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.719578 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.719845 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.735634 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.735907 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.736865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.737140 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.739811 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80442) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:06:22.741114 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80443) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:06:22.742986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.743275 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.744268 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.744588 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.747667 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80442) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:06:22.749759 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80443) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:06:22.751683 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80442) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:06:22.753066 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80443) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:06:22.754865 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.755159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.755440 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.755730 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.756000 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.756254 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.756356 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.756578 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.756864 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.757145 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.757423 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.757706 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.772292 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80442) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:06:22.772594 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.772858 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.773128 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.773984 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80443) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:06:22.774266 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.774533 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.774806 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.780230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.781822 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.781966 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.782129 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.783530 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.783823 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.784928 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80442) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:06:22.785205 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.785493 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.785770 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.786039 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.786666 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80443) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:06:22.786947 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.787237 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.787528 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.787810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.798390 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80442) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:06:22.798660 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.798933 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.799206 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.799480 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.799753 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.800022 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80443) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:06:22.800158 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.800287 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.800595 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.800875 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.801157 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.801453 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.801738 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.816395 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80442) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:06:22.818177 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80443) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:06:22.819342 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80442) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:06:22.821202 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80443) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:06:22.822315 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.824165 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.824862 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.826933 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80442) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:06:22.827212 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.827368 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.827498 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.829009 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80443) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:06:22.829287 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.829576 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.833963 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.835564 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80442) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:06:22.836067 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.837718 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80443) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:06:22.838526 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.838809 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.839084 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.839348 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.840685 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.840974 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.841255 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.842073 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.847962 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80442) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:06:22.848242 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.848546 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.850474 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80443) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:06:22.850760 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.851088 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.855685 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80442) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:06:22.855959 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.856231 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.856524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.856789 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.857070 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.857339 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.857621 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.857998 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.858129 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80443) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 05 02:06:22.858264 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.858369 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.858554 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.858725 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.858860 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.858993 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.859122 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.859258 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.859435 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80442) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.859566 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.859772 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.860058 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.860469 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.860755 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.861029 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.861292 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.861559 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.861825 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80443) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 05 02:06:22.892974 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56170a0a19c0 pid: 80442 (default app) Aug 05 02:06:22.896282 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x56170a0a19c0 pid: 80443 (default app) Aug 05 02:06:22.896381 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb962c0-7443-43ba-b44b-9a4429f661cd None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:22.896591 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb962c0-7443-43ba-b44b-9a4429f661cd None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:22.896865 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb962c0-7443-43ba-b44b-9a4429f661cd None None] PATH_INFO: `/v3` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:22.901107 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1/1] 10.222.0.15 () {50 vars in 791 bytes} [Fri Aug 5 02:06:22 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:06:30.661057 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4b03d-a624-4c25-b0a5-2207ae88b30d None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:30.661630 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4b03d-a624-4c25-b0a5-2207ae88b30d None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:30.661630 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd4b03d-a624-4c25-b0a5-2207ae88b30d None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:30.665995 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1/2] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:06:30 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:06:30.672195 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d693f67-212c-47e4-ae21-188360837cac None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:30.672627 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d693f67-212c-47e4-ae21-188360837cac None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:30.672776 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d693f67-212c-47e4-ae21-188360837cac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:30.743084 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: INFO dbcounter [None req-7d693f67-212c-47e4-ae21-188360837cac None None] Registered counter for database keystone Aug 05 02:06:30.761867 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG oslo_db.sqlalchemy.engines [None req-7d693f67-212c-47e4-ae21-188360837cac None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80442) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 02:06:30.768700 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writer thread running {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 02:06:30.948774 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG passlib.handlers.bcrypt [None req-7d693f67-212c-47e4-ae21-188360837cac None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80442) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 05 02:06:30.949195 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG passlib.handlers.bcrypt [None req-7d693f67-212c-47e4-ae21-188360837cac None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80442) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 05 02:06:31.003517 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-7d693f67-212c-47e4-ae21-188360837cac None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:06:31.005147 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-7d693f67-212c-47e4-ae21-188360837cac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:06:31.133582 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 2/3] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:06:30 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 462 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Aug 05 02:06:31.275587 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4b03d-a624-4c25-b0a5-2207ae88b30d None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:31.346065 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: INFO dbcounter [None req-0bd4b03d-a624-4c25-b0a5-2207ae88b30d None None] Registered counter for database keystone Aug 05 02:06:31.367105 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG oslo_db.sqlalchemy.engines [None req-0bd4b03d-a624-4c25-b0a5-2207ae88b30d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80443) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 05 02:06:31.373828 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writer thread running {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 05 02:06:31.494137 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bd4b03d-a624-4c25-b0a5-2207ae88b30d None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:31.500308 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75359aa0-c13b-445a-877c-0eab4e4bafca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:31.500990 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75359aa0-c13b-445a-877c-0eab4e4bafca admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:31.501273 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75359aa0-c13b-445a-877c-0eab4e4bafca admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:31.501550 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75359aa0-c13b-445a-877c-0eab4e4bafca admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:31.513860 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75359aa0-c13b-445a-877c-0eab4e4bafca admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:31.567186 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: WARNING keystone.common.rbac_enforcer.enforcer [None req-75359aa0-c13b-445a-877c-0eab4e4bafca admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 05 02:06:31.567470 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75359aa0-c13b-445a-877c-0eab4e4bafca admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:31.578676 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 2/4] 10.222.0.15 () {58 vars in 1324 bytes} [Fri Aug 5 02:06:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 05 02:06:31.584730 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d693f67-212c-47e4-ae21-188360837cac None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:31.599432 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d693f67-212c-47e4-ae21-188360837cac None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:31.604142 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a92c66e-82dc-42f0-8b56-ef472cdc9837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:31.605315 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92c66e-82dc-42f0-8b56-ef472cdc9837 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:31.605623 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92c66e-82dc-42f0-8b56-ef472cdc9837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:31.605903 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a92c66e-82dc-42f0-8b56-ef472cdc9837 admin admin] PATH_INFO: `/v3/projects/a0be9d6a2aae470aa8143374d4c4992b` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:31.608442 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a92c66e-82dc-42f0-8b56-ef472cdc9837 admin admin] RBAC: Authorizing `identity:get_project(project_id=a0be9d6a2aae470aa8143374d4c4992b)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:31.658669 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: WARNING keystone.common.rbac_enforcer.enforcer [None req-1a92c66e-82dc-42f0-8b56-ef472cdc9837 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 05 02:06:31.659014 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a92c66e-82dc-42f0-8b56-ef472cdc9837 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:31.663617 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 3/5] 10.222.0.15 () {56 vars in 1207 bytes} [Fri Aug 5 02:06:31 2022] GET /identity/v3/projects/a0be9d6a2aae470aa8143374d4c4992b => generated 344 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:06:33.696937 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f13198-5eed-495e-850b-691f5622f619 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:33.697503 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f13198-5eed-495e-850b-691f5622f619 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:33.697503 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98f13198-5eed-495e-850b-691f5622f619 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:33.701584 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 3/6] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:06:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:06:33.707313 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecdb7e-68af-447c-b9ae-016d6082b24b None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:33.707736 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecdb7e-68af-447c-b9ae-016d6082b24b None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:33.707873 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ecdb7e-68af-447c-b9ae-016d6082b24b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:33.729156 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-10ecdb7e-68af-447c-b9ae-016d6082b24b None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:06:33.730665 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-10ecdb7e-68af-447c-b9ae-016d6082b24b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:06:33.739047 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 4/7] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:06:33 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 05 02:06:33.760828 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f13198-5eed-495e-850b-691f5622f619 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:33.772716 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98f13198-5eed-495e-850b-691f5622f619 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:33.776846 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ddf856a-ff86-4609-ade4-9d1dc5a57f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:33.777446 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf856a-ff86-4609-ade4-9d1dc5a57f60 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:33.777724 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf856a-ff86-4609-ade4-9d1dc5a57f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:33.777996 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ddf856a-ff86-4609-ade4-9d1dc5a57f60 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:33.786349 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf856a-ff86-4609-ade4-9d1dc5a57f60 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:33.788106 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ddf856a-ff86-4609-ade4-9d1dc5a57f60 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:33.797261 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 4/8] 10.222.0.15 () {58 vars in 1324 bytes} [Fri Aug 5 02:06:33 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 02:06:33.802599 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ecdb7e-68af-447c-b9ae-016d6082b24b None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:33.811448 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ecdb7e-68af-447c-b9ae-016d6082b24b None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:33.815777 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cc625e-16b8-4851-9aa9-936bdfc8f553 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:33.816428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc625e-16b8-4851-9aa9-936bdfc8f553 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:33.816710 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc625e-16b8-4851-9aa9-936bdfc8f553 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:33.816986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cc625e-16b8-4851-9aa9-936bdfc8f553 admin admin] PATH_INFO: `/v3/users/c5c6e2a1691a410eaac17764c32341d7` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:33.818331 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cc625e-16b8-4851-9aa9-936bdfc8f553 admin admin] RBAC: Authorizing `identity:get_user(user_id=c5c6e2a1691a410eaac17764c32341d7)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:33.820126 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cc625e-16b8-4851-9aa9-936bdfc8f553 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:33.821687 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 5/9] 10.222.0.15 () {56 vars in 1198 bytes} [Fri Aug 5 02:06:33 2022] GET /identity/v3/users/c5c6e2a1691a410eaac17764c32341d7 => generated 247 bytes in 19 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:06:35.859418 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdac87-4233-48e5-9a28-d3f654182b6e None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:35.859909 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdac87-4233-48e5-9a28-d3f654182b6e None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:35.860001 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fabdac87-4233-48e5-9a28-d3f654182b6e None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:35.861327 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 5/10] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:06:35.866367 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd743e8-c323-47cf-a985-50eecdff029d None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:35.866766 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd743e8-c323-47cf-a985-50eecdff029d None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:35.866923 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd743e8-c323-47cf-a985-50eecdff029d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:35.886469 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-fcd743e8-c323-47cf-a985-50eecdff029d None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:06:35.887905 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-fcd743e8-c323-47cf-a985-50eecdff029d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:06:35.890661 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c594ca-52bb-4d91-8682-6a7887221597 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:35.891010 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c594ca-52bb-4d91-8682-6a7887221597 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:35.891348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c594ca-52bb-4d91-8682-6a7887221597 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:35.892761 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 6/11] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:06:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:06:35.897631 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f84763-d8cb-41f2-88c8-c7b9eb14af74 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:35.897911 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f84763-d8cb-41f2-88c8-c7b9eb14af74 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:35.898187 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28f84763-d8cb-41f2-88c8-c7b9eb14af74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:35.940845 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG passlib.handlers.bcrypt [None req-28f84763-d8cb-41f2-88c8-c7b9eb14af74 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80443) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 05 02:06:35.941265 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG passlib.handlers.bcrypt [None req-28f84763-d8cb-41f2-88c8-c7b9eb14af74 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80443) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 05 02:06:35.967808 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 6/12] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:06:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:06:35.986769 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-28f84763-d8cb-41f2-88c8-c7b9eb14af74 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:06:35.988404 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-28f84763-d8cb-41f2-88c8-c7b9eb14af74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:06:35.989965 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd743e8-c323-47cf-a985-50eecdff029d None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:36.014315 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:36.089133 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 7/13] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:06:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:06:36.094167 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd743e8-c323-47cf-a985-50eecdff029d None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:36.111845 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f84763-d8cb-41f2-88c8-c7b9eb14af74 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:36.129821 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21289fcb-aeb7-4e4e-83c0-70bf2ec29876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:36.130478 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21289fcb-aeb7-4e4e-83c0-70bf2ec29876 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:36.130761 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21289fcb-aeb7-4e4e-83c0-70bf2ec29876 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:36.131040 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21289fcb-aeb7-4e4e-83c0-70bf2ec29876 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:36.142918 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21289fcb-aeb7-4e4e-83c0-70bf2ec29876 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:06:36.151831 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-21289fcb-aeb7-4e4e-83c0-70bf2ec29876 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:06:36.151831 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:06:36.151831 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:06:36.151831 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:06:36.151831 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:06:36.151831 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:06:36.151831 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:06:36.151831 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:06:36.151831 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:06:36.151831 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:06:36.151831 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:06:36.151831 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:06:36.151831 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:06:36.151831 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:06:36.151831 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:06:36.151831 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:06:36.152780 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:06:36.152780 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:06:36.152780 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:06:36.152780 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:06:36.152780 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:06:36.152780 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:06:36.152780 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:06:36.152780 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:06:36.152780 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:06:36.152780 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:06:36.152780 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:06:36.152780 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:06:36.152780 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:06:36.152780 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:06:36.152780 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:06:36.152780 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:06:36.153845 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:06:36.153845 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:06:36.153845 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:06:36.153845 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:06:36.153845 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:06:36.153845 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:06:36.153845 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:06:36.153845 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:06:36.153845 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:06:36.153845 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:06:36.153845 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:06:36.153845 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:06:36.153845 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 7/14] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Aug 5 02:06:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:06:36.159314 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21289fcb-aeb7-4e4e-83c0-70bf2ec29876 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:36.215931 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28f84763-d8cb-41f2-88c8-c7b9eb14af74 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:36.218261 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:36.244871 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:36.254472 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36afbf4-6b1d-439f-ad19-8218004dd851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:36.255332 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36afbf4-6b1d-439f-ad19-8218004dd851 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:36.255611 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36afbf4-6b1d-439f-ad19-8218004dd851 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:36.255882 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36afbf4-6b1d-439f-ad19-8218004dd851 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:36.263854 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21289fcb-aeb7-4e4e-83c0-70bf2ec29876 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:36.302515 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25722079-f577-4ba0-9447-2b8b74219973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:36.303130 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25722079-f577-4ba0-9447-2b8b74219973 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:36.303411 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25722079-f577-4ba0-9447-2b8b74219973 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:36.303685 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25722079-f577-4ba0-9447-2b8b74219973 None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:36.304451 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25722079-f577-4ba0-9447-2b8b74219973 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:06:36.304759 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25722079-f577-4ba0-9447-2b8b74219973 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:36.306165 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25722079-f577-4ba0-9447-2b8b74219973 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:36.318977 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 8/15] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:06:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:06:36.324666 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25722079-f577-4ba0-9447-2b8b74219973 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:36.330529 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36afbf4-6b1d-439f-ad19-8218004dd851 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:36.332059 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a36afbf4-6b1d-439f-ad19-8218004dd851 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:36.449392 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 8/16] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:06:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 05 02:06:36.458143 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36afbf4-6b1d-439f-ad19-8218004dd851 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:36.463070 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:36.546402 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25722079-f577-4ba0-9447-2b8b74219973 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:36.581824 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36afbf4-6b1d-439f-ad19-8218004dd851 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:36.583345 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded00cf9-1ed1-4d7b-a334-d6dda87953dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:36.583919 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded00cf9-1ed1-4d7b-a334-d6dda87953dc None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:36.584213 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded00cf9-1ed1-4d7b-a334-d6dda87953dc None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:36.584520 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded00cf9-1ed1-4d7b-a334-d6dda87953dc None admin] PATH_INFO: `/v3/users/c5c6e2a1691a410eaac17764c32341d7` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:36.587526 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded00cf9-1ed1-4d7b-a334-d6dda87953dc None admin] RBAC: Authorizing `identity:get_user(user_id=c5c6e2a1691a410eaac17764c32341d7)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:36.590214 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ded00cf9-1ed1-4d7b-a334-d6dda87953dc None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:36.592433 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 9/17] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:06:36 2022] GET /identity/v3/users/c5c6e2a1691a410eaac17764c32341d7 => generated 247 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:06:36.600112 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded00cf9-1ed1-4d7b-a334-d6dda87953dc None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:36.616398 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:36.633744 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a4b46-76c0-4719-8681-afb18c9d84b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:36.634625 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a4b46-76c0-4719-8681-afb18c9d84b2 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:36.634908 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a4b46-76c0-4719-8681-afb18c9d84b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:36.635184 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f8a4b46-76c0-4719-8681-afb18c9d84b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:36.656474 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a4b46-76c0-4719-8681-afb18c9d84b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:36.657954 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f8a4b46-76c0-4719-8681-afb18c9d84b2 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:36.679981 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-9f8a4b46-76c0-4719-8681-afb18c9d84b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:06:36.679981 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:06:36.679981 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:06:36.679981 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:06:36.679981 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:06:36.679981 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:06:36.679981 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:06:36.679981 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:06:36.679981 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:06:36.679981 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:06:36.679981 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:06:36.679981 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:06:36.679981 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:06:36.679981 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:06:36.679981 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:06:36.680901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:06:36.680901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:06:36.680901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:06:36.680901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:06:36.680901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:06:36.680901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:06:36.680901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:06:36.680901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:06:36.680901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:06:36.680901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:06:36.680901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:06:36.680901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:06:36.680901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:06:36.680901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:06:36.680901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:06:36.680901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:06:36.680901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:06:36.681705 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:06:36.681705 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:06:36.681705 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:06:36.681705 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:06:36.681705 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 9/18] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:06:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:06:36.690567 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a4b46-76c0-4719-8681-afb18c9d84b2 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:36.712269 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded00cf9-1ed1-4d7b-a334-d6dda87953dc None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:36.747477 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c54873-e03d-41d3-9524-b3bdb7d584d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:36.748121 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c54873-e03d-41d3-9524-b3bdb7d584d8 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:36.748448 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c54873-e03d-41d3-9524-b3bdb7d584d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:36.748769 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c54873-e03d-41d3-9524-b3bdb7d584d8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:36.750026 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c54873-e03d-41d3-9524-b3bdb7d584d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:36.751435 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c54873-e03d-41d3-9524-b3bdb7d584d8 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:36.751930 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:36.753087 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 10/19] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:06:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:06:36.759674 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c54873-e03d-41d3-9524-b3bdb7d584d8 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:36.803441 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f8a4b46-76c0-4719-8681-afb18c9d84b2 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:36.845374 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09110d41-5afd-4752-9d6d-d10ad13a3785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:36.846378 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09110d41-5afd-4752-9d6d-d10ad13a3785 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:36.846662 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09110d41-5afd-4752-9d6d-d10ad13a3785 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:36.846940 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09110d41-5afd-4752-9d6d-d10ad13a3785 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:36.847643 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09110d41-5afd-4752-9d6d-d10ad13a3785 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:06:36.847948 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09110d41-5afd-4752-9d6d-d10ad13a3785 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:36.849379 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09110d41-5afd-4752-9d6d-d10ad13a3785 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:36.851130 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:36.868808 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 10/20] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:06:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:06:36.879641 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c54873-e03d-41d3-9524-b3bdb7d584d8 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:36.931183 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e82f18d-edf9-481b-b2df-c6d93fc1d012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:36.931833 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82f18d-edf9-481b-b2df-c6d93fc1d012 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:36.932116 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82f18d-edf9-481b-b2df-c6d93fc1d012 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:36.932596 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e82f18d-edf9-481b-b2df-c6d93fc1d012 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:36.933591 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82f18d-edf9-481b-b2df-c6d93fc1d012 None admin] RBAC: Adding query filter params (role.id=e1b75d5eea2a43b2b1b14cf0515350fa, scope.domain.id=default, user.id=c5c6e2a1691a410eaac17764c32341d7) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:06:36.934021 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82f18d-edf9-481b-b2df-c6d93fc1d012 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:36.936092 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e82f18d-edf9-481b-b2df-c6d93fc1d012 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:36.944210 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 11/21] 10.222.0.15 () {56 vars in 1322 bytes} [Fri Aug 5 02:06:36 2022] GET /identity/v3/role_assignments?user.id=c5c6e2a1691a410eaac17764c32341d7&scope.domain.id=default&role.id=e1b75d5eea2a43b2b1b14cf0515350fa => generated 233 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:06:39.239989 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d791b3-addb-4101-b97f-537124982bc3 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:39.240917 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d791b3-addb-4101-b97f-537124982bc3 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:39.241362 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d791b3-addb-4101-b97f-537124982bc3 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:39.242886 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 11/22] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:06:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:06:39.248380 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b4168-ce1b-4173-91bd-de61d4e05461 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:39.248789 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b4168-ce1b-4173-91bd-de61d4e05461 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:39.248995 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6b4168-ce1b-4173-91bd-de61d4e05461 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:39.273640 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-db6b4168-ce1b-4173-91bd-de61d4e05461 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:06:39.274855 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-db6b4168-ce1b-4173-91bd-de61d4e05461 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:06:39.366866 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 12/23] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:06:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:06:39.400605 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d791b3-addb-4101-b97f-537124982bc3 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:39.486771 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5fd89-41a1-49d4-8242-170bafeee9f5 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:39.487117 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5fd89-41a1-49d4-8242-170bafeee9f5 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:39.487361 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a5fd89-41a1-49d4-8242-170bafeee9f5 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:39.488767 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 13/24] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:06:39.493670 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17a3f1-6625-464a-ba1e-4cc9a968a101 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:39.493906 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17a3f1-6625-464a-ba1e-4cc9a968a101 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:39.494188 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee17a3f1-6625-464a-ba1e-4cc9a968a101 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:39.527056 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d791b3-addb-4101-b97f-537124982bc3 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:39.537402 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-ee17a3f1-6625-464a-ba1e-4cc9a968a101 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:06:39.538625 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-ee17a3f1-6625-464a-ba1e-4cc9a968a101 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:06:39.548608 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:39.569385 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d8594c0-eb95-47d5-bcb1-93c8190907d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:39.570042 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8594c0-eb95-47d5-bcb1-93c8190907d8 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:39.570328 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8594c0-eb95-47d5-bcb1-93c8190907d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:39.570605 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d8594c0-eb95-47d5-bcb1-93c8190907d8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:39.582803 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d8594c0-eb95-47d5-bcb1-93c8190907d8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:06:39.589505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-2d8594c0-eb95-47d5-bcb1-93c8190907d8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:06:39.589505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:06:39.589505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:06:39.589505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:06:39.589505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:06:39.589505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:06:39.589505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:06:39.589505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:06:39.589505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:06:39.589505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:06:39.589505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:06:39.589505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:06:39.589505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:06:39.589505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:06:39.589505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:06:39.589505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:06:39.590862 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:06:39.590862 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:06:39.590862 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:06:39.590862 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:06:39.590862 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:06:39.590862 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:06:39.590862 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:06:39.590862 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:06:39.590862 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:06:39.590862 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:06:39.590862 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:06:39.590862 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:06:39.590862 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:06:39.590862 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:06:39.590862 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:06:39.590862 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:06:39.591593 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:06:39.591593 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:06:39.591593 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:06:39.591593 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:06:39.591593 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:06:39.591593 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:06:39.591593 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:06:39.591593 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:06:39.591593 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:06:39.591593 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:06:39.591593 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:06:39.591593 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:06:39.591593 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 12/25] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Aug 5 02:06:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:06:39.592717 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89838a6-ee05-4dde-934d-e696c74bac28 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:39.596354 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89838a6-ee05-4dde-934d-e696c74bac28 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:39.596354 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d89838a6-ee05-4dde-934d-e696c74bac28 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:39.596354 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 13/26] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:06:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:06:39.599698 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89838a6-ee05-4dde-934d-e696c74bac28 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:39.683558 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 14/27] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:06:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:06:39.685550 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc5ada-58f1-4cd7-b762-4ad9665c77f6 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:39.685837 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc5ada-58f1-4cd7-b762-4ad9665c77f6 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:39.686115 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5dc5ada-58f1-4cd7-b762-4ad9665c77f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:39.712765 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:39.727620 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d89838a6-ee05-4dde-934d-e696c74bac28 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:39.728965 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-f5dc5ada-58f1-4cd7-b762-4ad9665c77f6 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:06:39.730206 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-f5dc5ada-58f1-4cd7-b762-4ad9665c77f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:06:39.767371 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e02da8-173e-4bc6-8ce4-2b70ee9060d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:39.767922 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e02da8-173e-4bc6-8ce4-2b70ee9060d4 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:39.768207 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e02da8-173e-4bc6-8ce4-2b70ee9060d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:39.768515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97e02da8-173e-4bc6-8ce4-2b70ee9060d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:39.769239 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e02da8-173e-4bc6-8ce4-2b70ee9060d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:06:39.769548 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e02da8-173e-4bc6-8ce4-2b70ee9060d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:39.770940 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97e02da8-173e-4bc6-8ce4-2b70ee9060d4 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:39.784123 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 14/28] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:06:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:06:39.785065 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e02da8-173e-4bc6-8ce4-2b70ee9060d4 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:39.853456 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 15/29] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:06:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:06:39.854335 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc5ada-58f1-4cd7-b762-4ad9665c77f6 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:39.968618 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:40.033770 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97e02da8-173e-4bc6-8ce4-2b70ee9060d4 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:40.047477 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5dc5ada-58f1-4cd7-b762-4ad9665c77f6 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:40.070178 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85403383-6f38-4ed0-aa8c-e29f264255e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:40.071051 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85403383-6f38-4ed0-aa8c-e29f264255e4 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:40.071511 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85403383-6f38-4ed0-aa8c-e29f264255e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:40.071933 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85403383-6f38-4ed0-aa8c-e29f264255e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:40.086778 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85403383-6f38-4ed0-aa8c-e29f264255e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:40.088664 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85403383-6f38-4ed0-aa8c-e29f264255e4 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:40.106906 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-85403383-6f38-4ed0-aa8c-e29f264255e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:06:40.106906 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:06:40.106906 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:06:40.106906 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:06:40.106906 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:06:40.106906 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:06:40.106906 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:06:40.106906 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:06:40.106906 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:06:40.106906 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:06:40.106906 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:06:40.106906 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:06:40.106906 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:06:40.106906 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:06:40.106906 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:06:40.107906 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:06:40.107906 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:06:40.107906 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:06:40.107906 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:06:40.107906 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:06:40.107906 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:06:40.107906 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:06:40.107906 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:06:40.107906 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:06:40.107906 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:06:40.107906 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:06:40.107906 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:06:40.107906 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:06:40.107906 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:06:40.107906 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:06:40.107906 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:06:40.107906 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:06:40.108839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:06:40.108839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:06:40.108839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:06:40.108839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:06:40.110493 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 15/30] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:06:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:06:40.111611 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85403383-6f38-4ed0-aa8c-e29f264255e4 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:40.111729 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce752900-a338-45a0-9ef7-542863fe58bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:40.112527 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce752900-a338-45a0-9ef7-542863fe58bd None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:40.112831 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce752900-a338-45a0-9ef7-542863fe58bd None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:40.113186 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce752900-a338-45a0-9ef7-542863fe58bd None admin] PATH_INFO: `/v3/users/c5c6e2a1691a410eaac17764c32341d7` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:40.114381 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce752900-a338-45a0-9ef7-542863fe58bd None admin] RBAC: Authorizing `identity:get_user(user_id=c5c6e2a1691a410eaac17764c32341d7)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:40.115839 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce752900-a338-45a0-9ef7-542863fe58bd None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:40.123012 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 16/31] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:06:39 2022] GET /identity/v3/users/c5c6e2a1691a410eaac17764c32341d7 => generated 247 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:06:40.124123 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce752900-a338-45a0-9ef7-542863fe58bd None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:40.136649 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:40.212238 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:40.222647 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85403383-6f38-4ed0-aa8c-e29f264255e4 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:40.258790 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2875103-b4cd-44f3-b1b0-7fa1c3699ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:40.259413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2875103-b4cd-44f3-b1b0-7fa1c3699ccc None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:40.259694 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2875103-b4cd-44f3-b1b0-7fa1c3699ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:40.259973 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2875103-b4cd-44f3-b1b0-7fa1c3699ccc None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:40.260732 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2875103-b4cd-44f3-b1b0-7fa1c3699ccc None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:40.262786 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2875103-b4cd-44f3-b1b0-7fa1c3699ccc None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:40.274127 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce752900-a338-45a0-9ef7-542863fe58bd None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:40.313044 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce81f23-bd54-437c-b5a7-42f5a84abd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:40.313581 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce81f23-bd54-437c-b5a7-42f5a84abd60 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:40.313864 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce81f23-bd54-437c-b5a7-42f5a84abd60 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:40.314140 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce81f23-bd54-437c-b5a7-42f5a84abd60 None admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:40.314894 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce81f23-bd54-437c-b5a7-42f5a84abd60 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:06:40.315203 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce81f23-bd54-437c-b5a7-42f5a84abd60 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:40.316772 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce81f23-bd54-437c-b5a7-42f5a84abd60 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:40.335218 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 17/32] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:06:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:06:40.336126 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce81f23-bd54-437c-b5a7-42f5a84abd60 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:40.402136 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 16/33] 10.222.0.15 () {60 vars in 1131 bytes} [Fri Aug 5 02:06:40 2022] POST /identity/v3/roles => generated 219 bytes in 291 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:06:40.404034 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e8389-efdb-4e91-93f1-db02670705b0 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:40.404450 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e8389-efdb-4e91-93f1-db02670705b0 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:40.404732 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6e8389-efdb-4e91-93f1-db02670705b0 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:40.410189 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 17/34] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:06:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:06:40.411128 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e8389-efdb-4e91-93f1-db02670705b0 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:40.453816 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:40.536245 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce81f23-bd54-437c-b5a7-42f5a84abd60 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:40.610695 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee74b3e8-6cca-411c-8be0-15d808002043 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:40.611289 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74b3e8-6cca-411c-8be0-15d808002043 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:40.611631 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74b3e8-6cca-411c-8be0-15d808002043 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:40.612190 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee74b3e8-6cca-411c-8be0-15d808002043 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:40.614848 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee74b3e8-6cca-411c-8be0-15d808002043 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:40.616346 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee74b3e8-6cca-411c-8be0-15d808002043 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:40.617972 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 18/35] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:06:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:06:40.619108 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae3295-23e9-46ab-9723-720c05c64931 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:40.619393 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae3295-23e9-46ab-9723-720c05c64931 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:40.619670 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43ae3295-23e9-46ab-9723-720c05c64931 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:40.630654 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6e8389-efdb-4e91-93f1-db02670705b0 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:40.646392 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-43ae3295-23e9-46ab-9723-720c05c64931 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:06:40.647807 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-43ae3295-23e9-46ab-9723-720c05c64931 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:06:40.675260 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8874056-1d1f-424e-9a2a-c4113b837ce9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:40.676575 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8874056-1d1f-424e-9a2a-c4113b837ce9 None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:40.677066 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8874056-1d1f-424e-9a2a-c4113b837ce9 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:40.677828 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8874056-1d1f-424e-9a2a-c4113b837ce9 None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:40.679693 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8874056-1d1f-424e-9a2a-c4113b837ce9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:40.682663 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8874056-1d1f-424e-9a2a-c4113b837ce9 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:40.727801 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 18/36] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Aug 5 02:06:40 2022] POST /identity/v3/projects => generated 301 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:06:40.729199 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8874056-1d1f-424e-9a2a-c4113b837ce9 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:40.733874 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:40.740613 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 19/37] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:06:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:06:40.740613 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7de43-2cde-490c-a13f-6ca89667ddf4 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:40.740613 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7de43-2cde-490c-a13f-6ca89667ddf4 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:40.740613 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec7de43-2cde-490c-a13f-6ca89667ddf4 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:40.740613 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 20/38] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:06:40.747359 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aba3c8-3c07-434a-acb1-0c4356901573 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:40.747727 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aba3c8-3c07-434a-acb1-0c4356901573 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:40.747989 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aba3c8-3c07-434a-acb1-0c4356901573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:40.787900 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-75aba3c8-3c07-434a-acb1-0c4356901573 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:06:40.790381 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-75aba3c8-3c07-434a-acb1-0c4356901573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:06:40.882001 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:40.897852 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 21/39] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:06:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:06:40.898460 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aba3c8-3c07-434a-acb1-0c4356901573 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:40.906513 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8874056-1d1f-424e-9a2a-c4113b837ce9 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:40.947875 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b66bd8-6429-4ad8-8bb2-c7dd84a9339a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:40.949376 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b66bd8-6429-4ad8-8bb2-c7dd84a9339a None admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:40.950198 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b66bd8-6429-4ad8-8bb2-c7dd84a9339a None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:40.950964 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b66bd8-6429-4ad8-8bb2-c7dd84a9339a None admin] PATH_INFO: `/v3/domains/default/users/c5c6e2a1691a410eaac17764c32341d7/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:40.953512 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b66bd8-6429-4ad8-8bb2-c7dd84a9339a None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=c5c6e2a1691a410eaac17764c32341d7, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:40.955382 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59b66bd8-6429-4ad8-8bb2-c7dd84a9339a None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:40.972900 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 19/40] 10.222.0.15 () {58 vars in 1361 bytes} [Fri Aug 5 02:06:40 2022] PUT /identity/v3/domains/default/users/c5c6e2a1691a410eaac17764c32341d7/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:06:40.974231 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a45ac4-5e42-446d-b272-720954b55d8f None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:40.974784 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a45ac4-5e42-446d-b272-720954b55d8f None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:40.975066 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a45ac4-5e42-446d-b272-720954b55d8f None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:40.976419 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 20/41] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:06:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:06:40.977348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a45ac4-5e42-446d-b272-720954b55d8f None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:41.026969 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aba3c8-3c07-434a-acb1-0c4356901573 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:41.049876 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:41.068203 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d148b-8cfb-4555-84ac-24d26effbfe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:41.068878 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d148b-8cfb-4555-84ac-24d26effbfe1 None admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:41.069746 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d148b-8cfb-4555-84ac-24d26effbfe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:41.070024 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216d148b-8cfb-4555-84ac-24d26effbfe1 None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:41.070754 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216d148b-8cfb-4555-84ac-24d26effbfe1 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:41.072575 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216d148b-8cfb-4555-84ac-24d26effbfe1 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:41.102203 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a45ac4-5e42-446d-b272-720954b55d8f None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:41.146900 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8007ff-a781-4e6a-b445-c087f154f7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:41.147482 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8007ff-a781-4e6a-b445-c087f154f7ba None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:41.147767 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8007ff-a781-4e6a-b445-c087f154f7ba None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:41.148045 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8007ff-a781-4e6a-b445-c087f154f7ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:41.149273 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8007ff-a781-4e6a-b445-c087f154f7ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:41.150741 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8007ff-a781-4e6a-b445-c087f154f7ba None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:41.152412 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 21/42] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:06:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:06:41.154405 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f58bf2-8df5-4507-a95d-1db9c3ee6e20 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:41.154694 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f58bf2-8df5-4507-a95d-1db9c3ee6e20 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:41.154971 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f58bf2-8df5-4507-a95d-1db9c3ee6e20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:41.173460 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-b9f58bf2-8df5-4507-a95d-1db9c3ee6e20 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:06:41.174969 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-b9f58bf2-8df5-4507-a95d-1db9c3ee6e20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:06:41.202009 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 22/43] 10.222.0.15 () {60 vars in 1131 bytes} [Fri Aug 5 02:06:40 2022] POST /identity/v3/roles => generated 225 bytes in 304 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:06:41.202820 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d148b-8cfb-4555-84ac-24d26effbfe1 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:41.263326 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:41.270988 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 22/44] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:06:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:06:41.293459 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f58bf2-8df5-4507-a95d-1db9c3ee6e20 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:41.327617 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216d148b-8cfb-4555-84ac-24d26effbfe1 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:41.358319 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:41.367049 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36901264-e554-4971-87ee-5c5617cbac4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:41.367742 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36901264-e554-4971-87ee-5c5617cbac4c None admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:41.368034 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36901264-e554-4971-87ee-5c5617cbac4c None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:41.368319 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36901264-e554-4971-87ee-5c5617cbac4c None admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:41.369062 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36901264-e554-4971-87ee-5c5617cbac4c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:41.370747 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36901264-e554-4971-87ee-5c5617cbac4c None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:41.407837 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 23/45] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Aug 5 02:06:41 2022] POST /identity/v3/projects => generated 312 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:06:41.409124 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f58bf2-8df5-4507-a95d-1db9c3ee6e20 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:41.458814 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e62843-a3f2-4b31-a5dc-ee8cb6707aac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:41.459459 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e62843-a3f2-4b31-a5dc-ee8cb6707aac None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:41.459745 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e62843-a3f2-4b31-a5dc-ee8cb6707aac None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:41.460068 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e62843-a3f2-4b31-a5dc-ee8cb6707aac None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:41.460861 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e62843-a3f2-4b31-a5dc-ee8cb6707aac None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:41.462472 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e62843-a3f2-4b31-a5dc-ee8cb6707aac None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:41.483249 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 23/46] 10.222.0.15 () {60 vars in 1131 bytes} [Fri Aug 5 02:06:41 2022] POST /identity/v3/roles => generated 223 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:06:43.034574 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11306c93-2e49-4fb3-abad-ff423ba16b38 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:43.035116 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11306c93-2e49-4fb3-abad-ff423ba16b38 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:43.035116 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11306c93-2e49-4fb3-abad-ff423ba16b38 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:43.036521 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 24/47] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:06:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:06:43.041611 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a6c94-2a0c-4d12-817f-95c9d32c1946 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:43.042006 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a6c94-2a0c-4d12-817f-95c9d32c1946 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:43.042285 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-976a6c94-2a0c-4d12-817f-95c9d32c1946 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:43.061754 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-976a6c94-2a0c-4d12-817f-95c9d32c1946 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:06:43.062965 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-976a6c94-2a0c-4d12-817f-95c9d32c1946 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:06:43.128665 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 24/48] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:06:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:06:43.151360 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11306c93-2e49-4fb3-abad-ff423ba16b38 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:43.253332 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11306c93-2e49-4fb3-abad-ff423ba16b38 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:43.254856 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:43.290063 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae73467e-6c03-45d8-8bce-bf7ef51277dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:43.290705 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73467e-6c03-45d8-8bce-bf7ef51277dc None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:43.290993 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73467e-6c03-45d8-8bce-bf7ef51277dc None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:43.291272 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae73467e-6c03-45d8-8bce-bf7ef51277dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:43.301380 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae73467e-6c03-45d8-8bce-bf7ef51277dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:06:43.306383 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-ae73467e-6c03-45d8-8bce-bf7ef51277dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:06:43.306383 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:06:43.306383 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:06:43.306383 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:06:43.306383 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:06:43.306383 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:06:43.306383 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:06:43.306383 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:06:43.306383 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:06:43.306383 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:06:43.306383 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:06:43.306383 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:06:43.306383 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:06:43.306383 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:06:43.306383 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:06:43.306383 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:06:43.307212 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:06:43.307212 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:06:43.307212 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:06:43.307212 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:06:43.307212 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:06:43.307212 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:06:43.307212 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:06:43.307212 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:06:43.307212 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:06:43.307212 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:06:43.307212 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:06:43.307212 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:06:43.307212 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:06:43.307212 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:06:43.307212 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:06:43.307212 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:06:43.308039 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:06:43.308039 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:06:43.308039 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:06:43.308039 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:06:43.308039 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:06:43.308039 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:06:43.308039 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:06:43.308039 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:06:43.308039 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:06:43.308039 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:06:43.308039 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:06:43.308039 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:06:43.308039 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 25/49] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Aug 5 02:06:43 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:06:43.314211 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a6c94-2a0c-4d12-817f-95c9d32c1946 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:43.363245 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:43.413407 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-976a6c94-2a0c-4d12-817f-95c9d32c1946 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:43.446158 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ad4e5-55a0-44f1-a98e-dfc989e9eb81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:43.446778 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ad4e5-55a0-44f1-a98e-dfc989e9eb81 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:43.447063 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ad4e5-55a0-44f1-a98e-dfc989e9eb81 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:43.447342 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781ad4e5-55a0-44f1-a98e-dfc989e9eb81 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:43.448065 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ad4e5-55a0-44f1-a98e-dfc989e9eb81 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:06:43.448410 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ad4e5-55a0-44f1-a98e-dfc989e9eb81 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:43.449880 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781ad4e5-55a0-44f1-a98e-dfc989e9eb81 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:43.458012 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 25/50] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:06:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:06:43.463505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ad4e5-55a0-44f1-a98e-dfc989e9eb81 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:43.464711 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2aa63a-0427-4d01-ab9f-f607281721ff None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:43.465565 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2aa63a-0427-4d01-ab9f-f607281721ff None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:43.465850 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2aa63a-0427-4d01-ab9f-f607281721ff None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:43.467240 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 26/51] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:06:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:06:43.472427 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8eb818-779c-455a-8f2a-1f758143cdfe None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:43.472719 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8eb818-779c-455a-8f2a-1f758143cdfe None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:43.473003 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8eb818-779c-455a-8f2a-1f758143cdfe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:43.491956 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-ff8eb818-779c-455a-8f2a-1f758143cdfe None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:06:43.493947 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-ff8eb818-779c-455a-8f2a-1f758143cdfe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:06:43.563129 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 27/52] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:06:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:06:43.567077 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781ad4e5-55a0-44f1-a98e-dfc989e9eb81 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:43.579545 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:43.585781 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8eb818-779c-455a-8f2a-1f758143cdfe None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:43.605109 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725dde7d-6ed7-4d39-a41f-bff90f5d23cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:43.606687 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725dde7d-6ed7-4d39-a41f-bff90f5d23cb None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:43.606687 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725dde7d-6ed7-4d39-a41f-bff90f5d23cb None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:43.606939 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725dde7d-6ed7-4d39-a41f-bff90f5d23cb None admin] PATH_INFO: `/v3/users/c5c6e2a1691a410eaac17764c32341d7` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:43.608101 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725dde7d-6ed7-4d39-a41f-bff90f5d23cb None admin] RBAC: Authorizing `identity:get_user(user_id=c5c6e2a1691a410eaac17764c32341d7)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:43.609566 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725dde7d-6ed7-4d39-a41f-bff90f5d23cb None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:43.611152 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 26/53] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:06:43 2022] GET /identity/v3/users/c5c6e2a1691a410eaac17764c32341d7 => generated 247 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:06:43.616541 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725dde7d-6ed7-4d39-a41f-bff90f5d23cb None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:43.676757 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:43.685400 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8eb818-779c-455a-8f2a-1f758143cdfe None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:43.714303 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725dde7d-6ed7-4d39-a41f-bff90f5d23cb None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:43.718979 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40095e3-6f44-47c4-a6ee-d1c9c5ed4b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:43.719619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40095e3-6f44-47c4-a6ee-d1c9c5ed4b51 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:43.719898 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40095e3-6f44-47c4-a6ee-d1c9c5ed4b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:43.720171 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40095e3-6f44-47c4-a6ee-d1c9c5ed4b51 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:43.721361 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40095e3-6f44-47c4-a6ee-d1c9c5ed4b51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:43.722801 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40095e3-6f44-47c4-a6ee-d1c9c5ed4b51 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:43.724665 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 28/54] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:06:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:06:43.731497 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40095e3-6f44-47c4-a6ee-d1c9c5ed4b51 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:43.748986 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88d416-527a-4e87-96db-12e6d52cf817 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:43.749642 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88d416-527a-4e87-96db-12e6d52cf817 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:43.749926 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88d416-527a-4e87-96db-12e6d52cf817 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:43.750204 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b88d416-527a-4e87-96db-12e6d52cf817 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:43.751370 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b88d416-527a-4e87-96db-12e6d52cf817 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:43.752867 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b88d416-527a-4e87-96db-12e6d52cf817 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:43.754618 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 27/55] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:06:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:06:43.760185 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88d416-527a-4e87-96db-12e6d52cf817 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:43.809344 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:43.840974 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40095e3-6f44-47c4-a6ee-d1c9c5ed4b51 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:43.859821 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b88d416-527a-4e87-96db-12e6d52cf817 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:43.874905 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f41ecea-090a-4014-a792-907d9e0bf51a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:43.875525 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41ecea-090a-4014-a792-907d9e0bf51a None admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:43.875809 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41ecea-090a-4014-a792-907d9e0bf51a None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:43.876085 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f41ecea-090a-4014-a792-907d9e0bf51a None admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:43.876800 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f41ecea-090a-4014-a792-907d9e0bf51a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:43.878252 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f41ecea-090a-4014-a792-907d9e0bf51a None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:43.894099 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f49a7a5-6e3c-482f-b062-5deb8264ed13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:43.894716 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49a7a5-6e3c-482f-b062-5deb8264ed13 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:43.895034 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49a7a5-6e3c-482f-b062-5deb8264ed13 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:43.895272 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f49a7a5-6e3c-482f-b062-5deb8264ed13 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:43.896058 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f49a7a5-6e3c-482f-b062-5deb8264ed13 None admin] RBAC: Adding query filter params (role.id=e1b75d5eea2a43b2b1b14cf0515350fa, scope.domain.id=default, user.id=c5c6e2a1691a410eaac17764c32341d7) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:06:43.896398 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f49a7a5-6e3c-482f-b062-5deb8264ed13 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:43.897831 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f49a7a5-6e3c-482f-b062-5deb8264ed13 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:43.904761 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 29/56] 10.222.0.15 () {60 vars in 1140 bytes} [Fri Aug 5 02:06:43 2022] POST /identity/v3/projects => generated 298 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:06:43.905861 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 28/57] 10.222.0.15 () {56 vars in 1322 bytes} [Fri Aug 5 02:06:43 2022] GET /identity/v3/role_assignments?user.id=c5c6e2a1691a410eaac17764c32341d7&scope.domain.id=default&role.id=e1b75d5eea2a43b2b1b14cf0515350fa => generated 530 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:06:45.910143 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2dc5d-a3ee-4146-bc9f-edef15e93c46 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:45.910636 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2dc5d-a3ee-4146-bc9f-edef15e93c46 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:45.910720 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da2dc5d-a3ee-4146-bc9f-edef15e93c46 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:45.912099 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 30/58] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:06:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:06:45.917226 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8184e-79e4-433c-bebc-8a6e3a78d0de None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:45.917613 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8184e-79e4-433c-bebc-8a6e3a78d0de None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:45.917786 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec8184e-79e4-433c-bebc-8a6e3a78d0de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:45.936187 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-7ec8184e-79e4-433c-bebc-8a6e3a78d0de None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:06:45.937390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-7ec8184e-79e4-433c-bebc-8a6e3a78d0de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:06:46.001251 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 29/59] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:06:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:06:46.024671 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2dc5d-a3ee-4146-bc9f-edef15e93c46 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:46.039773 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:46.126671 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da2dc5d-a3ee-4146-bc9f-edef15e93c46 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:46.158568 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a44659-5061-4584-a21d-f67978a30393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:46.159193 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a44659-5061-4584-a21d-f67978a30393 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:46.159475 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a44659-5061-4584-a21d-f67978a30393 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:46.159749 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a44659-5061-4584-a21d-f67978a30393 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:46.160909 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a44659-5061-4584-a21d-f67978a30393 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:46.162348 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a44659-5061-4584-a21d-f67978a30393 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:46.163913 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 31/60] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:06:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:06:46.170123 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8184e-79e4-433c-bebc-8a6e3a78d0de None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:46.211735 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:46.267360 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec8184e-79e4-433c-bebc-8a6e3a78d0de None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:46.299571 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6554e74e-026c-4703-a375-bf41eada8b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:46.300176 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554e74e-026c-4703-a375-bf41eada8b17 None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:46.300484 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554e74e-026c-4703-a375-bf41eada8b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:46.300785 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6554e74e-026c-4703-a375-bf41eada8b17 None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:46.301471 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554e74e-026c-4703-a375-bf41eada8b17 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:46.302895 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6554e74e-026c-4703-a375-bf41eada8b17 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:46.328397 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 30/61] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Aug 5 02:06:46 2022] POST /identity/v3/users => generated 275 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:06:49.549658 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f42d7-e33b-4757-bc7b-f56146d9a707 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:49.550172 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f42d7-e33b-4757-bc7b-f56146d9a707 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:49.550277 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20f42d7-e33b-4757-bc7b-f56146d9a707 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:49.551698 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 32/62] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:06:49.557251 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80738e41-4a52-47f5-9111-8998ef725a73 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:49.558068 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80738e41-4a52-47f5-9111-8998ef725a73 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:49.559064 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80738e41-4a52-47f5-9111-8998ef725a73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:49.577902 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-80738e41-4a52-47f5-9111-8998ef725a73 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:06:49.579448 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-80738e41-4a52-47f5-9111-8998ef725a73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:06:49.649149 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 31/63] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:06:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:06:49.673014 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f42d7-e33b-4757-bc7b-f56146d9a707 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:49.733958 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444d605-8db6-4820-aebd-7df3479acf1d None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:49.734566 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444d605-8db6-4820-aebd-7df3479acf1d None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:49.735062 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8444d605-8db6-4820-aebd-7df3479acf1d None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:49.736659 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 32/64] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:06:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:06:49.741775 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df7ed2-a226-482e-95bf-64ceddcaa68b None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:49.742301 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df7ed2-a226-482e-95bf-64ceddcaa68b None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:49.742887 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74df7ed2-a226-482e-95bf-64ceddcaa68b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:49.767803 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-74df7ed2-a226-482e-95bf-64ceddcaa68b None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:06:49.769592 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-74df7ed2-a226-482e-95bf-64ceddcaa68b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:06:49.795056 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:49.797050 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:49.816990 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20f42d7-e33b-4757-bc7b-f56146d9a707 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:49.852185 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 33/65] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:06:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:06:49.856786 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec429d0d-e27e-4e57-99c4-90e5da597ec5 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:49.856786 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec429d0d-e27e-4e57-99c4-90e5da597ec5 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:49.856786 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec429d0d-e27e-4e57-99c4-90e5da597ec5 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:49.856786 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 34/66] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:06:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:06:49.860608 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6e362-8bc6-43fe-af0c-6df6ce0342ea None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:49.860902 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6e362-8bc6-43fe-af0c-6df6ce0342ea None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:49.861187 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a6e362-8bc6-43fe-af0c-6df6ce0342ea None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:49.862409 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 35/67] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:06:49 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:06:49.863644 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94a53d-4282-4cf2-a63b-45f2740e8459 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:49.864139 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94a53d-4282-4cf2-a63b-45f2740e8459 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:49.864658 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe94a53d-4282-4cf2-a63b-45f2740e8459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:49.866329 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37ac5735-4119-43f9-84eb-a176a08ffdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:49.867055 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac5735-4119-43f9-84eb-a176a08ffdb2 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:49.867430 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac5735-4119-43f9-84eb-a176a08ffdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:49.867792 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37ac5735-4119-43f9-84eb-a176a08ffdb2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:49.880297 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37ac5735-4119-43f9-84eb-a176a08ffdb2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:06:49.884924 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-fe94a53d-4282-4cf2-a63b-45f2740e8459 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:06:49.885817 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-37ac5735-4119-43f9-84eb-a176a08ffdb2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:06:49.885817 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:06:49.885817 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:06:49.885817 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:06:49.885817 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:06:49.885817 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:06:49.885817 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:06:49.885817 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:06:49.885817 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:06:49.885817 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:06:49.885817 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:06:49.885817 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:06:49.885817 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:06:49.885817 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:06:49.885817 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:06:49.885817 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:06:49.887258 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:06:49.887258 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:06:49.887258 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:06:49.887258 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:06:49.887258 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:06:49.887258 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:06:49.887258 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:06:49.887258 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:06:49.887258 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:06:49.887258 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:06:49.887258 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:06:49.887258 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:06:49.887258 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:06:49.887258 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:06:49.887258 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:06:49.887258 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:06:49.888614 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:06:49.888614 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:06:49.888614 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:06:49.888614 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:06:49.888614 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:06:49.888614 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:06:49.888614 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:06:49.888614 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:06:49.888614 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:06:49.888614 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:06:49.888614 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:06:49.888614 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:06:49.889179 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-fe94a53d-4282-4cf2-a63b-45f2740e8459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:06:49.889710 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 33/68] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:06:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:06:49.893115 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a6059-ebe9-4a65-b581-f5e61050bba8 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:49.893630 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a6059-ebe9-4a65-b581-f5e61050bba8 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:49.893912 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212a6059-ebe9-4a65-b581-f5e61050bba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:49.913007 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-212a6059-ebe9-4a65-b581-f5e61050bba8 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:06:49.914204 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-212a6059-ebe9-4a65-b581-f5e61050bba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:06:49.968352 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 36/69] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:06:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:06:49.968352 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94a53d-4282-4cf2-a63b-45f2740e8459 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:49.996249 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 34/70] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:06:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:06:49.997218 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a6059-ebe9-4a65-b581-f5e61050bba8 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:50.068120 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:50.071050 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:50.083728 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe94a53d-4282-4cf2-a63b-45f2740e8459 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:50.102933 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212a6059-ebe9-4a65-b581-f5e61050bba8 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:50.120242 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe592e-d62f-483a-98de-58c34cbcbe10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:50.121516 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe592e-d62f-483a-98de-58c34cbcbe10 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:50.121826 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe592e-d62f-483a-98de-58c34cbcbe10 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:50.122254 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe592e-d62f-483a-98de-58c34cbcbe10 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:50.132823 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe592e-d62f-483a-98de-58c34cbcbe10 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:06:50.138133 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-53fe592e-d62f-483a-98de-58c34cbcbe10 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:06:50.138133 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:06:50.138133 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:06:50.138133 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:06:50.138133 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:06:50.138133 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:06:50.138133 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:06:50.138133 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:06:50.138133 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:06:50.138133 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:06:50.138133 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:06:50.138133 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:06:50.138133 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:06:50.138133 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:06:50.138133 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:06:50.138133 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:06:50.139151 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:06:50.139151 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:06:50.139151 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:06:50.139151 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:06:50.139151 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:06:50.139151 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:06:50.139151 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:06:50.139151 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:06:50.139151 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:06:50.139151 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:06:50.139151 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:06:50.139151 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:06:50.139151 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:06:50.139151 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:06:50.139151 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:06:50.139151 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:06:50.139921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:06:50.139921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:06:50.139921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:06:50.139921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:06:50.139921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:06:50.139921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:06:50.139921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:06:50.139921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:06:50.139921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:06:50.139921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:06:50.139921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:06:50.139921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:06:50.140536 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c43e5-8f04-4edf-bf55-3d1a8530459c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:50.140536 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c43e5-8f04-4edf-bf55-3d1a8530459c None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:50.140536 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c43e5-8f04-4edf-bf55-3d1a8530459c None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:50.140536 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-118c43e5-8f04-4edf-bf55-3d1a8530459c None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:50.140801 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 37/71] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:06:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:06:50.140801 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe592e-d62f-483a-98de-58c34cbcbe10 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:50.144764 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c43e5-8f04-4edf-bf55-3d1a8530459c None admin] RBAC: Adding query filter params (name=member) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:06:50.145084 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c43e5-8f04-4edf-bf55-3d1a8530459c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:50.146464 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-118c43e5-8f04-4edf-bf55-3d1a8530459c None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:50.155714 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 35/72] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Aug 5 02:06:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:06:50.156604 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c43e5-8f04-4edf-bf55-3d1a8530459c None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:50.240461 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe592e-d62f-483a-98de-58c34cbcbe10 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:50.258208 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-118c43e5-8f04-4edf-bf55-3d1a8530459c None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:50.273487 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c935f40a-3260-4223-a826-9a67cfadf21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:50.274128 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935f40a-3260-4223-a826-9a67cfadf21b None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:50.274410 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935f40a-3260-4223-a826-9a67cfadf21b None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:50.274693 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935f40a-3260-4223-a826-9a67cfadf21b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:50.285229 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c935f40a-3260-4223-a826-9a67cfadf21b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:06:50.286793 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:50.290532 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-c935f40a-3260-4223-a826-9a67cfadf21b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:06:50.290532 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:06:50.290532 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:06:50.290532 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:06:50.290532 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:06:50.290532 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:06:50.290532 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:06:50.290532 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:06:50.290532 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:06:50.290532 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:06:50.290532 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:06:50.290532 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:06:50.290532 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:06:50.290532 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:06:50.290532 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:06:50.290532 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:06:50.291379 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:06:50.291379 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:06:50.291379 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:06:50.291379 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:06:50.291379 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:06:50.291379 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:06:50.291379 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:06:50.291379 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:06:50.291379 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:06:50.291379 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:06:50.291379 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:06:50.291379 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:06:50.291379 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:06:50.291379 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:06:50.291379 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:06:50.291379 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:06:50.292768 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:06:50.292768 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:06:50.292768 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:06:50.292768 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:06:50.292768 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:06:50.292768 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:06:50.292768 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:06:50.292768 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:06:50.292768 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:06:50.292768 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:06:50.292768 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:06:50.292768 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:06:50.292768 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 38/73] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Aug 5 02:06:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:06:50.293887 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d8bb0-dd34-4aed-a53d-9a0d6c72dde5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:50.293977 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4908cb-86ec-40e3-b6c6-2de65d83ad74 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:50.293977 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4908cb-86ec-40e3-b6c6-2de65d83ad74 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:50.294100 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d8bb0-dd34-4aed-a53d-9a0d6c72dde5 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:50.294164 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4908cb-86ec-40e3-b6c6-2de65d83ad74 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:50.294232 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d8bb0-dd34-4aed-a53d-9a0d6c72dde5 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:50.294232 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa3d8bb0-dd34-4aed-a53d-9a0d6c72dde5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:50.294893 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 39/74] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:06:50 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:06:50.295394 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4908cb-86ec-40e3-b6c6-2de65d83ad74 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:50.306456 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:50.306682 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa3d8bb0-dd34-4aed-a53d-9a0d6c72dde5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:06:50.313388 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-fa3d8bb0-dd34-4aed-a53d-9a0d6c72dde5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:06:50.313388 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:06:50.313388 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:06:50.313388 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:06:50.313388 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:06:50.313388 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:06:50.313388 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:06:50.313388 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:06:50.313388 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:06:50.313388 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:06:50.313388 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:06:50.313388 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:06:50.313388 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:06:50.313388 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:06:50.313388 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:06:50.313388 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:06:50.314252 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:06:50.314252 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:06:50.314252 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:06:50.314252 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:06:50.314252 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:06:50.314252 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:06:50.314252 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:06:50.314252 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:06:50.314252 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:06:50.314252 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:06:50.314252 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:06:50.314252 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:06:50.314252 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:06:50.314252 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:06:50.314252 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:06:50.314252 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:06:50.314997 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:06:50.314997 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:06:50.314997 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:06:50.314997 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:06:50.314997 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:06:50.314997 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:06:50.314997 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:06:50.314997 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:06:50.314997 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:06:50.314997 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:06:50.314997 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:06:50.314997 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:06:50.314997 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 36/75] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Aug 5 02:06:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:06:50.315627 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d8bb0-dd34-4aed-a53d-9a0d6c72dde5 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:50.403838 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4908cb-86ec-40e3-b6c6-2de65d83ad74 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:50.413186 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa3d8bb0-dd34-4aed-a53d-9a0d6c72dde5 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:50.436768 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aacc439-7a3a-4b02-854b-3adee639a241 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:50.437382 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aacc439-7a3a-4b02-854b-3adee639a241 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:50.437665 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aacc439-7a3a-4b02-854b-3adee639a241 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:50.437941 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1aacc439-7a3a-4b02-854b-3adee639a241 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:50.438660 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aacc439-7a3a-4b02-854b-3adee639a241 None admin] RBAC: Adding query filter params (name=member) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:06:50.438969 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aacc439-7a3a-4b02-854b-3adee639a241 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:50.440370 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1aacc439-7a3a-4b02-854b-3adee639a241 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:50.446961 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84bd545f-da85-4088-9766-ca0f9a857961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:50.447596 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd545f-da85-4088-9766-ca0f9a857961 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:50.447883 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd545f-da85-4088-9766-ca0f9a857961 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:50.448166 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84bd545f-da85-4088-9766-ca0f9a857961 None admin] PATH_INFO: `/v3/users/d91b409307d64b3fb23df25bc6e6dfdc` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:50.448399 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 40/76] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Aug 5 02:06:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:06:50.450133 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aacc439-7a3a-4b02-854b-3adee639a241 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:50.462308 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bd545f-da85-4088-9766-ca0f9a857961 None admin] RBAC: Authorizing `identity:get_user(user_id=d91b409307d64b3fb23df25bc6e6dfdc)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:50.463765 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84bd545f-da85-4088-9766-ca0f9a857961 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:50.466240 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 37/77] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:06:50 2022] GET /identity/v3/users/d91b409307d64b3fb23df25bc6e6dfdc => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:06:50.467394 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b24964-6ffa-44a1-863b-c98f7cc89c21 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:50.467675 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b24964-6ffa-44a1-863b-c98f7cc89c21 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:50.467950 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6b24964-6ffa-44a1-863b-c98f7cc89c21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:50.485141 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-f6b24964-6ffa-44a1-863b-c98f7cc89c21 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:06:50.486367 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-f6b24964-6ffa-44a1-863b-c98f7cc89c21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:06:50.528349 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:50.533756 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:50.555263 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 38/78] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:06:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:06:50.556084 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b24964-6ffa-44a1-863b-c98f7cc89c21 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:50.565470 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1aacc439-7a3a-4b02-854b-3adee639a241 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:50.600985 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc504d79-d3f8-4b92-82d2-0f53f1975b84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:50.601606 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc504d79-d3f8-4b92-82d2-0f53f1975b84 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:50.601891 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc504d79-d3f8-4b92-82d2-0f53f1975b84 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:50.602165 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc504d79-d3f8-4b92-82d2-0f53f1975b84 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:50.602877 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc504d79-d3f8-4b92-82d2-0f53f1975b84 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:06:50.603177 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc504d79-d3f8-4b92-82d2-0f53f1975b84 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:50.604575 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc504d79-d3f8-4b92-82d2-0f53f1975b84 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:50.612863 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 41/79] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:06:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:06:50.617214 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc504d79-d3f8-4b92-82d2-0f53f1975b84 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:50.665664 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6b24964-6ffa-44a1-863b-c98f7cc89c21 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:50.698332 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8104e9-9772-48b3-9b65-bb4e3c285d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:50.699474 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8104e9-9772-48b3-9b65-bb4e3c285d38 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:50.699754 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8104e9-9772-48b3-9b65-bb4e3c285d38 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:50.700031 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8104e9-9772-48b3-9b65-bb4e3c285d38 None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:50.700780 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8104e9-9772-48b3-9b65-bb4e3c285d38 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:06:50.701087 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8104e9-9772-48b3-9b65-bb4e3c285d38 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:50.702456 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8104e9-9772-48b3-9b65-bb4e3c285d38 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:50.710151 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 39/80] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:06:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:06:50.710935 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8104e9-9772-48b3-9b65-bb4e3c285d38 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:50.715944 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc504d79-d3f8-4b92-82d2-0f53f1975b84 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:50.745073 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:50.750700 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c964dcf-80f6-489b-843e-4b5db86d315c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:50.751749 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c964dcf-80f6-489b-843e-4b5db86d315c None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:50.752036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c964dcf-80f6-489b-843e-4b5db86d315c None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:50.752319 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c964dcf-80f6-489b-843e-4b5db86d315c None admin] PATH_INFO: `/v3/users/d91b409307d64b3fb23df25bc6e6dfdc` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:50.753565 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c964dcf-80f6-489b-843e-4b5db86d315c None admin] RBAC: Authorizing `identity:get_user(user_id=d91b409307d64b3fb23df25bc6e6dfdc)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:50.754857 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:50.755045 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c964dcf-80f6-489b-843e-4b5db86d315c None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:50.756687 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 42/81] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:06:50 2022] GET /identity/v3/users/d91b409307d64b3fb23df25bc6e6dfdc => generated 275 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:06:50.757463 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c964dcf-80f6-489b-843e-4b5db86d315c None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:50.816754 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8104e9-9772-48b3-9b65-bb4e3c285d38 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:50.852066 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f2dac-f278-4f12-a000-38b22bd66620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:50.852719 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f2dac-f278-4f12-a000-38b22bd66620 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:50.853002 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f2dac-f278-4f12-a000-38b22bd66620 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:50.853279 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f2dac-f278-4f12-a000-38b22bd66620 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:50.859299 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c964dcf-80f6-489b-843e-4b5db86d315c None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:50.894713 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce86f8-7eed-48cc-a40c-faeb783b2831 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:50.895359 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce86f8-7eed-48cc-a40c-faeb783b2831 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:50.895984 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce86f8-7eed-48cc-a40c-faeb783b2831 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:50.896270 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce86f8-7eed-48cc-a40c-faeb783b2831 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:50.897475 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce86f8-7eed-48cc-a40c-faeb783b2831 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:50.898921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce86f8-7eed-48cc-a40c-faeb783b2831 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:50.900554 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 43/82] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:06:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:06:50.901325 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce86f8-7eed-48cc-a40c-faeb783b2831 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:50.924450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f2dac-f278-4f12-a000-38b22bd66620 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:50.925934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f2dac-f278-4f12-a000-38b22bd66620 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:50.967007 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:50.967461 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:51.001979 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce86f8-7eed-48cc-a40c-faeb783b2831 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:51.023097 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 40/83] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:06:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:06:51.024005 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f2dac-f278-4f12-a000-38b22bd66620 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:51.035995 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d1875-ffee-4879-999c-67862d4a3b66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:51.036682 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d1875-ffee-4879-999c-67862d4a3b66 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:51.036966 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d1875-ffee-4879-999c-67862d4a3b66 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:51.037243 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa7d1875-ffee-4879-999c-67862d4a3b66 None admin] PATH_INFO: `/v3/users/c5c6e2a1691a410eaac17764c32341d7` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:51.038425 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d1875-ffee-4879-999c-67862d4a3b66 None admin] RBAC: Authorizing `identity:get_user(user_id=c5c6e2a1691a410eaac17764c32341d7)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:51.039874 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa7d1875-ffee-4879-999c-67862d4a3b66 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:51.041626 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 44/84] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:06:50 2022] GET /identity/v3/users/c5c6e2a1691a410eaac17764c32341d7 => generated 247 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:06:51.042256 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d1875-ffee-4879-999c-67862d4a3b66 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:51.125484 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f2dac-f278-4f12-a000-38b22bd66620 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:51.145435 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa7d1875-ffee-4879-999c-67862d4a3b66 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:51.160272 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b516cfd-d0c9-4253-a2b1-4cf8f2b2d20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:51.160951 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b516cfd-d0c9-4253-a2b1-4cf8f2b2d20c None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:51.161235 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b516cfd-d0c9-4253-a2b1-4cf8f2b2d20c None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:51.161515 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b516cfd-d0c9-4253-a2b1-4cf8f2b2d20c None admin] PATH_INFO: `/v3/users/d91b409307d64b3fb23df25bc6e6dfdc` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:51.162684 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b516cfd-d0c9-4253-a2b1-4cf8f2b2d20c None admin] RBAC: Authorizing `identity:get_user(user_id=d91b409307d64b3fb23df25bc6e6dfdc)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:51.164136 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b516cfd-d0c9-4253-a2b1-4cf8f2b2d20c None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:51.165805 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 41/85] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:06:51 2022] GET /identity/v3/users/d91b409307d64b3fb23df25bc6e6dfdc => generated 275 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:06:51.166553 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b516cfd-d0c9-4253-a2b1-4cf8f2b2d20c None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:51.179279 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:51.185418 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5156feb6-0833-43a1-97ee-f678392ac439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:51.186064 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156feb6-0833-43a1-97ee-f678392ac439 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:51.186350 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156feb6-0833-43a1-97ee-f678392ac439 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:51.186631 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5156feb6-0833-43a1-97ee-f678392ac439 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:51.190075 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:51.254872 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5156feb6-0833-43a1-97ee-f678392ac439 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:51.256407 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5156feb6-0833-43a1-97ee-f678392ac439 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:51.266491 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b516cfd-d0c9-4253-a2b1-4cf8f2b2d20c None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:51.300119 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc6e27-dfb6-44cc-a657-2abeafc6d544 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:51.300754 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc6e27-dfb6-44cc-a657-2abeafc6d544 None admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:51.301032 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc6e27-dfb6-44cc-a657-2abeafc6d544 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:51.301307 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edc6e27-dfb6-44cc-a657-2abeafc6d544 None admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:51.301982 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc6e27-dfb6-44cc-a657-2abeafc6d544 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:51.303469 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edc6e27-dfb6-44cc-a657-2abeafc6d544 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:51.330188 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 42/86] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Aug 5 02:06:51 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:06:51.331002 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc6e27-dfb6-44cc-a657-2abeafc6d544 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:51.368811 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 45/87] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:06:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:06:51.368811 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5156feb6-0833-43a1-97ee-f678392ac439 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:51.404063 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:51.410589 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:51.455409 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edc6e27-dfb6-44cc-a657-2abeafc6d544 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:51.479762 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5156feb6-0833-43a1-97ee-f678392ac439 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:51.499055 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d567aad-95e5-48fb-a0f0-146391066d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:51.499650 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d567aad-95e5-48fb-a0f0-146391066d7b None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:51.499953 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d567aad-95e5-48fb-a0f0-146391066d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:51.500202 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d567aad-95e5-48fb-a0f0-146391066d7b None admin] PATH_INFO: `/v3/projects/758af4bbce9a439eb91820fb4527231a` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:51.501430 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d567aad-95e5-48fb-a0f0-146391066d7b None admin] RBAC: Authorizing `identity:get_project(project_id=758af4bbce9a439eb91820fb4527231a)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:51.502844 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d567aad-95e5-48fb-a0f0-146391066d7b None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:51.504977 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 43/88] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:06:51 2022] GET /identity/v3/projects/758af4bbce9a439eb91820fb4527231a => generated 298 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:06:51.505766 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d567aad-95e5-48fb-a0f0-146391066d7b None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:51.524943 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5930a-77e7-463a-876b-43b89bb4ce26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:51.525571 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5930a-77e7-463a-876b-43b89bb4ce26 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:51.525855 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5930a-77e7-463a-876b-43b89bb4ce26 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:51.526158 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f5930a-77e7-463a-876b-43b89bb4ce26 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:51.613376 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f5930a-77e7-463a-876b-43b89bb4ce26 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:51.614961 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f5930a-77e7-463a-876b-43b89bb4ce26 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:51.630146 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d567aad-95e5-48fb-a0f0-146391066d7b None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:51.665511 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:51.677052 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738223be-bdb5-40a1-aec8-921f0a8be31b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:51.677688 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738223be-bdb5-40a1-aec8-921f0a8be31b None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:51.677979 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738223be-bdb5-40a1-aec8-921f0a8be31b None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:51.678259 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-738223be-bdb5-40a1-aec8-921f0a8be31b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:51.681682 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:51.739311 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 46/89] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:06:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:06:51.740439 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5930a-77e7-463a-876b-43b89bb4ce26 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:51.780183 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738223be-bdb5-40a1-aec8-921f0a8be31b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:51.781850 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-738223be-bdb5-40a1-aec8-921f0a8be31b None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:51.863378 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f5930a-77e7-463a-876b-43b89bb4ce26 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:51.920575 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 44/90] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:06:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:06:51.920575 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738223be-bdb5-40a1-aec8-921f0a8be31b None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:51.925708 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f1012-6bb7-452d-bd47-83d6bc911fc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:51.925708 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f1012-6bb7-452d-bd47-83d6bc911fc5 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:51.925708 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f1012-6bb7-452d-bd47-83d6bc911fc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:51.925708 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720f1012-6bb7-452d-bd47-83d6bc911fc5 None admin] PATH_INFO: `/v3/projects/bc21d3271bc242269a0b17ac6504bde5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:51.927171 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f1012-6bb7-452d-bd47-83d6bc911fc5 None admin] RBAC: Authorizing `identity:get_project(project_id=bc21d3271bc242269a0b17ac6504bde5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:51.928515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720f1012-6bb7-452d-bd47-83d6bc911fc5 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:51.930191 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 47/91] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:06:51 2022] GET /identity/v3/projects/bc21d3271bc242269a0b17ac6504bde5 => generated 312 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:06:51.930956 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f1012-6bb7-452d-bd47-83d6bc911fc5 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:51.935862 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:51.972898 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:52.055914 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-738223be-bdb5-40a1-aec8-921f0a8be31b None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:52.073218 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720f1012-6bb7-452d-bd47-83d6bc911fc5 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:52.101156 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bcc7f0-b8e3-4518-bfb9-5e579fb627dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:52.102321 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcc7f0-b8e3-4518-bfb9-5e579fb627dd None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:52.103131 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcc7f0-b8e3-4518-bfb9-5e579fb627dd None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:52.104136 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2bcc7f0-b8e3-4518-bfb9-5e579fb627dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:52.105930 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bcc7f0-b8e3-4518-bfb9-5e579fb627dd None admin] RBAC: Adding query filter params (role.id=33cd9c7fcf9b4bbe9d604952279e8d76, scope.project.id=758af4bbce9a439eb91820fb4527231a, user.id=d91b409307d64b3fb23df25bc6e6dfdc) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:06:52.106866 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bcc7f0-b8e3-4518-bfb9-5e579fb627dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:52.109147 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2bcc7f0-b8e3-4518-bfb9-5e579fb627dd None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:52.111586 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c5009-67f5-4de2-bb54-9bad437948c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:52.112317 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c5009-67f5-4de2-bb54-9bad437948c4 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:52.112717 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c5009-67f5-4de2-bb54-9bad437948c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:52.113052 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4c5009-67f5-4de2-bb54-9bad437948c4 None admin] PATH_INFO: `/v3/projects/758af4bbce9a439eb91820fb4527231a` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:52.114547 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c5009-67f5-4de2-bb54-9bad437948c4 None admin] RBAC: Authorizing `identity:get_project(project_id=758af4bbce9a439eb91820fb4527231a)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:52.116056 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4c5009-67f5-4de2-bb54-9bad437948c4 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:52.116949 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 45/92] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:06:51 2022] GET /identity/v3/role_assignments?user.id=d91b409307d64b3fb23df25bc6e6dfdc&scope.project.id=758af4bbce9a439eb91820fb4527231a&role.id=33cd9c7fcf9b4bbe9d604952279e8d76 => generated 259 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:06:52.118019 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bcc7f0-b8e3-4518-bfb9-5e579fb627dd None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:52.126012 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 48/93] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:06:51 2022] GET /identity/v3/projects/758af4bbce9a439eb91820fb4527231a => generated 298 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:06:52.127100 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c5009-67f5-4de2-bb54-9bad437948c4 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:52.244965 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:52.251499 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2bcc7f0-b8e3-4518-bfb9-5e579fb627dd None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:52.295327 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c8250-d8f1-4c03-b3a7-8c904ebf059c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:52.296496 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c8250-d8f1-4c03-b3a7-8c904ebf059c None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:52.296963 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c8250-d8f1-4c03-b3a7-8c904ebf059c None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:52.297436 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3c8250-d8f1-4c03-b3a7-8c904ebf059c None admin] PATH_INFO: `/v3/projects/758af4bbce9a439eb91820fb4527231a` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:52.299080 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3c8250-d8f1-4c03-b3a7-8c904ebf059c None admin] RBAC: Authorizing `identity:get_project(project_id=758af4bbce9a439eb91820fb4527231a)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:52.300790 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3c8250-d8f1-4c03-b3a7-8c904ebf059c None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:52.308553 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 46/94] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:06:52 2022] GET /identity/v3/projects/758af4bbce9a439eb91820fb4527231a => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:06:52.309793 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c8250-d8f1-4c03-b3a7-8c904ebf059c None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:52.316581 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:52.381885 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4c5009-67f5-4de2-bb54-9bad437948c4 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:52.422512 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e492f54-07fe-478e-8257-f90b06872b2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:52.423227 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e492f54-07fe-478e-8257-f90b06872b2d None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:52.423585 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e492f54-07fe-478e-8257-f90b06872b2d None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:52.423932 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e492f54-07fe-478e-8257-f90b06872b2d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:52.424890 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e492f54-07fe-478e-8257-f90b06872b2d None admin] RBAC: Adding query filter params (role.id=33cd9c7fcf9b4bbe9d604952279e8d76, scope.project.id=bc21d3271bc242269a0b17ac6504bde5, user.id=d91b409307d64b3fb23df25bc6e6dfdc) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:06:52.425284 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e492f54-07fe-478e-8257-f90b06872b2d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:52.426866 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e492f54-07fe-478e-8257-f90b06872b2d None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:52.433361 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 49/95] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:06:52 2022] GET /identity/v3/role_assignments?user.id=d91b409307d64b3fb23df25bc6e6dfdc&scope.project.id=bc21d3271bc242269a0b17ac6504bde5&role.id=33cd9c7fcf9b4bbe9d604952279e8d76 => generated 259 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:06:52.441274 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e492f54-07fe-478e-8257-f90b06872b2d None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:52.442739 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3c8250-d8f1-4c03-b3a7-8c904ebf059c None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:52.484400 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9b205-fea0-44bc-98f7-9e88aafc2fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:52.485638 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9b205-fea0-44bc-98f7-9e88aafc2fda None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:52.486152 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9b205-fea0-44bc-98f7-9e88aafc2fda None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:52.486638 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9b205-fea0-44bc-98f7-9e88aafc2fda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:52.487749 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a9b205-fea0-44bc-98f7-9e88aafc2fda None admin] RBAC: Adding query filter params (role.id=e1b75d5eea2a43b2b1b14cf0515350fa, scope.project.id=758af4bbce9a439eb91820fb4527231a, user.id=c5c6e2a1691a410eaac17764c32341d7) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:06:52.488309 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a9b205-fea0-44bc-98f7-9e88aafc2fda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:52.490570 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a9b205-fea0-44bc-98f7-9e88aafc2fda None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:52.499335 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 47/96] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:06:52 2022] GET /identity/v3/role_assignments?user.id=c5c6e2a1691a410eaac17764c32341d7&scope.project.id=758af4bbce9a439eb91820fb4527231a&role.id=e1b75d5eea2a43b2b1b14cf0515350fa => generated 259 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:06:52.629893 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e492f54-07fe-478e-8257-f90b06872b2d None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:52.668237 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54f2ebf0-680e-42b0-9c96-50b5d8e67655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:52.668922 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2ebf0-680e-42b0-9c96-50b5d8e67655 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:52.669212 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2ebf0-680e-42b0-9c96-50b5d8e67655 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:52.669499 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54f2ebf0-680e-42b0-9c96-50b5d8e67655 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:52.670325 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f2ebf0-680e-42b0-9c96-50b5d8e67655 None admin] RBAC: Adding query filter params (role.id=5c52e382f2bc436d95d82f2a2fae8ace, scope.project.id=758af4bbce9a439eb91820fb4527231a, user.id=d91b409307d64b3fb23df25bc6e6dfdc) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:06:52.670639 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f2ebf0-680e-42b0-9c96-50b5d8e67655 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:52.672120 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54f2ebf0-680e-42b0-9c96-50b5d8e67655 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:52.678789 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 50/97] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:06:52 2022] GET /identity/v3/role_assignments?user.id=d91b409307d64b3fb23df25bc6e6dfdc&scope.project.id=758af4bbce9a439eb91820fb4527231a&role.id=5c52e382f2bc436d95d82f2a2fae8ace => generated 259 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:06:52.679340 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:53.896900 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21c3cf-43e7-4f97-b961-b7d61a4f0f1d None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:53.897871 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21c3cf-43e7-4f97-b961-b7d61a4f0f1d None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:53.898351 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d21c3cf-43e7-4f97-b961-b7d61a4f0f1d None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:53.900453 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 48/98] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:06:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:06:53.900557 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4ea0f-0f61-4ded-bc54-27a3c3e6d101 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:53.900950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4ea0f-0f61-4ded-bc54-27a3c3e6d101 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:53.901228 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c4ea0f-0f61-4ded-bc54-27a3c3e6d101 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:53.903550 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 51/99] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:06:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:06:53.908723 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75485aba-1afe-4114-9ae6-f3e962f3a6a8 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:53.909239 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75485aba-1afe-4114-9ae6-f3e962f3a6a8 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:53.909341 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea22fc-b8a5-4922-8ab0-5df4cbacf65a None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:53.909601 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea22fc-b8a5-4922-8ab0-5df4cbacf65a None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:53.909889 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bea22fc-b8a5-4922-8ab0-5df4cbacf65a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:53.910233 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75485aba-1afe-4114-9ae6-f3e962f3a6a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:53.931327 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-75485aba-1afe-4114-9ae6-f3e962f3a6a8 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:06:53.933013 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-75485aba-1afe-4114-9ae6-f3e962f3a6a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:06:53.943769 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-5bea22fc-b8a5-4922-8ab0-5df4cbacf65a None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:06:53.945048 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-5bea22fc-b8a5-4922-8ab0-5df4cbacf65a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:06:53.961095 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:54.014857 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 49/100] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:06:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:06:54.047575 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75485aba-1afe-4114-9ae6-f3e962f3a6a8 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:54.085486 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 52/101] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:06:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:06:54.119895 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea22fc-b8a5-4922-8ab0-5df4cbacf65a None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:54.175624 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75485aba-1afe-4114-9ae6-f3e962f3a6a8 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:54.212339 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23431d-a041-40b8-a185-2500a2b29dee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:54.213351 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23431d-a041-40b8-a185-2500a2b29dee None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:54.213903 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23431d-a041-40b8-a185-2500a2b29dee None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:54.214964 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b23431d-a041-40b8-a185-2500a2b29dee None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:54.226605 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b23431d-a041-40b8-a185-2500a2b29dee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:06:54.232267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-1b23431d-a041-40b8-a185-2500a2b29dee None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 02:06:54.232267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:06:54.232267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:06:54.232267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:06:54.232267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:06:54.232267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:06:54.232267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:06:54.232267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:06:54.232267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:06:54.232267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:06:54.232267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:06:54.232267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:06:54.232267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:06:54.232267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:06:54.232267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:06:54.232267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:06:54.233176 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:06:54.233176 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:06:54.233176 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:06:54.233176 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:06:54.233176 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:06:54.233176 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:06:54.233176 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:06:54.233176 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:06:54.233176 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:06:54.233176 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:06:54.233176 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:06:54.233176 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:06:54.233176 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:06:54.233176 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:06:54.233176 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:06:54.233176 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:06:54.233957 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:06:54.233957 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:06:54.233957 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:06:54.233957 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:06:54.233957 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:06:54.233957 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:06:54.233957 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:06:54.233957 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:06:54.233957 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:06:54.233957 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:06:54.233957 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 02:06:54.233957 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:06:54.236869 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 50/102] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:06:54 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:06:54.242035 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23431d-a041-40b8-a185-2500a2b29dee None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:54.283288 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:54.301315 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bea22fc-b8a5-4922-8ab0-5df4cbacf65a None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:54.336798 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:54.357323 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568f856-34aa-40ed-817f-28a850868e48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:54.358055 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568f856-34aa-40ed-817f-28a850868e48 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:54.358347 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568f856-34aa-40ed-817f-28a850868e48 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:54.358629 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9568f856-34aa-40ed-817f-28a850868e48 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:54.361098 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9568f856-34aa-40ed-817f-28a850868e48 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:54.362565 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9568f856-34aa-40ed-817f-28a850868e48 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:54.364198 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 53/103] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:06:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:06:54.373442 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568f856-34aa-40ed-817f-28a850868e48 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:54.412436 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b23431d-a041-40b8-a185-2500a2b29dee None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:54.517019 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcdd85a-9b0b-4b6d-bf9a-562021bf2885 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:54.517662 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcdd85a-9b0b-4b6d-bf9a-562021bf2885 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:54.517948 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcdd85a-9b0b-4b6d-bf9a-562021bf2885 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:54.518228 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcdd85a-9b0b-4b6d-bf9a-562021bf2885 None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:54.518963 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcdd85a-9b0b-4b6d-bf9a-562021bf2885 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:06:54.519273 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcdd85a-9b0b-4b6d-bf9a-562021bf2885 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:54.520690 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcdd85a-9b0b-4b6d-bf9a-562021bf2885 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:54.534248 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 51/104] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Aug 5 02:06:54 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:06:54.539631 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcdd85a-9b0b-4b6d-bf9a-562021bf2885 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:54.595743 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9568f856-34aa-40ed-817f-28a850868e48 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:54.655639 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15ca20-d4eb-4576-a868-56f70c1feb40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:54.656266 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15ca20-d4eb-4576-a868-56f70c1feb40 None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:54.656576 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15ca20-d4eb-4576-a868-56f70c1feb40 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:54.656855 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a15ca20-d4eb-4576-a868-56f70c1feb40 None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:54.657945 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a15ca20-d4eb-4576-a868-56f70c1feb40 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:54.665807 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a15ca20-d4eb-4576-a868-56f70c1feb40 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:54.712545 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 54/105] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Aug 5 02:06:54 2022] POST /identity/v3/projects => generated 302 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:06:54.732181 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:54.763596 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcdd85a-9b0b-4b6d-bf9a-562021bf2885 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:54.813718 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7d7ac-38ee-4dc3-b60a-5a31d1917454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:54.814719 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7d7ac-38ee-4dc3-b60a-5a31d1917454 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:54.815197 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7d7ac-38ee-4dc3-b60a-5a31d1917454 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:54.815720 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d7d7ac-38ee-4dc3-b60a-5a31d1917454 None admin] PATH_INFO: `/v3/users/8c80afce28044fe0bbb3c9f8cd3c3df0` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:54.842776 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d7d7ac-38ee-4dc3-b60a-5a31d1917454 None admin] RBAC: Authorizing `identity:get_user(user_id=8c80afce28044fe0bbb3c9f8cd3c3df0)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:54.843201 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7d7d7ac-38ee-4dc3-b60a-5a31d1917454 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:54.845387 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 52/106] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:06:54 2022] GET /identity/v3/users/8c80afce28044fe0bbb3c9f8cd3c3df0 => generated 289 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:06:54.850921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15ca20-d4eb-4576-a868-56f70c1feb40 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:54.939597 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:55.001005 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a15ca20-d4eb-4576-a868-56f70c1feb40 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:55.038856 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40504721-426f-43e5-9d11-ddedf6022d01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:55.039498 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40504721-426f-43e5-9d11-ddedf6022d01 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:55.039786 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40504721-426f-43e5-9d11-ddedf6022d01 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:55.040065 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40504721-426f-43e5-9d11-ddedf6022d01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:55.119688 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40504721-426f-43e5-9d11-ddedf6022d01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:55.122107 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40504721-426f-43e5-9d11-ddedf6022d01 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:55.176744 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:55.228018 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 55/107] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:06:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:06:55.234365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7d7ac-38ee-4dc3-b60a-5a31d1917454 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:55.369107 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7d7d7ac-38ee-4dc3-b60a-5a31d1917454 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:55.415910 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2926b45d-4add-4bc1-8f3d-f7ec4a6df6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:55.416934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926b45d-4add-4bc1-8f3d-f7ec4a6df6f8 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:55.417508 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926b45d-4add-4bc1-8f3d-f7ec4a6df6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:55.417999 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2926b45d-4add-4bc1-8f3d-f7ec4a6df6f8 None admin] PATH_INFO: `/v3/projects/758af4bbce9a439eb91820fb4527231a` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:55.419491 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2926b45d-4add-4bc1-8f3d-f7ec4a6df6f8 None admin] RBAC: Authorizing `identity:get_project(project_id=758af4bbce9a439eb91820fb4527231a)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:55.421167 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2926b45d-4add-4bc1-8f3d-f7ec4a6df6f8 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:55.423035 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 53/108] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:06:55 2022] GET /identity/v3/projects/758af4bbce9a439eb91820fb4527231a => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:06:55.433996 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40504721-426f-43e5-9d11-ddedf6022d01 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:55.477269 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b196c-9469-46b5-a9dd-6c0c3b630f9f None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:55.477971 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b196c-9469-46b5-a9dd-6c0c3b630f9f None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:55.478554 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e8b196c-9469-46b5-a9dd-6c0c3b630f9f None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:55.480370 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 54/109] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:06:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:06:55.491098 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f1e8e-e46d-4aa2-b0f2-88400ef001b2 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:55.491925 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f1e8e-e46d-4aa2-b0f2-88400ef001b2 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:55.494161 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6f1e8e-e46d-4aa2-b0f2-88400ef001b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:55.536926 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-4c6f1e8e-e46d-4aa2-b0f2-88400ef001b2 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:06:55.539031 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-4c6f1e8e-e46d-4aa2-b0f2-88400ef001b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:06:55.543677 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:55.619881 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40504721-426f-43e5-9d11-ddedf6022d01 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:55.655435 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 55/110] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:06:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:06:55.660388 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e02250-8111-4b21-b106-985cd60d5b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:55.660527 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e02250-8111-4b21-b106-985cd60d5b3f None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:55.660784 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e02250-8111-4b21-b106-985cd60d5b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:55.661127 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e02250-8111-4b21-b106-985cd60d5b3f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:55.662003 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e02250-8111-4b21-b106-985cd60d5b3f None admin] RBAC: Adding query filter params (role.id=1070d90fae74403eab5e52609af8ed78, scope.project.id=758af4bbce9a439eb91820fb4527231a, user.id=8c80afce28044fe0bbb3c9f8cd3c3df0) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:06:55.662369 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e02250-8111-4b21-b106-985cd60d5b3f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:55.662588 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1622c-ffb0-413e-9563-d612493a609e None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:55.663233 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1622c-ffb0-413e-9563-d612493a609e None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:55.663908 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b1622c-ffb0-413e-9563-d612493a609e None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:55.664014 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e02250-8111-4b21-b106-985cd60d5b3f None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:55.669017 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 56/111] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:06:55 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:06:55.670411 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457ea7f-ac26-4bcf-a40a-2173f0cb157d None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:55.670850 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457ea7f-ac26-4bcf-a40a-2173f0cb157d None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:55.671279 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0457ea7f-ac26-4bcf-a40a-2173f0cb157d None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:55.672715 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 57/112] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:06:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:06:55.676375 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 56/113] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:06:55 2022] GET /identity/v3/role_assignments?user.id=8c80afce28044fe0bbb3c9f8cd3c3df0&scope.project.id=758af4bbce9a439eb91820fb4527231a&role.id=1070d90fae74403eab5e52609af8ed78 => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:06:55.678091 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1ec5b-7bbe-42b2-9bc9-d997614dbb5b None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:55.678568 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1ec5b-7bbe-42b2-9bc9-d997614dbb5b None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:55.679012 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68e1ec5b-7bbe-42b2-9bc9-d997614dbb5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:55.680088 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5af4d2-a770-4666-bfbb-7f88a090e11e None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:55.680467 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5af4d2-a770-4666-bfbb-7f88a090e11e None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:55.680812 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf5af4d2-a770-4666-bfbb-7f88a090e11e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:55.712213 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-bf5af4d2-a770-4666-bfbb-7f88a090e11e None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:06:55.712527 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-68e1ec5b-7bbe-42b2-9bc9-d997614dbb5b None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:06:55.713611 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-bf5af4d2-a770-4666-bfbb-7f88a090e11e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:06:55.714074 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-68e1ec5b-7bbe-42b2-9bc9-d997614dbb5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:06:55.732172 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:55.796576 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 58/114] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:06:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:06:55.797782 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1ec5b-7bbe-42b2-9bc9-d997614dbb5b None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:55.876027 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 57/115] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:06:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Aug 05 02:06:55.878234 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a61b04-b27e-42ed-a7a0-478e232b595a None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:55.878603 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a61b04-b27e-42ed-a7a0-478e232b595a None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:55.878880 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a61b04-b27e-42ed-a7a0-478e232b595a None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:55.879888 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:55.880295 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 58/116] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:06:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:06:55.881014 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a61b04-b27e-42ed-a7a0-478e232b595a None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:55.923272 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68e1ec5b-7bbe-42b2-9bc9-d997614dbb5b None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:55.963512 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c9bf3c-b54f-4986-8e73-1bf8acca73d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:55.964198 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9bf3c-b54f-4986-8e73-1bf8acca73d1 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:55.964616 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9bf3c-b54f-4986-8e73-1bf8acca73d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:55.964616 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c9bf3c-b54f-4986-8e73-1bf8acca73d1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:55.976134 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c9bf3c-b54f-4986-8e73-1bf8acca73d1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:06:55.983622 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-c6c9bf3c-b54f-4986-8e73-1bf8acca73d1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:06:55.983622 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:06:55.983622 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:06:55.983622 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:06:55.983622 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:06:55.983622 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:06:55.983622 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:06:55.983622 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:06:55.983622 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:06:55.983622 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:06:55.983622 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:06:55.983622 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:06:55.983622 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:06:55.983622 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:06:55.983622 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:06:55.983622 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:06:55.984515 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:06:55.984515 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:06:55.984515 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:06:55.984515 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:06:55.984515 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:06:55.984515 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:06:55.984515 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:06:55.984515 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:06:55.984515 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:06:55.984515 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:06:55.984515 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:06:55.984515 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:06:55.984515 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:06:55.984515 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:06:55.984515 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:06:55.984515 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:06:55.985271 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:06:55.985271 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:06:55.985271 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:06:55.985271 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:06:55.985271 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:06:55.985271 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:06:55.985271 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:06:55.985271 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:06:55.985271 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:06:55.985271 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:06:55.985271 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:06:55.985271 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:06:55.985271 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 59/117] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Aug 5 02:06:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:06:55.990650 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0497f96-20ea-4e0b-ba24-3c55c513a096 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:55.990650 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0497f96-20ea-4e0b-ba24-3c55c513a096 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:55.990650 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0497f96-20ea-4e0b-ba24-3c55c513a096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:56.007314 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-f0497f96-20ea-4e0b-ba24-3c55c513a096 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:06:56.008551 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-f0497f96-20ea-4e0b-ba24-3c55c513a096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:06:56.020157 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20a61b04-b27e-42ed-a7a0-478e232b595a None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:56.061316 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ea3fb-1a6a-4ee6-aa3a-7704aa56e134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:56.062203 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ea3fb-1a6a-4ee6-aa3a-7704aa56e134 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:56.062627 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ea3fb-1a6a-4ee6-aa3a-7704aa56e134 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:56.063065 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769ea3fb-1a6a-4ee6-aa3a-7704aa56e134 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:56.075623 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769ea3fb-1a6a-4ee6-aa3a-7704aa56e134 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:06:56.081256 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-769ea3fb-1a6a-4ee6-aa3a-7704aa56e134 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:06:56.081256 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:06:56.081256 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:06:56.081256 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:06:56.081256 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:06:56.081256 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:06:56.081256 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:06:56.081256 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:06:56.081256 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:06:56.081256 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:06:56.081256 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:06:56.081256 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:06:56.081256 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:06:56.081256 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:06:56.081256 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:06:56.081256 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:06:56.082299 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:06:56.082299 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:06:56.082299 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:06:56.082299 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:06:56.082299 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:06:56.082299 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:06:56.082299 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:06:56.082299 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:06:56.082299 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:06:56.082299 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:06:56.082299 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:06:56.082299 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:06:56.082299 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:06:56.082299 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:06:56.082299 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:06:56.082299 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:06:56.083037 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:06:56.083037 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:06:56.083037 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:06:56.083037 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:06:56.083037 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:06:56.083037 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:06:56.083037 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:06:56.083037 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:06:56.083037 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:06:56.083037 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:06:56.083037 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:06:56.083037 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:06:56.085051 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 59/118] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:06:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:06:56.085996 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ea3fb-1a6a-4ee6-aa3a-7704aa56e134 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:56.090651 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 60/119] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:06:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:06:56.091597 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0497f96-20ea-4e0b-ba24-3c55c513a096 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:56.092066 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:56.156083 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:56.209235 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769ea3fb-1a6a-4ee6-aa3a-7704aa56e134 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:56.216181 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0497f96-20ea-4e0b-ba24-3c55c513a096 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:56.251354 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84593d4d-717e-405f-ab8a-547c6673e08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:56.252437 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84593d4d-717e-405f-ab8a-547c6673e08a None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:56.252965 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84593d4d-717e-405f-ab8a-547c6673e08a None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:56.253386 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84593d4d-717e-405f-ab8a-547c6673e08a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:56.255053 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27bade-fb6f-4970-9031-5d0ac274cc54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:56.255784 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27bade-fb6f-4970-9031-5d0ac274cc54 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:56.256164 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27bade-fb6f-4970-9031-5d0ac274cc54 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:56.256613 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef27bade-fb6f-4970-9031-5d0ac274cc54 None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:56.257455 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef27bade-fb6f-4970-9031-5d0ac274cc54 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:06:56.257853 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef27bade-fb6f-4970-9031-5d0ac274cc54 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:56.259352 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef27bade-fb6f-4970-9031-5d0ac274cc54 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:56.266858 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84593d4d-717e-405f-ab8a-547c6673e08a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:06:56.269270 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 61/120] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:06:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:06:56.273805 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27bade-fb6f-4970-9031-5d0ac274cc54 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:56.278492 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-84593d4d-717e-405f-ab8a-547c6673e08a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:06:56.278492 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:06:56.278492 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:06:56.278492 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:06:56.278492 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:06:56.278492 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:06:56.278492 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:06:56.278492 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:06:56.278492 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:06:56.278492 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:06:56.278492 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:06:56.278492 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:06:56.278492 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:06:56.278492 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:06:56.278492 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:06:56.278492 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:06:56.279522 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:06:56.279522 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:06:56.279522 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:06:56.279522 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:06:56.279522 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:06:56.279522 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:06:56.279522 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:06:56.279522 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:06:56.279522 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:06:56.279522 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:06:56.279522 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:06:56.279522 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:06:56.279522 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:06:56.279522 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:06:56.279522 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:06:56.279522 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:06:56.280488 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:06:56.280488 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:06:56.280488 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:06:56.280488 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:06:56.280488 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:06:56.280488 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:06:56.280488 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:06:56.280488 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:06:56.280488 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:06:56.280488 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:06:56.280488 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:06:56.280488 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:06:56.282598 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 60/121] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:06:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:06:56.283623 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84593d4d-717e-405f-ab8a-547c6673e08a None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:56.369302 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:56.390942 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef27bade-fb6f-4970-9031-5d0ac274cc54 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:56.417294 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:56.420181 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84593d4d-717e-405f-ab8a-547c6673e08a None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:56.435640 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616cfc0d-3877-4b67-939e-77897de2275f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:56.436537 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616cfc0d-3877-4b67-939e-77897de2275f None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:56.436964 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616cfc0d-3877-4b67-939e-77897de2275f None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:56.437482 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616cfc0d-3877-4b67-939e-77897de2275f None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:56.438455 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616cfc0d-3877-4b67-939e-77897de2275f None admin] RBAC: Adding query filter params (name=member) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:06:56.438910 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616cfc0d-3877-4b67-939e-77897de2275f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:56.440558 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616cfc0d-3877-4b67-939e-77897de2275f None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:56.451920 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 62/122] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Aug 5 02:06:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:06:56.452983 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616cfc0d-3877-4b67-939e-77897de2275f None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:56.467829 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4dea6-e545-4ff1-aac5-3db2ad6f9b01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:56.468609 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4dea6-e545-4ff1-aac5-3db2ad6f9b01 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:56.469319 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4dea6-e545-4ff1-aac5-3db2ad6f9b01 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:56.469707 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f4dea6-e545-4ff1-aac5-3db2ad6f9b01 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:56.483659 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f4dea6-e545-4ff1-aac5-3db2ad6f9b01 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:06:56.490510 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-88f4dea6-e545-4ff1-aac5-3db2ad6f9b01 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:06:56.490510 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:06:56.490510 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:06:56.490510 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:06:56.490510 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:06:56.490510 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:06:56.490510 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:06:56.490510 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:06:56.490510 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:06:56.490510 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:06:56.490510 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:06:56.490510 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:06:56.490510 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:06:56.490510 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:06:56.490510 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:06:56.490510 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:06:56.491393 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:06:56.491393 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:06:56.491393 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:06:56.491393 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:06:56.491393 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:06:56.491393 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:06:56.491393 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:06:56.491393 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:06:56.491393 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:06:56.491393 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:06:56.491393 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:06:56.491393 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:06:56.491393 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:06:56.491393 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:06:56.491393 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:06:56.491393 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:06:56.492174 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:06:56.492174 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:06:56.492174 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:06:56.492174 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:06:56.492174 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:06:56.492174 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:06:56.492174 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:06:56.492174 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:06:56.492174 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:06:56.492174 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:06:56.492174 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:06:56.492174 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:06:56.492174 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 61/123] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Aug 5 02:06:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:06:56.493795 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4dea6-e545-4ff1-aac5-3db2ad6f9b01 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:56.581692 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616cfc0d-3877-4b67-939e-77897de2275f None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:56.621060 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f4dea6-e545-4ff1-aac5-3db2ad6f9b01 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:56.623814 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386430b0-8179-4001-909a-2a119513afe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:56.624735 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386430b0-8179-4001-909a-2a119513afe1 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:56.625186 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386430b0-8179-4001-909a-2a119513afe1 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:56.625658 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-386430b0-8179-4001-909a-2a119513afe1 None admin] PATH_INFO: `/v3/users/d91b409307d64b3fb23df25bc6e6dfdc` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:56.627039 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386430b0-8179-4001-909a-2a119513afe1 None admin] RBAC: Authorizing `identity:get_user(user_id=d91b409307d64b3fb23df25bc6e6dfdc)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:56.628791 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-386430b0-8179-4001-909a-2a119513afe1 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:56.630643 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 63/124] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:06:56 2022] GET /identity/v3/users/d91b409307d64b3fb23df25bc6e6dfdc => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:06:56.636770 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386430b0-8179-4001-909a-2a119513afe1 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:56.648079 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:56.667478 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f52c49-cbda-4947-a64e-d81ab483b5cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:56.668194 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f52c49-cbda-4947-a64e-d81ab483b5cb None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:56.668515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f52c49-cbda-4947-a64e-d81ab483b5cb None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:56.668790 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f52c49-cbda-4947-a64e-d81ab483b5cb None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:56.669514 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f52c49-cbda-4947-a64e-d81ab483b5cb None admin] RBAC: Adding query filter params (name=member) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:06:56.669818 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f52c49-cbda-4947-a64e-d81ab483b5cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:56.671192 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f52c49-cbda-4947-a64e-d81ab483b5cb None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:56.681956 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 62/125] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Aug 5 02:06:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:06:56.682767 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f52c49-cbda-4947-a64e-d81ab483b5cb None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:56.710878 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:56.777913 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-386430b0-8179-4001-909a-2a119513afe1 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:56.809192 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f52c49-cbda-4947-a64e-d81ab483b5cb None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:56.815428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e393cd-7795-4a71-871b-820c4fdf5f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:56.816179 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e393cd-7795-4a71-871b-820c4fdf5f16 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:56.816616 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e393cd-7795-4a71-871b-820c4fdf5f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:56.816987 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e393cd-7795-4a71-871b-820c4fdf5f16 None admin] PATH_INFO: `/v3/users/d91b409307d64b3fb23df25bc6e6dfdc` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:56.818362 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e393cd-7795-4a71-871b-820c4fdf5f16 None admin] RBAC: Authorizing `identity:get_user(user_id=d91b409307d64b3fb23df25bc6e6dfdc)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:56.819939 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e393cd-7795-4a71-871b-820c4fdf5f16 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:56.826400 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 64/126] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:06:56 2022] GET /identity/v3/users/d91b409307d64b3fb23df25bc6e6dfdc => generated 275 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:06:56.826400 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e393cd-7795-4a71-871b-820c4fdf5f16 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:56.863207 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5049d0-2743-4289-b2f8-ea6e5f7d9534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:56.864386 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5049d0-2743-4289-b2f8-ea6e5f7d9534 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:56.864819 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5049d0-2743-4289-b2f8-ea6e5f7d9534 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:56.865631 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5049d0-2743-4289-b2f8-ea6e5f7d9534 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:56.866807 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5049d0-2743-4289-b2f8-ea6e5f7d9534 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:06:56.867251 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5049d0-2743-4289-b2f8-ea6e5f7d9534 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:56.869696 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc5049d0-2743-4289-b2f8-ea6e5f7d9534 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:56.880967 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 63/127] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:06:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:06:56.882441 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5049d0-2743-4289-b2f8-ea6e5f7d9534 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:56.945151 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:56.949445 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e393cd-7795-4a71-871b-820c4fdf5f16 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:56.968745 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:56.988075 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75461d-330c-404e-915d-69819840d0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:56.988862 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75461d-330c-404e-915d-69819840d0b2 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:56.989216 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75461d-330c-404e-915d-69819840d0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:56.989756 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a75461d-330c-404e-915d-69819840d0b2 None admin] PATH_INFO: `/v3/projects/758af4bbce9a439eb91820fb4527231a` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:56.990920 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a75461d-330c-404e-915d-69819840d0b2 None admin] RBAC: Authorizing `identity:get_project(project_id=758af4bbce9a439eb91820fb4527231a)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:56.992575 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a75461d-330c-404e-915d-69819840d0b2 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:56.994511 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 65/128] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:06:56 2022] GET /identity/v3/projects/758af4bbce9a439eb91820fb4527231a => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:06:57.000208 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75461d-330c-404e-915d-69819840d0b2 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:57.003655 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5049d0-2743-4289-b2f8-ea6e5f7d9534 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:57.039197 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b92f7-1fb0-40fe-b626-ac9834de0be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:57.040665 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b92f7-1fb0-40fe-b626-ac9834de0be1 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:57.041122 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b92f7-1fb0-40fe-b626-ac9834de0be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:57.041570 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013b92f7-1fb0-40fe-b626-ac9834de0be1 None admin] PATH_INFO: `/v3/users/d91b409307d64b3fb23df25bc6e6dfdc` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:57.043818 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b92f7-1fb0-40fe-b626-ac9834de0be1 None admin] RBAC: Authorizing `identity:get_user(user_id=d91b409307d64b3fb23df25bc6e6dfdc)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:57.045483 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-013b92f7-1fb0-40fe-b626-ac9834de0be1 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:57.047295 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 64/129] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:06:56 2022] GET /identity/v3/users/d91b409307d64b3fb23df25bc6e6dfdc => generated 275 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:06:57.052614 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b92f7-1fb0-40fe-b626-ac9834de0be1 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:57.109061 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a75461d-330c-404e-915d-69819840d0b2 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:57.145219 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7565e-a597-419e-a38f-756c71209f7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:57.145912 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7565e-a597-419e-a38f-756c71209f7f None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:57.146240 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7565e-a597-419e-a38f-756c71209f7f None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:57.146524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e7565e-a597-419e-a38f-756c71209f7f None admin] PATH_INFO: `/v3/projects/758af4bbce9a439eb91820fb4527231a` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:57.147724 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e7565e-a597-419e-a38f-756c71209f7f None admin] RBAC: Authorizing `identity:get_project(project_id=758af4bbce9a439eb91820fb4527231a)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:57.149295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41e7565e-a597-419e-a38f-756c71209f7f None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:57.151004 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 66/130] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:06:56 2022] GET /identity/v3/projects/758af4bbce9a439eb91820fb4527231a => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:06:57.152642 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7565e-a597-419e-a38f-756c71209f7f None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:57.162281 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013b92f7-1fb0-40fe-b626-ac9834de0be1 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:57.178942 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:57.200867 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a554cab-cbdc-4947-b674-d858b2fc788c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:57.201862 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a554cab-cbdc-4947-b674-d858b2fc788c None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:57.202357 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a554cab-cbdc-4947-b674-d858b2fc788c None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:57.202829 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a554cab-cbdc-4947-b674-d858b2fc788c None admin] PATH_INFO: `/v3/users/c5c6e2a1691a410eaac17764c32341d7` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:57.204196 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a554cab-cbdc-4947-b674-d858b2fc788c None admin] RBAC: Authorizing `identity:get_user(user_id=c5c6e2a1691a410eaac17764c32341d7)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:57.205877 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a554cab-cbdc-4947-b674-d858b2fc788c None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:57.207696 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 65/131] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:06:57 2022] GET /identity/v3/users/c5c6e2a1691a410eaac17764c32341d7 => generated 247 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:06:57.208851 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a554cab-cbdc-4947-b674-d858b2fc788c None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:57.217092 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:57.269902 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e7565e-a597-419e-a38f-756c71209f7f None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:57.309020 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad60b71-28c3-4a79-98b8-6716e68147d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:57.309665 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad60b71-28c3-4a79-98b8-6716e68147d2 None admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:57.310375 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad60b71-28c3-4a79-98b8-6716e68147d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:57.310661 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad60b71-28c3-4a79-98b8-6716e68147d2 None admin] PATH_INFO: `/v3/projects/758af4bbce9a439eb91820fb4527231a/users/d91b409307d64b3fb23df25bc6e6dfdc/roles/5c52e382f2bc436d95d82f2a2fae8ace` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:57.313273 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad60b71-28c3-4a79-98b8-6716e68147d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=758af4bbce9a439eb91820fb4527231a, user_id=d91b409307d64b3fb23df25bc6e6dfdc, role_id=5c52e382f2bc436d95d82f2a2fae8ace)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:57.313381 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a554cab-cbdc-4947-b674-d858b2fc788c None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:57.314836 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad60b71-28c3-4a79-98b8-6716e68147d2 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:57.334378 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 67/132] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Aug 5 02:06:57 2022] PUT /identity/v3/projects/758af4bbce9a439eb91820fb4527231a/users/d91b409307d64b3fb23df25bc6e6dfdc/roles/5c52e382f2bc436d95d82f2a2fae8ace => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:06:57.335229 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad60b71-28c3-4a79-98b8-6716e68147d2 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:57.397168 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15476db-bc9e-44d9-85cc-15b51fa16ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:57.397864 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15476db-bc9e-44d9-85cc-15b51fa16ade None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:57.398155 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15476db-bc9e-44d9-85cc-15b51fa16ade None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:57.398439 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15476db-bc9e-44d9-85cc-15b51fa16ade None admin] PATH_INFO: `/v3/projects/bc21d3271bc242269a0b17ac6504bde5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:57.399809 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15476db-bc9e-44d9-85cc-15b51fa16ade None admin] RBAC: Authorizing `identity:get_project(project_id=bc21d3271bc242269a0b17ac6504bde5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:57.401329 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15476db-bc9e-44d9-85cc-15b51fa16ade None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:57.408022 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 66/133] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:06:57 2022] GET /identity/v3/projects/bc21d3271bc242269a0b17ac6504bde5 => generated 312 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:06:57.408022 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15476db-bc9e-44d9-85cc-15b51fa16ade None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:57.479430 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad60b71-28c3-4a79-98b8-6716e68147d2 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:57.497381 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:57.506897 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:57.525066 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00acc477-3d34-4ccb-9cc6-e2e4a736bc9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:57.525840 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00acc477-3d34-4ccb-9cc6-e2e4a736bc9c None admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:57.526126 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00acc477-3d34-4ccb-9cc6-e2e4a736bc9c None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:57.526403 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00acc477-3d34-4ccb-9cc6-e2e4a736bc9c None admin] PATH_INFO: `/v3/projects/758af4bbce9a439eb91820fb4527231a/users/d91b409307d64b3fb23df25bc6e6dfdc/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:57.529131 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00acc477-3d34-4ccb-9cc6-e2e4a736bc9c None admin] RBAC: Authorizing `identity:create_grant(project_id=758af4bbce9a439eb91820fb4527231a, user_id=d91b409307d64b3fb23df25bc6e6dfdc, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:57.530559 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00acc477-3d34-4ccb-9cc6-e2e4a736bc9c None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:57.546690 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 68/134] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Aug 5 02:06:57 2022] PUT /identity/v3/projects/758af4bbce9a439eb91820fb4527231a/users/d91b409307d64b3fb23df25bc6e6dfdc/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:06:57.547351 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00acc477-3d34-4ccb-9cc6-e2e4a736bc9c None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:57.575998 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15476db-bc9e-44d9-85cc-15b51fa16ade None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:57.613868 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1102d848-9486-4ec4-8555-98813e1e75a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:57.614588 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102d848-9486-4ec4-8555-98813e1e75a1 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:57.614818 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102d848-9486-4ec4-8555-98813e1e75a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:57.615095 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1102d848-9486-4ec4-8555-98813e1e75a1 None admin] PATH_INFO: `/v3/projects/758af4bbce9a439eb91820fb4527231a` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:57.616403 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102d848-9486-4ec4-8555-98813e1e75a1 None admin] RBAC: Authorizing `identity:get_project(project_id=758af4bbce9a439eb91820fb4527231a)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:57.617864 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1102d848-9486-4ec4-8555-98813e1e75a1 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:57.619847 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 67/135] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:06:57 2022] GET /identity/v3/projects/758af4bbce9a439eb91820fb4527231a => generated 298 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:06:57.627287 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d8709-2808-4fd6-a9b2-a346a3936019 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:57.627287 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d8709-2808-4fd6-a9b2-a346a3936019 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:57.627287 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c50d8709-2808-4fd6-a9b2-a346a3936019 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:57.627287 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 68/136] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:06:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:06:57.628683 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d8709-2808-4fd6-a9b2-a346a3936019 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:57.689423 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00acc477-3d34-4ccb-9cc6-e2e4a736bc9c None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:57.771158 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59159dd7-cd73-4901-8ceb-2b65e3eaead7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:57.772208 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59159dd7-cd73-4901-8ceb-2b65e3eaead7 None admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:57.772629 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59159dd7-cd73-4901-8ceb-2b65e3eaead7 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:57.774151 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59159dd7-cd73-4901-8ceb-2b65e3eaead7 None admin] PATH_INFO: `/v3/projects/bc21d3271bc242269a0b17ac6504bde5/users/d91b409307d64b3fb23df25bc6e6dfdc/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:57.775745 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59159dd7-cd73-4901-8ceb-2b65e3eaead7 None admin] RBAC: Authorizing `identity:create_grant(project_id=bc21d3271bc242269a0b17ac6504bde5, user_id=d91b409307d64b3fb23df25bc6e6dfdc, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:57.778400 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59159dd7-cd73-4901-8ceb-2b65e3eaead7 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:57.797483 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 69/137] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Aug 5 02:06:57 2022] PUT /identity/v3/projects/bc21d3271bc242269a0b17ac6504bde5/users/d91b409307d64b3fb23df25bc6e6dfdc/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:06:57.800475 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c50d8709-2808-4fd6-a9b2-a346a3936019 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:57.801958 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8a06d-fe60-40ce-870e-1e4582acb05f None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:57.802673 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8a06d-fe60-40ce-870e-1e4582acb05f None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:57.803071 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c8a06d-fe60-40ce-870e-1e4582acb05f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:57.835577 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-b5c8a06d-fe60-40ce-870e-1e4582acb05f None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:06:57.837081 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-b5c8a06d-fe60-40ce-870e-1e4582acb05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:06:57.838872 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:57.876516 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80ba802-30fe-4bfc-b30c-2707c22f2c2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:57.877276 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ba802-30fe-4bfc-b30c-2707c22f2c2e None admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:57.877561 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ba802-30fe-4bfc-b30c-2707c22f2c2e None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:57.877811 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:57.877916 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80ba802-30fe-4bfc-b30c-2707c22f2c2e None admin] PATH_INFO: `/v3/projects/758af4bbce9a439eb91820fb4527231a/users/c5c6e2a1691a410eaac17764c32341d7/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:57.881168 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ba802-30fe-4bfc-b30c-2707c22f2c2e None admin] RBAC: Authorizing `identity:create_grant(project_id=758af4bbce9a439eb91820fb4527231a, user_id=c5c6e2a1691a410eaac17764c32341d7, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:57.883862 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80ba802-30fe-4bfc-b30c-2707c22f2c2e None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:57.912239 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 69/138] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Aug 5 02:06:57 2022] PUT /identity/v3/projects/758af4bbce9a439eb91820fb4527231a/users/c5c6e2a1691a410eaac17764c32341d7/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:06:57.931048 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 70/139] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:06:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:06:57.963857 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56851e67-e6fc-4a3a-af4f-4694f83a33d3 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:57.964423 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56851e67-e6fc-4a3a-af4f-4694f83a33d3 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:57.964856 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56851e67-e6fc-4a3a-af4f-4694f83a33d3 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:57.966541 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 70/140] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:06:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:06:57.972831 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df04683-bbca-4a8b-acd2-5741f32355f2 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:57.973419 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df04683-bbca-4a8b-acd2-5741f32355f2 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:57.974117 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df04683-bbca-4a8b-acd2-5741f32355f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:57.974235 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56851e67-e6fc-4a3a-af4f-4694f83a33d3 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:58.006598 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-8df04683-bbca-4a8b-acd2-5741f32355f2 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:06:58.007834 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-8df04683-bbca-4a8b-acd2-5741f32355f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:06:58.179947 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 71/141] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:06:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:06:58.187817 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56851e67-e6fc-4a3a-af4f-4694f83a33d3 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:58.207198 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df04683-bbca-4a8b-acd2-5741f32355f2 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:58.234901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f9eed-fdc6-4eb4-a27a-e1548674f093 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:58.235564 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f9eed-fdc6-4eb4-a27a-e1548674f093 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:58.235849 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f9eed-fdc6-4eb4-a27a-e1548674f093 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:58.236130 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f9eed-fdc6-4eb4-a27a-e1548674f093 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:58.240095 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f9eed-fdc6-4eb4-a27a-e1548674f093 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:58.241651 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f9eed-fdc6-4eb4-a27a-e1548674f093 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:58.243316 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 71/142] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:06:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:06:58.256584 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f9eed-fdc6-4eb4-a27a-e1548674f093 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:58.345449 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:58.354461 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df04683-bbca-4a8b-acd2-5741f32355f2 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:58.393388 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976a5a3-6706-4767-8f91-e5a9af618a8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:58.394031 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:58.395631 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976a5a3-6706-4767-8f91-e5a9af618a8f None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:58.396008 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976a5a3-6706-4767-8f91-e5a9af618a8f None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:58.396299 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f976a5a3-6706-4767-8f91-e5a9af618a8f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:58.410817 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f976a5a3-6706-4767-8f91-e5a9af618a8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:06:58.416266 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-f976a5a3-6706-4767-8f91-e5a9af618a8f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 02:06:58.416266 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:06:58.416266 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:06:58.416266 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:06:58.416266 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:06:58.416266 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:06:58.416266 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:06:58.416266 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:06:58.416266 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:06:58.416266 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:06:58.416266 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:06:58.416266 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:06:58.416266 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:06:58.416266 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:06:58.416266 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:06:58.416266 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:06:58.417388 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:06:58.417388 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:06:58.417388 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:06:58.417388 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:06:58.417388 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:06:58.417388 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:06:58.417388 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:06:58.417388 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:06:58.417388 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:06:58.417388 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:06:58.417388 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:06:58.417388 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:06:58.417388 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:06:58.417388 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:06:58.417388 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:06:58.417388 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:06:58.418721 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:06:58.418721 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:06:58.418721 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:06:58.418721 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:06:58.418721 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:06:58.418721 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:06:58.418721 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:06:58.418721 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:06:58.418721 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:06:58.418721 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:06:58.418721 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 02:06:58.418721 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:06:58.418721 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 72/143] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:06:58 2022] GET /identity/v3/roles/reader => generated 84 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:06:58.424659 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976a5a3-6706-4767-8f91-e5a9af618a8f None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:58.506400 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f9eed-fdc6-4eb4-a27a-e1548674f093 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:58.572172 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b5438-0c1a-4ee8-be09-0e59e2d3a9b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:58.572833 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b5438-0c1a-4ee8-be09-0e59e2d3a9b1 None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:58.573119 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b5438-0c1a-4ee8-be09-0e59e2d3a9b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:58.573560 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99b5438-0c1a-4ee8-be09-0e59e2d3a9b1 None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:58.574287 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b5438-0c1a-4ee8-be09-0e59e2d3a9b1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:58.575743 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99b5438-0c1a-4ee8-be09-0e59e2d3a9b1 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:58.609270 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f976a5a3-6706-4767-8f91-e5a9af618a8f None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:58.625425 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 72/144] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Aug 5 02:06:58 2022] POST /identity/v3/users => generated 283 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:06:58.672538 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f659d4-5f25-4181-9beb-6dd25fb3d899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:58.673236 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f659d4-5f25-4181-9beb-6dd25fb3d899 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:58.673526 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f659d4-5f25-4181-9beb-6dd25fb3d899 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:58.673802 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f659d4-5f25-4181-9beb-6dd25fb3d899 None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:58.674538 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f659d4-5f25-4181-9beb-6dd25fb3d899 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:06:58.674897 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f659d4-5f25-4181-9beb-6dd25fb3d899 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:58.676303 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f659d4-5f25-4181-9beb-6dd25fb3d899 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:58.686619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 73/145] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Aug 5 02:06:58 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:06:58.694262 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b5438-0c1a-4ee8-be09-0e59e2d3a9b1 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:58.837566 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99b5438-0c1a-4ee8-be09-0e59e2d3a9b1 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:58.844291 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:58.894476 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3661a3-00ef-4fff-8416-bd0dc8ea8990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:58.895138 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3661a3-00ef-4fff-8416-bd0dc8ea8990 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:58.895427 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3661a3-00ef-4fff-8416-bd0dc8ea8990 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:58.895709 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3661a3-00ef-4fff-8416-bd0dc8ea8990 None admin] PATH_INFO: `/v3/users/8c80afce28044fe0bbb3c9f8cd3c3df0` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:58.896935 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3661a3-00ef-4fff-8416-bd0dc8ea8990 None admin] RBAC: Authorizing `identity:get_user(user_id=8c80afce28044fe0bbb3c9f8cd3c3df0)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:58.898378 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b3661a3-00ef-4fff-8416-bd0dc8ea8990 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:58.900147 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 73/146] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:06:58 2022] GET /identity/v3/users/8c80afce28044fe0bbb3c9f8cd3c3df0 => generated 289 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:06:58.906316 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f659d4-5f25-4181-9beb-6dd25fb3d899 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:58.931860 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:06:59.030125 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f659d4-5f25-4181-9beb-6dd25fb3d899 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:59.071599 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a569150-9c45-46f0-8887-85e7525c62da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:59.072261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a569150-9c45-46f0-8887-85e7525c62da None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:59.072757 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a569150-9c45-46f0-8887-85e7525c62da None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:59.073049 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a569150-9c45-46f0-8887-85e7525c62da None admin] PATH_INFO: `/v3/projects/758af4bbce9a439eb91820fb4527231a` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:59.074746 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a569150-9c45-46f0-8887-85e7525c62da None admin] RBAC: Authorizing `identity:get_project(project_id=758af4bbce9a439eb91820fb4527231a)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:59.076249 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a569150-9c45-46f0-8887-85e7525c62da None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:59.079070 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 74/147] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:06:58 2022] GET /identity/v3/projects/758af4bbce9a439eb91820fb4527231a => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:06:59.085191 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3661a3-00ef-4fff-8416-bd0dc8ea8990 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:06:59.219988 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3661a3-00ef-4fff-8416-bd0dc8ea8990 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:06:59.261868 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e57528-d8a6-48c8-bcbf-1ee8a276c739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:06:59.262900 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e57528-d8a6-48c8-bcbf-1ee8a276c739 None admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:06:59.263381 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e57528-d8a6-48c8-bcbf-1ee8a276c739 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:06:59.263864 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e57528-d8a6-48c8-bcbf-1ee8a276c739 None admin] PATH_INFO: `/v3/projects/758af4bbce9a439eb91820fb4527231a/users/8c80afce28044fe0bbb3c9f8cd3c3df0/roles/1070d90fae74403eab5e52609af8ed78` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:06:59.267000 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e57528-d8a6-48c8-bcbf-1ee8a276c739 None admin] RBAC: Authorizing `identity:create_grant(project_id=758af4bbce9a439eb91820fb4527231a, user_id=8c80afce28044fe0bbb3c9f8cd3c3df0, role_id=1070d90fae74403eab5e52609af8ed78)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:06:59.268781 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e57528-d8a6-48c8-bcbf-1ee8a276c739 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:06:59.287180 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 74/148] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Aug 5 02:06:59 2022] PUT /identity/v3/projects/758af4bbce9a439eb91820fb4527231a/users/8c80afce28044fe0bbb3c9f8cd3c3df0/roles/1070d90fae74403eab5e52609af8ed78 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:07:00.470493 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd7e08-1035-42d7-a666-254185cfa176 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:00.471008 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd7e08-1035-42d7-a666-254185cfa176 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:00.471008 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd7e08-1035-42d7-a666-254185cfa176 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:00.472567 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 75/149] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:00.478010 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e19ab-6d50-48fc-8e37-757112a2e1e1 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:00.478843 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e19ab-6d50-48fc-8e37-757112a2e1e1 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:00.479329 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7e19ab-6d50-48fc-8e37-757112a2e1e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:00.505364 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-ee7e19ab-6d50-48fc-8e37-757112a2e1e1 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:00.506927 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-ee7e19ab-6d50-48fc-8e37-757112a2e1e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:00.539481 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:00.598069 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 75/150] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:07:00.633620 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd7e08-1035-42d7-a666-254185cfa176 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:00.739573 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:00.767336 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd7e08-1035-42d7-a666-254185cfa176 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:00.803667 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1403ebd4-74d2-4dac-bb0b-5c19810a4d91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:00.804308 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403ebd4-74d2-4dac-bb0b-5c19810a4d91 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:00.804614 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403ebd4-74d2-4dac-bb0b-5c19810a4d91 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:00.804886 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1403ebd4-74d2-4dac-bb0b-5c19810a4d91 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:00.819433 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1403ebd4-74d2-4dac-bb0b-5c19810a4d91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:00.825755 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-1403ebd4-74d2-4dac-bb0b-5c19810a4d91 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:07:00.825755 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:00.825755 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:00.825755 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:00.825755 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:00.825755 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:00.825755 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:00.825755 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:00.825755 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:00.825755 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:00.825755 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:00.825755 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:00.825755 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:00.825755 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:00.825755 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:00.825755 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:00.826625 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:00.826625 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:00.826625 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:00.826625 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:00.826625 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:00.826625 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:00.826625 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:00.826625 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:00.826625 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:00.826625 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:00.826625 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:00.826625 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:00.826625 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:00.826625 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:00.826625 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:00.826625 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:00.827393 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:00.827393 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:00.827393 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:00.827393 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:00.827393 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:00.827393 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:00.827393 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:00.827393 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:00.827393 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:00.827393 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:00.827393 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:07:00.827393 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:00.827393 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 76/151] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Aug 5 02:07:00 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:00.835551 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e19ab-6d50-48fc-8e37-757112a2e1e1 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:00.900593 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199f054-dfbf-46f2-a406-86f06e088f23 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:00.900935 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199f054-dfbf-46f2-a406-86f06e088f23 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:00.902067 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f199f054-dfbf-46f2-a406-86f06e088f23 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:00.903945 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 77/152] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:07:00.923418 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ef295-29e4-469a-94a5-2e961f8c504a None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:00.923711 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ef295-29e4-469a-94a5-2e961f8c504a None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:00.923966 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3ef295-29e4-469a-94a5-2e961f8c504a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:00.961731 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-5c3ef295-29e4-469a-94a5-2e961f8c504a None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:00.963184 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-5c3ef295-29e4-469a-94a5-2e961f8c504a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:01.009553 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7e19ab-6d50-48fc-8e37-757112a2e1e1 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:01.061262 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7562b-989f-44f2-8945-bb13fc83be78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:01.061899 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7562b-989f-44f2-8945-bb13fc83be78 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:01.062175 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7562b-989f-44f2-8945-bb13fc83be78 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:01.062448 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f7562b-989f-44f2-8945-bb13fc83be78 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:01.063171 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f7562b-989f-44f2-8945-bb13fc83be78 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:01.063472 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f7562b-989f-44f2-8945-bb13fc83be78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:01.064867 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f7562b-989f-44f2-8945-bb13fc83be78 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:01.079944 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 76/153] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:07:00 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:01.080897 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7562b-989f-44f2-8945-bb13fc83be78 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:01.112134 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:01.121755 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 78/154] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:07:01.161531 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ef295-29e4-469a-94a5-2e961f8c504a None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:01.207683 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f7562b-989f-44f2-8945-bb13fc83be78 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:01.250667 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc667356-eca7-4984-bc0c-ef4e16a19814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:01.251325 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc667356-eca7-4984-bc0c-ef4e16a19814 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:01.251607 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc667356-eca7-4984-bc0c-ef4e16a19814 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:01.251880 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc667356-eca7-4984-bc0c-ef4e16a19814 None admin] PATH_INFO: `/v3/users/d91b409307d64b3fb23df25bc6e6dfdc` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:01.256416 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc667356-eca7-4984-bc0c-ef4e16a19814 None admin] RBAC: Authorizing `identity:get_user(user_id=d91b409307d64b3fb23df25bc6e6dfdc)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:01.257878 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc667356-eca7-4984-bc0c-ef4e16a19814 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:01.259771 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 77/155] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:07:01 2022] GET /identity/v3/users/d91b409307d64b3fb23df25bc6e6dfdc => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:01.264569 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f97c5-3ab1-43a4-ad6c-fea65ee57e56 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:01.264802 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f97c5-3ab1-43a4-ad6c-fea65ee57e56 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:01.265069 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f97c5-3ab1-43a4-ad6c-fea65ee57e56 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:01.266353 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 78/156] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:01 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:01.271458 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f97c5-3ab1-43a4-ad6c-fea65ee57e56 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:01.302464 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:01.327208 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3ef295-29e4-469a-94a5-2e961f8c504a None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:01.364743 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbca4500-f5bb-4d0a-8ba9-ea43ce40c9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:01.365386 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca4500-f5bb-4d0a-8ba9-ea43ce40c9f2 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:01.365805 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca4500-f5bb-4d0a-8ba9-ea43ce40c9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:01.366089 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbca4500-f5bb-4d0a-8ba9-ea43ce40c9f2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:01.377807 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbca4500-f5bb-4d0a-8ba9-ea43ce40c9f2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:01.383020 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-fbca4500-f5bb-4d0a-8ba9-ea43ce40c9f2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:07:01.383020 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:01.383020 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:01.383020 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:01.383020 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:01.383020 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:01.383020 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:01.383020 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:01.383020 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:01.383020 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:01.383020 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:01.383020 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:01.383020 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:01.383020 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:01.383020 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:01.383020 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:01.384100 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:01.384100 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:01.384100 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:01.384100 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:01.384100 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:01.384100 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:01.384100 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:01.384100 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:01.384100 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:01.384100 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:01.384100 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:01.384100 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:01.384100 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:01.384100 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:01.384100 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:01.384100 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:01.385006 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:01.385006 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:01.385006 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:01.385006 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:01.385006 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:01.385006 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:01.385006 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:01.385006 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:01.385006 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:01.385006 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:01.385006 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:07:01.385006 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:01.385006 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 79/157] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:07:01 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:07:01.386287 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadc4c4-5c47-4d71-8a33-d341bace6c9b None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:01.386791 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadc4c4-5c47-4d71-8a33-d341bace6c9b None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:01.387073 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdadc4c4-5c47-4d71-8a33-d341bace6c9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:01.406784 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-fdadc4c4-5c47-4d71-8a33-d341bace6c9b None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:01.407978 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-fdadc4c4-5c47-4d71-8a33-d341bace6c9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:01.480297 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 80/158] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:07:01.481254 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdadc4c4-5c47-4d71-8a33-d341bace6c9b None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:01.516276 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:01.541557 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f97c5-3ab1-43a4-ad6c-fea65ee57e56 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:01.574170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:01.605131 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdadc4c4-5c47-4d71-8a33-d341bace6c9b None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:01.614426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f347616-ec08-4068-aa74-2a423ecae064 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:01.615077 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f347616-ec08-4068-aa74-2a423ecae064 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:01.615360 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f347616-ec08-4068-aa74-2a423ecae064 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:01.615638 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f347616-ec08-4068-aa74-2a423ecae064 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:01.645840 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6587e7f9-8eae-4d87-99d7-16d9879a5486 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:01.646466 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587e7f9-8eae-4d87-99d7-16d9879a5486 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:01.646742 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587e7f9-8eae-4d87-99d7-16d9879a5486 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:01.647071 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6587e7f9-8eae-4d87-99d7-16d9879a5486 None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:01.647850 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6587e7f9-8eae-4d87-99d7-16d9879a5486 None admin] RBAC: Adding query filter params (name=member) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:01.648159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6587e7f9-8eae-4d87-99d7-16d9879a5486 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:01.649608 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6587e7f9-8eae-4d87-99d7-16d9879a5486 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:01.664441 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 81/159] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Aug 5 02:07:01 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:01.669923 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18074bed-ed71-4378-8a12-019d41b897a8 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:01.670283 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18074bed-ed71-4378-8a12-019d41b897a8 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:01.670563 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18074bed-ed71-4378-8a12-019d41b897a8 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:01.672052 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 82/160] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:01.672856 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18074bed-ed71-4378-8a12-019d41b897a8 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:01.746238 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f347616-ec08-4068-aa74-2a423ecae064 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:01.747734 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f347616-ec08-4068-aa74-2a423ecae064 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:01.852162 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18074bed-ed71-4378-8a12-019d41b897a8 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:01.909987 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:01.911311 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:01.921402 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 79/161] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:07:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 654 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:07:01.922242 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f347616-ec08-4068-aa74-2a423ecae064 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:01.945330 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d90185-e9a6-47e9-8096-8f6ac5032052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:01.945994 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d90185-e9a6-47e9-8096-8f6ac5032052 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:01.946276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d90185-e9a6-47e9-8096-8f6ac5032052 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:01.946553 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d90185-e9a6-47e9-8096-8f6ac5032052 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:01.981310 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d90185-e9a6-47e9-8096-8f6ac5032052 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:01.986947 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-15d90185-e9a6-47e9-8096-8f6ac5032052 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:07:01.986947 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:01.986947 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:01.986947 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:01.986947 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:01.986947 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:01.986947 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:01.986947 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:01.986947 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:01.986947 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:01.986947 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:01.986947 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:01.986947 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:01.986947 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:01.986947 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:01.986947 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:01.987823 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:01.987823 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:01.987823 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:01.987823 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:01.987823 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:01.987823 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:01.987823 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:01.987823 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:01.987823 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:01.987823 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:01.987823 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:01.987823 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:01.987823 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:01.987823 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:01.987823 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:01.987823 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:01.988622 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:01.988622 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:01.988622 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:01.988622 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:01.988622 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:01.988622 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:01.988622 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:01.988622 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:01.988622 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:01.988622 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:01.988622 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:07:01.988622 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:01.995862 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 83/162] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Aug 5 02:07:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:01.997298 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca5394-2ad7-4ed4-b028-1a90250f35e5 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:01.997587 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca5394-2ad7-4ed4-b028-1a90250f35e5 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:01.997862 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ca5394-2ad7-4ed4-b028-1a90250f35e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:02.032430 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-d0ca5394-2ad7-4ed4-b028-1a90250f35e5 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:02.033652 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-d0ca5394-2ad7-4ed4-b028-1a90250f35e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:02.075426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f347616-ec08-4068-aa74-2a423ecae064 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:02.145748 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee2e5e-e3ad-4a7d-bd82-dfd2c3db8875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:02.146332 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee2e5e-e3ad-4a7d-bd82-dfd2c3db8875 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:02.146609 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee2e5e-e3ad-4a7d-bd82-dfd2c3db8875 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:02.146877 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eee2e5e-e3ad-4a7d-bd82-dfd2c3db8875 None admin] PATH_INFO: `/v3/users/d91b409307d64b3fb23df25bc6e6dfdc` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:02.153051 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee2e5e-e3ad-4a7d-bd82-dfd2c3db8875 None admin] RBAC: Authorizing `identity:get_user(user_id=d91b409307d64b3fb23df25bc6e6dfdc)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:02.154496 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eee2e5e-e3ad-4a7d-bd82-dfd2c3db8875 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:02.156136 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 80/163] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:07:01 2022] GET /identity/v3/users/d91b409307d64b3fb23df25bc6e6dfdc => generated 275 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:02.156939 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee2e5e-e3ad-4a7d-bd82-dfd2c3db8875 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:02.202242 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 84/164] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:07:02.203117 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca5394-2ad7-4ed4-b028-1a90250f35e5 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:02.249024 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:02.297293 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eee2e5e-e3ad-4a7d-bd82-dfd2c3db8875 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:02.371399 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ca5394-2ad7-4ed4-b028-1a90250f35e5 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:02.373844 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cea6fc-dcaa-4468-9936-a68313a9a84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:02.374521 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cea6fc-dcaa-4468-9936-a68313a9a84b None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:02.374804 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cea6fc-dcaa-4468-9936-a68313a9a84b None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:02.375079 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cea6fc-dcaa-4468-9936-a68313a9a84b None admin] PATH_INFO: `/v3/projects/758af4bbce9a439eb91820fb4527231a` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:02.376265 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cea6fc-dcaa-4468-9936-a68313a9a84b None admin] RBAC: Authorizing `identity:get_project(project_id=758af4bbce9a439eb91820fb4527231a)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:02.377729 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cea6fc-dcaa-4468-9936-a68313a9a84b None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:02.379406 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 81/165] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:07:02 2022] GET /identity/v3/projects/758af4bbce9a439eb91820fb4527231a => generated 298 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:02.380171 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cea6fc-dcaa-4468-9936-a68313a9a84b None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:02.395977 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:02.425986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603c6ef-166d-46f5-aabf-2fee1319afdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:02.426618 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603c6ef-166d-46f5-aabf-2fee1319afdf None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:02.427001 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603c6ef-166d-46f5-aabf-2fee1319afdf None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:02.427281 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b603c6ef-166d-46f5-aabf-2fee1319afdf None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:02.428121 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603c6ef-166d-46f5-aabf-2fee1319afdf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:02.428458 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603c6ef-166d-46f5-aabf-2fee1319afdf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:02.429929 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b603c6ef-166d-46f5-aabf-2fee1319afdf None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:02.444816 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 85/166] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:07:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:02.445441 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603c6ef-166d-46f5-aabf-2fee1319afdf None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:02.544416 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cea6fc-dcaa-4468-9936-a68313a9a84b None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:02.593126 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:02.609964 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bac0b3-d4d0-4ca6-abc8-6a080acca8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:02.610600 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bac0b3-d4d0-4ca6-abc8-6a080acca8ae None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:02.610883 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bac0b3-d4d0-4ca6-abc8-6a080acca8ae None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:02.611154 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bac0b3-d4d0-4ca6-abc8-6a080acca8ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:02.642762 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b603c6ef-166d-46f5-aabf-2fee1319afdf None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:02.685496 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bac0b3-d4d0-4ca6-abc8-6a080acca8ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:02.686987 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8bac0b3-d4d0-4ca6-abc8-6a080acca8ae None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:02.736562 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6430641d-84b5-4124-a6c4-5b03c85a65bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:02.737256 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430641d-84b5-4124-a6c4-5b03c85a65bd None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:02.737536 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430641d-84b5-4124-a6c4-5b03c85a65bd None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:02.737804 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6430641d-84b5-4124-a6c4-5b03c85a65bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:02.758576 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6430641d-84b5-4124-a6c4-5b03c85a65bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:02.765065 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-6430641d-84b5-4124-a6c4-5b03c85a65bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:07:02.765065 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:02.765065 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:02.765065 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:02.765065 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:02.765065 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:02.765065 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:02.765065 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:02.765065 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:02.765065 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:02.765065 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:02.765065 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:02.765065 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:02.765065 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:02.765065 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:02.765065 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:02.765998 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:02.765998 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:02.765998 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:02.765998 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:02.765998 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:02.765998 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:02.765998 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:02.765998 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:02.765998 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:02.765998 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:02.765998 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:02.765998 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:02.765998 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:02.765998 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:02.765998 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:02.765998 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:02.766854 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:02.766854 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:02.766854 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:02.766854 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:02.766854 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:02.766854 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:02.766854 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:02.766854 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:02.766854 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:02.766854 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:02.766854 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:07:02.766854 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:02.766854 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 86/167] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:07:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:02.771820 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6430641d-84b5-4124-a6c4-5b03c85a65bd None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:02.790341 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 82/168] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:07:02 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:07:02.791313 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bac0b3-d4d0-4ca6-abc8-6a080acca8ae None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:02.818665 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:02.852698 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:02.883761 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6430641d-84b5-4124-a6c4-5b03c85a65bd None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:02.922646 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090f8cd9-3a92-4aa2-9492-ba6f45e4fa7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:02.923261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f8cd9-3a92-4aa2-9492-ba6f45e4fa7e None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:02.923536 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f8cd9-3a92-4aa2-9492-ba6f45e4fa7e None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:02.923802 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090f8cd9-3a92-4aa2-9492-ba6f45e4fa7e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:02.925530 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f8cd9-3a92-4aa2-9492-ba6f45e4fa7e None admin] RBAC: Adding query filter params (role.id=5c52e382f2bc436d95d82f2a2fae8ace, scope.project.id=758af4bbce9a439eb91820fb4527231a, user.id=d91b409307d64b3fb23df25bc6e6dfdc) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:02.925841 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f8cd9-3a92-4aa2-9492-ba6f45e4fa7e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:02.928392 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090f8cd9-3a92-4aa2-9492-ba6f45e4fa7e None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:02.940628 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 87/169] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:07:02 2022] GET /identity/v3/role_assignments?user.id=d91b409307d64b3fb23df25bc6e6dfdc&scope.project.id=758af4bbce9a439eb91820fb4527231a&role.id=5c52e382f2bc436d95d82f2a2fae8ace => generated 608 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:02.942256 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1cbbff-ccb3-4b1c-a8af-7c5d132261d0 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:02.942861 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1cbbff-ccb3-4b1c-a8af-7c5d132261d0 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:02.943141 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1cbbff-ccb3-4b1c-a8af-7c5d132261d0 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:02.944718 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 88/170] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:02.945598 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1cbbff-ccb3-4b1c-a8af-7c5d132261d0 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:02.986715 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bac0b3-d4d0-4ca6-abc8-6a080acca8ae None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:03.065116 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58bac07-11fa-41db-8455-24abe97b4cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:03.066163 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58bac07-11fa-41db-8455-24abe97b4cbb None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:03.066673 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58bac07-11fa-41db-8455-24abe97b4cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:03.067172 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58bac07-11fa-41db-8455-24abe97b4cbb None admin] PATH_INFO: `/v3/users/c5c6e2a1691a410eaac17764c32341d7` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:03.068779 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58bac07-11fa-41db-8455-24abe97b4cbb None admin] RBAC: Authorizing `identity:get_user(user_id=c5c6e2a1691a410eaac17764c32341d7)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:03.070572 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58bac07-11fa-41db-8455-24abe97b4cbb None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:03.072580 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 83/171] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:07:02 2022] GET /identity/v3/users/c5c6e2a1691a410eaac17764c32341d7 => generated 247 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:03.073787 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58bac07-11fa-41db-8455-24abe97b4cbb None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:03.111963 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1cbbff-ccb3-4b1c-a8af-7c5d132261d0 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:03.113671 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:03.156582 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2837b970-7151-4314-b8f2-9ec369b77ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:03.160359 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837b970-7151-4314-b8f2-9ec369b77ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:03.160359 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837b970-7151-4314-b8f2-9ec369b77ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:03.160359 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2837b970-7151-4314-b8f2-9ec369b77ea5 None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:03.160359 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2837b970-7151-4314-b8f2-9ec369b77ea5 None admin] RBAC: Adding query filter params (name=member) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:03.160359 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2837b970-7151-4314-b8f2-9ec369b77ea5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:03.160359 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2837b970-7151-4314-b8f2-9ec369b77ea5 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:03.170391 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 89/172] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Aug 5 02:07:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:03.171836 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730fb90-4530-496b-a114-b263b1eda37a None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:03.172169 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730fb90-4530-496b-a114-b263b1eda37a None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:03.172468 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3730fb90-4530-496b-a114-b263b1eda37a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:03.192051 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-3730fb90-4530-496b-a114-b263b1eda37a None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:03.193186 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-3730fb90-4530-496b-a114-b263b1eda37a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:03.235435 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:03.239187 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58bac07-11fa-41db-8455-24abe97b4cbb None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:03.268253 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 90/173] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:07:03.269592 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b77c5b-c2ab-48dd-a767-310bc11809c1 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:03.269843 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b77c5b-c2ab-48dd-a767-310bc11809c1 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:03.270118 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b77c5b-c2ab-48dd-a767-310bc11809c1 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:03.271691 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 91/174] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:03.272455 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b77c5b-c2ab-48dd-a767-310bc11809c1 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:03.292337 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2f840-1c0e-4513-a691-62d20dc08afd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:03.293010 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2f840-1c0e-4513-a691-62d20dc08afd None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:03.293294 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2f840-1c0e-4513-a691-62d20dc08afd None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:03.293575 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8af2f840-1c0e-4513-a691-62d20dc08afd None admin] PATH_INFO: `/v3/projects/758af4bbce9a439eb91820fb4527231a` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:03.294823 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af2f840-1c0e-4513-a691-62d20dc08afd None admin] RBAC: Authorizing `identity:get_project(project_id=758af4bbce9a439eb91820fb4527231a)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:03.296270 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8af2f840-1c0e-4513-a691-62d20dc08afd None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:03.304842 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 84/175] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:07:03 2022] GET /identity/v3/projects/758af4bbce9a439eb91820fb4527231a => generated 298 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:03.305724 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2f840-1c0e-4513-a691-62d20dc08afd None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:03.401997 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:03.410419 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b77c5b-c2ab-48dd-a767-310bc11809c1 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:03.431937 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8af2f840-1c0e-4513-a691-62d20dc08afd None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:03.448002 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a48ee-246a-449e-939d-9548714cb74f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:03.448619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a48ee-246a-449e-939d-9548714cb74f None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:03.448899 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a48ee-246a-449e-939d-9548714cb74f None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:03.449170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a48ee-246a-449e-939d-9548714cb74f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:03.467895 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35eb93fa-727d-4f5c-a05e-bb9b787cb080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:03.468847 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb93fa-727d-4f5c-a05e-bb9b787cb080 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:03.469133 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb93fa-727d-4f5c-a05e-bb9b787cb080 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:03.469573 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35eb93fa-727d-4f5c-a05e-bb9b787cb080 None admin] PATH_INFO: `/v3/users/d91b409307d64b3fb23df25bc6e6dfdc` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:03.471042 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eb93fa-727d-4f5c-a05e-bb9b787cb080 None admin] RBAC: Authorizing `identity:get_user(user_id=d91b409307d64b3fb23df25bc6e6dfdc)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:03.472505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35eb93fa-727d-4f5c-a05e-bb9b787cb080 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:03.474882 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 85/176] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:07:03 2022] GET /identity/v3/users/d91b409307d64b3fb23df25bc6e6dfdc => generated 275 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:03.476007 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc262c5f-cf64-4ba2-bb6a-4b0112e98a35 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:03.476282 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc262c5f-cf64-4ba2-bb6a-4b0112e98a35 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:03.476590 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc262c5f-cf64-4ba2-bb6a-4b0112e98a35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:03.496129 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-fc262c5f-cf64-4ba2-bb6a-4b0112e98a35 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:03.497372 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-fc262c5f-cf64-4ba2-bb6a-4b0112e98a35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:03.523406 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a48ee-246a-449e-939d-9548714cb74f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:03.523637 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:03.525400 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a48ee-246a-449e-939d-9548714cb74f None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:03.567584 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 86/177] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:07:03.569645 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fade7e7-d04e-4818-9cd8-d39340093ddf None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:03.571630 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fade7e7-d04e-4818-9cd8-d39340093ddf None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:03.571933 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fade7e7-d04e-4818-9cd8-d39340093ddf None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:03.577751 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 87/178] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:03 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:03.578586 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fade7e7-d04e-4818-9cd8-d39340093ddf None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:03.631430 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:03.640215 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 92/179] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:07:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:07:03.641069 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a48ee-246a-449e-939d-9548714cb74f None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:03.684431 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fade7e7-d04e-4818-9cd8-d39340093ddf None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:03.718876 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6192e2aa-dd68-4dd0-9003-50624a1d28fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:03.719452 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192e2aa-dd68-4dd0-9003-50624a1d28fc None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:03.719733 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192e2aa-dd68-4dd0-9003-50624a1d28fc None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:03.720008 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6192e2aa-dd68-4dd0-9003-50624a1d28fc None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:03.730452 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6192e2aa-dd68-4dd0-9003-50624a1d28fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:03.735472 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-6192e2aa-dd68-4dd0-9003-50624a1d28fc None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 02:07:03.735472 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:03.735472 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:03.735472 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:03.735472 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:03.735472 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:03.735472 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:03.735472 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:03.735472 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:03.735472 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:03.735472 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:03.735472 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:03.735472 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:03.735472 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:03.735472 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:03.735472 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:03.736400 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:03.736400 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:03.736400 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:03.736400 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:03.736400 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:03.736400 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:03.736400 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:03.736400 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:03.736400 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:03.736400 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:03.736400 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:03.736400 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:03.736400 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:03.736400 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:03.736400 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:03.736400 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:03.737200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:03.737200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:03.737200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:03.737200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:03.737200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:03.737200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:03.737200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:03.737200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:03.737200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:03.737200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:03.737200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 02:07:03.737200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:03.737200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 88/180] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:07:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:03.738039 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6192e2aa-dd68-4dd0-9003-50624a1d28fc None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:03.747899 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a48ee-246a-449e-939d-9548714cb74f None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:03.765238 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:03.783621 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b507f-9ae7-4692-a2e7-e3b8b599c21e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:03.784232 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b507f-9ae7-4692-a2e7-e3b8b599c21e None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:03.784544 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b507f-9ae7-4692-a2e7-e3b8b599c21e None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:03.784821 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b507f-9ae7-4692-a2e7-e3b8b599c21e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:03.785607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b507f-9ae7-4692-a2e7-e3b8b599c21e None admin] RBAC: Adding query filter params (role.id=33cd9c7fcf9b4bbe9d604952279e8d76, scope.project.id=758af4bbce9a439eb91820fb4527231a, user.id=d91b409307d64b3fb23df25bc6e6dfdc) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:03.785921 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b507f-9ae7-4692-a2e7-e3b8b599c21e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:03.787359 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b507f-9ae7-4692-a2e7-e3b8b599c21e None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:03.793421 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 93/181] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:07:03 2022] GET /identity/v3/role_assignments?user.id=d91b409307d64b3fb23df25bc6e6dfdc&scope.project.id=758af4bbce9a439eb91820fb4527231a&role.id=33cd9c7fcf9b4bbe9d604952279e8d76 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:03.794461 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf6d3e-7d1c-40e8-a534-20343dc68113 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:03.794686 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf6d3e-7d1c-40e8-a534-20343dc68113 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:03.794961 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edf6d3e-7d1c-40e8-a534-20343dc68113 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:03.814520 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-2edf6d3e-7d1c-40e8-a534-20343dc68113 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:03.815801 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-2edf6d3e-7d1c-40e8-a534-20343dc68113 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:03.851908 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6192e2aa-dd68-4dd0-9003-50624a1d28fc None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:03.888574 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:03.891182 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f79118-9f57-4bf4-a8a6-d1140791d8eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:03.891794 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f79118-9f57-4bf4-a8a6-d1140791d8eb None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:03.892075 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f79118-9f57-4bf4-a8a6-d1140791d8eb None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:03.892369 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f79118-9f57-4bf4-a8a6-d1140791d8eb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:03.910760 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 94/182] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:07:03.911983 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf6d3e-7d1c-40e8-a534-20343dc68113 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:03.989911 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f79118-9f57-4bf4-a8a6-d1140791d8eb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:03.991293 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78f79118-9f57-4bf4-a8a6-d1140791d8eb None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:04.020593 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:04.035642 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edf6d3e-7d1c-40e8-a534-20343dc68113 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:04.069851 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-468f3f60-9596-4aa4-a022-19b15be4b0dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:04.070483 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f3f60-9596-4aa4-a022-19b15be4b0dc None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:04.070765 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f3f60-9596-4aa4-a022-19b15be4b0dc None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:04.071038 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-468f3f60-9596-4aa4-a022-19b15be4b0dc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:04.081164 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-468f3f60-9596-4aa4-a022-19b15be4b0dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:04.086141 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-468f3f60-9596-4aa4-a022-19b15be4b0dc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:07:04.086141 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:04.086141 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:04.086141 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:04.086141 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:04.086141 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:04.086141 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:04.086141 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:04.086141 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:04.086141 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:04.086141 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:04.086141 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:04.086141 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:04.086141 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:04.086141 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:04.086141 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:04.087012 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:04.087012 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:04.087012 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:04.087012 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:04.087012 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:04.087012 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:04.087012 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:04.087012 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:04.087012 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:04.087012 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:04.087012 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:04.087012 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:04.087012 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:04.087012 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:04.087012 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:04.087012 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:04.087804 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:04.087804 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:04.087804 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:04.087804 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:04.087804 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:04.087804 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:04.087804 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:04.087804 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:04.087804 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:04.087804 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:04.087804 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:07:04.087804 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:04.087804 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 95/183] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Aug 5 02:07:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:04.088542 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b47ff-cee4-4c4f-943e-2a8fa2514508 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:04.088860 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b47ff-cee4-4c4f-943e-2a8fa2514508 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:04.089079 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742b47ff-cee4-4c4f-943e-2a8fa2514508 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:04.090413 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 96/184] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:04.091107 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b47ff-cee4-4c4f-943e-2a8fa2514508 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:04.107902 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 89/185] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:07:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:07:04.107902 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f79118-9f57-4bf4-a8a6-d1140791d8eb None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:04.147347 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:04.200006 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742b47ff-cee4-4c4f-943e-2a8fa2514508 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:04.201100 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f79118-9f57-4bf4-a8a6-d1140791d8eb None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:04.222986 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:04.233606 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65364f4-fed8-4ab9-a52c-04e6504d7b80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:04.234238 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65364f4-fed8-4ab9-a52c-04e6504d7b80 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:04.234516 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65364f4-fed8-4ab9-a52c-04e6504d7b80 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:04.234791 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b65364f4-fed8-4ab9-a52c-04e6504d7b80 None admin] PATH_INFO: `/v3/projects/758af4bbce9a439eb91820fb4527231a` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:04.235265 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7240da6-e558-461f-b1cb-161fe64fae76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:04.235872 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7240da6-e558-461f-b1cb-161fe64fae76 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:04.235970 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65364f4-fed8-4ab9-a52c-04e6504d7b80 None admin] RBAC: Authorizing `identity:get_project(project_id=758af4bbce9a439eb91820fb4527231a)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:04.236148 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7240da6-e558-461f-b1cb-161fe64fae76 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:04.236457 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7240da6-e558-461f-b1cb-161fe64fae76 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:04.237162 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7240da6-e558-461f-b1cb-161fe64fae76 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:04.237417 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b65364f4-fed8-4ab9-a52c-04e6504d7b80 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:04.237508 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7240da6-e558-461f-b1cb-161fe64fae76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:04.238793 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7240da6-e558-461f-b1cb-161fe64fae76 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:04.239265 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 97/186] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:07:04 2022] GET /identity/v3/projects/758af4bbce9a439eb91820fb4527231a => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:04.239833 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65364f4-fed8-4ab9-a52c-04e6504d7b80 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:04.251797 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 90/187] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Aug 5 02:07:04 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:04.251797 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7240da6-e558-461f-b1cb-161fe64fae76 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:04.340192 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b65364f4-fed8-4ab9-a52c-04e6504d7b80 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:04.345271 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7240da6-e558-461f-b1cb-161fe64fae76 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:04.357451 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:04.375907 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f5bf2-fe4d-4ecd-b039-df97051c1a87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:04.376555 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f5bf2-fe4d-4ecd-b039-df97051c1a87 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:04.376832 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f5bf2-fe4d-4ecd-b039-df97051c1a87 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:04.377102 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384f5bf2-fe4d-4ecd-b039-df97051c1a87 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:04.378753 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d259bad-8a9f-4714-bd8f-51a71e4b6047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:04.379350 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d259bad-8a9f-4714-bd8f-51a71e4b6047 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:04.379632 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d259bad-8a9f-4714-bd8f-51a71e4b6047 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:04.379903 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d259bad-8a9f-4714-bd8f-51a71e4b6047 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:04.380640 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d259bad-8a9f-4714-bd8f-51a71e4b6047 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:04.380941 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d259bad-8a9f-4714-bd8f-51a71e4b6047 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:04.382283 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d259bad-8a9f-4714-bd8f-51a71e4b6047 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:04.387110 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384f5bf2-fe4d-4ecd-b039-df97051c1a87 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:04.390722 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 91/188] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:07:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:04.391967 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b426a4b-81a8-4a07-9c56-6ac7f02b97c4 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:04.392068 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-384f5bf2-fe4d-4ecd-b039-df97051c1a87 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:07:04.392068 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:04.392068 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:04.392068 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:04.392068 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:04.392068 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:04.392068 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:04.392068 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:04.392068 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:04.392068 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:04.392068 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:04.392068 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:04.392068 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:04.392068 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:04.392068 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:04.392068 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:04.392961 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:04.392961 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:04.392961 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:04.392961 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:04.392961 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:04.392961 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:04.392961 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:04.392961 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:04.392961 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:04.392961 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:04.392961 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:04.392961 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:04.392961 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:04.392961 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:04.392961 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:04.392961 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:04.393804 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:04.393804 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:04.393804 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:04.393804 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:04.393804 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:04.393804 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:04.393804 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:04.393804 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:04.393804 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:04.393804 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:04.393804 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:07:04.393804 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:04.394431 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b426a4b-81a8-4a07-9c56-6ac7f02b97c4 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:04.394431 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b426a4b-81a8-4a07-9c56-6ac7f02b97c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:04.394550 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 98/189] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Aug 5 02:07:04 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:04.394550 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f5bf2-fe4d-4ecd-b039-df97051c1a87 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:04.412492 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-0b426a4b-81a8-4a07-9c56-6ac7f02b97c4 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:04.413709 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-0b426a4b-81a8-4a07-9c56-6ac7f02b97c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:04.459700 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:04.484709 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 92/190] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:07:04.485524 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b426a4b-81a8-4a07-9c56-6ac7f02b97c4 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:04.502694 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384f5bf2-fe4d-4ecd-b039-df97051c1a87 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:04.536900 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f5b6d-52c3-41fc-ade8-f96e997d6f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:04.537536 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f5b6d-52c3-41fc-ade8-f96e997d6f03 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:04.537818 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f5b6d-52c3-41fc-ade8-f96e997d6f03 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:04.538095 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f5b6d-52c3-41fc-ade8-f96e997d6f03 None admin] PATH_INFO: `/v3/projects/bc21d3271bc242269a0b17ac6504bde5` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:04.539254 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f5b6d-52c3-41fc-ade8-f96e997d6f03 None admin] RBAC: Authorizing `identity:get_project(project_id=bc21d3271bc242269a0b17ac6504bde5)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:04.540755 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567f5b6d-52c3-41fc-ade8-f96e997d6f03 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:04.542623 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 99/191] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:07:04 2022] GET /identity/v3/projects/bc21d3271bc242269a0b17ac6504bde5 => generated 312 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:04.543289 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f5b6d-52c3-41fc-ade8-f96e997d6f03 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:04.587106 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:04.589583 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b426a4b-81a8-4a07-9c56-6ac7f02b97c4 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:04.623383 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b8840-8b96-45fc-8a4a-baf560019645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:04.623993 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b8840-8b96-45fc-8a4a-baf560019645 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:04.624266 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b8840-8b96-45fc-8a4a-baf560019645 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:04.624561 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-122b8840-8b96-45fc-8a4a-baf560019645 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:04.625347 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b8840-8b96-45fc-8a4a-baf560019645 None admin] RBAC: Adding query filter params (role.id=e1b75d5eea2a43b2b1b14cf0515350fa, scope.project.id=758af4bbce9a439eb91820fb4527231a, user.id=c5c6e2a1691a410eaac17764c32341d7) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:04.625649 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b8840-8b96-45fc-8a4a-baf560019645 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:04.627064 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-122b8840-8b96-45fc-8a4a-baf560019645 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:04.632696 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 93/192] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:07:04 2022] GET /identity/v3/role_assignments?user.id=c5c6e2a1691a410eaac17764c32341d7&scope.project.id=758af4bbce9a439eb91820fb4527231a&role.id=e1b75d5eea2a43b2b1b14cf0515350fa => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:04.633475 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b8840-8b96-45fc-8a4a-baf560019645 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:04.653330 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567f5b6d-52c3-41fc-ade8-f96e997d6f03 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:04.686926 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:04.695097 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86f0aa-c916-480e-9cd4-4d760e3b881e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:04.695781 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86f0aa-c916-480e-9cd4-4d760e3b881e None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:04.696026 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86f0aa-c916-480e-9cd4-4d760e3b881e None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:04.696297 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86f0aa-c916-480e-9cd4-4d760e3b881e None admin] PATH_INFO: `/v3/users/8c80afce28044fe0bbb3c9f8cd3c3df0` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:04.697740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86f0aa-c916-480e-9cd4-4d760e3b881e None admin] RBAC: Authorizing `identity:get_user(user_id=8c80afce28044fe0bbb3c9f8cd3c3df0)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:04.699855 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86f0aa-c916-480e-9cd4-4d760e3b881e None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:04.701608 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 100/193] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:07:04 2022] GET /identity/v3/users/8c80afce28044fe0bbb3c9f8cd3c3df0 => generated 289 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:04.702446 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86f0aa-c916-480e-9cd4-4d760e3b881e None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:04.753830 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-122b8840-8b96-45fc-8a4a-baf560019645 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:04.795326 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a98dde-ed3d-4072-9735-bbfa37b6bae3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:04.795975 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a98dde-ed3d-4072-9735-bbfa37b6bae3 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:04.796252 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a98dde-ed3d-4072-9735-bbfa37b6bae3 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:04.796871 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a98dde-ed3d-4072-9735-bbfa37b6bae3 None admin] PATH_INFO: `/v3/users/513f8c5508794dee99ec79dd7ad7819f` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:04.814302 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a98dde-ed3d-4072-9735-bbfa37b6bae3 None admin] RBAC: Authorizing `identity:get_user(user_id=513f8c5508794dee99ec79dd7ad7819f)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:04.815992 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42a98dde-ed3d-4072-9735-bbfa37b6bae3 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:04.818147 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 94/194] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:07:04 2022] GET /identity/v3/users/513f8c5508794dee99ec79dd7ad7819f => generated 283 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:04.818531 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a98dde-ed3d-4072-9735-bbfa37b6bae3 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:04.819922 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86f0aa-c916-480e-9cd4-4d760e3b881e None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:04.834755 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:04.864374 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d829f-9e7e-430f-b538-738fea0d37ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:04.865000 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d829f-9e7e-430f-b538-738fea0d37ed None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:04.867412 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d829f-9e7e-430f-b538-738fea0d37ed None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:04.867412 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117d829f-9e7e-430f-b538-738fea0d37ed None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:04.867412 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d829f-9e7e-430f-b538-738fea0d37ed None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:04.867690 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d829f-9e7e-430f-b538-738fea0d37ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:04.868886 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117d829f-9e7e-430f-b538-738fea0d37ed None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:04.881308 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 101/195] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:07:04 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:04.886706 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d829f-9e7e-430f-b538-738fea0d37ed None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:04.933744 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:04.937731 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a98dde-ed3d-4072-9735-bbfa37b6bae3 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:04.974241 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3c222-d777-4c3d-b179-ca833d00d8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:04.974879 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3c222-d777-4c3d-b179-ca833d00d8b9 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:04.975156 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3c222-d777-4c3d-b179-ca833d00d8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:04.975428 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa3c222-d777-4c3d-b179-ca833d00d8b9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:04.976588 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3c222-d777-4c3d-b179-ca833d00d8b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:04.978036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa3c222-d777-4c3d-b179-ca833d00d8b9 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:04.979800 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 95/196] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:07:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:04.980662 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3c222-d777-4c3d-b179-ca833d00d8b9 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:04.989339 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117d829f-9e7e-430f-b538-738fea0d37ed None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:05.022281 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47e08c-a32b-4b58-afea-dcbdbad56f62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:05.022822 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47e08c-a32b-4b58-afea-dcbdbad56f62 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:05.023099 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47e08c-a32b-4b58-afea-dcbdbad56f62 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:05.023370 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e47e08c-a32b-4b58-afea-dcbdbad56f62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:05.024146 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47e08c-a32b-4b58-afea-dcbdbad56f62 None admin] RBAC: Adding query filter params (role.id=33cd9c7fcf9b4bbe9d604952279e8d76, scope.project.id=bc21d3271bc242269a0b17ac6504bde5, user.id=d91b409307d64b3fb23df25bc6e6dfdc) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:05.024483 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47e08c-a32b-4b58-afea-dcbdbad56f62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:05.025934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e47e08c-a32b-4b58-afea-dcbdbad56f62 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:05.032147 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 102/197] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:07:04 2022] GET /identity/v3/role_assignments?user.id=d91b409307d64b3fb23df25bc6e6dfdc&scope.project.id=bc21d3271bc242269a0b17ac6504bde5&role.id=33cd9c7fcf9b4bbe9d604952279e8d76 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:05.032948 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47e08c-a32b-4b58-afea-dcbdbad56f62 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:05.077058 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:05.098731 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa3c222-d777-4c3d-b179-ca833d00d8b9 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:05.137212 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9d21f-e786-4795-84d0-16680f606cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:05.137846 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9d21f-e786-4795-84d0-16680f606cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:05.138121 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9d21f-e786-4795-84d0-16680f606cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:05.138388 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c9d21f-e786-4795-84d0-16680f606cd7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:05.148102 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e47e08c-a32b-4b58-afea-dcbdbad56f62 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:05.174482 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:05.194730 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec0944-ca89-4445-8b0b-ed858cc6e293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:05.196152 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec0944-ca89-4445-8b0b-ed858cc6e293 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:05.196152 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec0944-ca89-4445-8b0b-ed858cc6e293 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:05.196427 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fec0944-ca89-4445-8b0b-ed858cc6e293 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:05.219398 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c9d21f-e786-4795-84d0-16680f606cd7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:05.220878 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c9d21f-e786-4795-84d0-16680f606cd7 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:05.280794 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec0944-ca89-4445-8b0b-ed858cc6e293 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:05.282199 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fec0944-ca89-4445-8b0b-ed858cc6e293 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:05.321371 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:05.328446 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 96/198] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:07:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:07:05.328446 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9d21f-e786-4795-84d0-16680f606cd7 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:05.382852 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 103/199] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:07:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:07:05.383667 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec0944-ca89-4445-8b0b-ed858cc6e293 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:05.394618 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:05.429439 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c9d21f-e786-4795-84d0-16680f606cd7 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:05.462646 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826bb9f-a51c-4c5f-9644-67e52dc0ec7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:05.463275 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826bb9f-a51c-4c5f-9644-67e52dc0ec7a None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:05.464073 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826bb9f-a51c-4c5f-9644-67e52dc0ec7a None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:05.464364 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e826bb9f-a51c-4c5f-9644-67e52dc0ec7a None admin] PATH_INFO: `/v3/users/513f8c5508794dee99ec79dd7ad7819f` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:05.465528 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826bb9f-a51c-4c5f-9644-67e52dc0ec7a None admin] RBAC: Authorizing `identity:get_user(user_id=513f8c5508794dee99ec79dd7ad7819f)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:05.466964 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e826bb9f-a51c-4c5f-9644-67e52dc0ec7a None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:05.468577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 97/200] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:07:05 2022] GET /identity/v3/users/513f8c5508794dee99ec79dd7ad7819f => generated 283 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:05.469331 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826bb9f-a51c-4c5f-9644-67e52dc0ec7a None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:05.485288 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fec0944-ca89-4445-8b0b-ed858cc6e293 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:05.517838 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8485c-33d9-4d76-8eba-961bad2c9e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:05.518442 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8485c-33d9-4d76-8eba-961bad2c9e6f None admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:05.518719 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8485c-33d9-4d76-8eba-961bad2c9e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:05.518985 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f8485c-33d9-4d76-8eba-961bad2c9e6f None admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:05.519659 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f8485c-33d9-4d76-8eba-961bad2c9e6f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:05.521105 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56f8485c-33d9-4d76-8eba-961bad2c9e6f None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:05.531315 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:05.543162 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 104/201] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Aug 5 02:07:05 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:07:05.543965 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8485c-33d9-4d76-8eba-961bad2c9e6f None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:05.572507 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e826bb9f-a51c-4c5f-9644-67e52dc0ec7a None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:05.614032 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1787f-bef4-4736-b85e-6966107c8c9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:05.614737 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1787f-bef4-4736-b85e-6966107c8c9b None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:05.614959 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1787f-bef4-4736-b85e-6966107c8c9b None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:05.615233 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f1787f-bef4-4736-b85e-6966107c8c9b None admin] PATH_INFO: `/v3/projects/758af4bbce9a439eb91820fb4527231a` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:05.616481 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f1787f-bef4-4736-b85e-6966107c8c9b None admin] RBAC: Authorizing `identity:get_project(project_id=758af4bbce9a439eb91820fb4527231a)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:05.617943 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f1787f-bef4-4736-b85e-6966107c8c9b None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:05.619720 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 98/202] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:07:05 2022] GET /identity/v3/projects/758af4bbce9a439eb91820fb4527231a => generated 298 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:05.620731 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1787f-bef4-4736-b85e-6966107c8c9b None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:05.623705 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:05.682532 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f8485c-33d9-4d76-8eba-961bad2c9e6f None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:05.722233 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09198f0-69cc-44bf-8a1d-afc83f1bf035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:05.723253 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09198f0-69cc-44bf-8a1d-afc83f1bf035 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:05.723789 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09198f0-69cc-44bf-8a1d-afc83f1bf035 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:05.724182 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e09198f0-69cc-44bf-8a1d-afc83f1bf035 None admin] PATH_INFO: `/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:05.725405 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09198f0-69cc-44bf-8a1d-afc83f1bf035 None admin] RBAC: Authorizing `identity:get_project(project_id=4c39c7e842b54d0f8d9c70bc00f480ce)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:05.726863 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e09198f0-69cc-44bf-8a1d-afc83f1bf035 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:05.728831 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 105/203] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:07:05 2022] GET /identity/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:05.729515 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09198f0-69cc-44bf-8a1d-afc83f1bf035 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:05.747752 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f1787f-bef4-4736-b85e-6966107c8c9b None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:05.793360 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e0108-0c0b-4477-a4f2-8f9fc5e39221 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:05.794345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e0108-0c0b-4477-a4f2-8f9fc5e39221 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:05.794845 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e0108-0c0b-4477-a4f2-8f9fc5e39221 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:05.795318 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239e0108-0c0b-4477-a4f2-8f9fc5e39221 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:05.803570 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:05.856022 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e09198f0-69cc-44bf-8a1d-afc83f1bf035 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:05.895636 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e0108-0c0b-4477-a4f2-8f9fc5e39221 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:05.896905 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741470e-2efd-47ee-9a9e-7a7391d460bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:05.897111 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239e0108-0c0b-4477-a4f2-8f9fc5e39221 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:05.897531 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741470e-2efd-47ee-9a9e-7a7391d460bf None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:05.897817 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741470e-2efd-47ee-9a9e-7a7391d460bf None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:05.898098 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4741470e-2efd-47ee-9a9e-7a7391d460bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:05.898904 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4741470e-2efd-47ee-9a9e-7a7391d460bf None admin] RBAC: Adding query filter params (role.id=1070d90fae74403eab5e52609af8ed78, scope.project.id=758af4bbce9a439eb91820fb4527231a, user.id=8c80afce28044fe0bbb3c9f8cd3c3df0) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:05.899085 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:05.899222 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4741470e-2efd-47ee-9a9e-7a7391d460bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:05.900693 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4741470e-2efd-47ee-9a9e-7a7391d460bf None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:05.909862 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 106/204] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:07:05 2022] GET /identity/v3/role_assignments?user.id=8c80afce28044fe0bbb3c9f8cd3c3df0&scope.project.id=758af4bbce9a439eb91820fb4527231a&role.id=1070d90fae74403eab5e52609af8ed78 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:05.910789 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741470e-2efd-47ee-9a9e-7a7391d460bf None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:06.024747 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4741470e-2efd-47ee-9a9e-7a7391d460bf None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:06.043093 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 99/205] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:07:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:07:06.048671 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e0108-0c0b-4477-a4f2-8f9fc5e39221 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:06.080011 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:06.085103 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95706574-1f86-4036-873f-848f06496a0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:06.085783 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95706574-1f86-4036-873f-848f06496a0f None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:06.086068 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95706574-1f86-4036-873f-848f06496a0f None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:06.086415 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95706574-1f86-4036-873f-848f06496a0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:06.088037 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95706574-1f86-4036-873f-848f06496a0f None admin] RBAC: Adding query filter params (role.id=e1b75d5eea2a43b2b1b14cf0515350fa, scope.project.id=4c39c7e842b54d0f8d9c70bc00f480ce, user.id=513f8c5508794dee99ec79dd7ad7819f) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:06.090322 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95706574-1f86-4036-873f-848f06496a0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:06.091829 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95706574-1f86-4036-873f-848f06496a0f None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:06.105291 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 107/206] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:07:05 2022] GET /identity/v3/role_assignments?user.id=513f8c5508794dee99ec79dd7ad7819f&scope.project.id=4c39c7e842b54d0f8d9c70bc00f480ce&role.id=e1b75d5eea2a43b2b1b14cf0515350fa => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:06.211896 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239e0108-0c0b-4477-a4f2-8f9fc5e39221 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:06.214126 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:06.254602 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773b879e-36e9-42e6-91cf-d53a61f71d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:06.255286 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b879e-36e9-42e6-91cf-d53a61f71d0d None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:06.255570 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b879e-36e9-42e6-91cf-d53a61f71d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:06.255843 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773b879e-36e9-42e6-91cf-d53a61f71d0d None admin] PATH_INFO: `/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:06.257179 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773b879e-36e9-42e6-91cf-d53a61f71d0d None admin] RBAC: Authorizing `identity:get_project(project_id=4c39c7e842b54d0f8d9c70bc00f480ce)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:06.258677 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773b879e-36e9-42e6-91cf-d53a61f71d0d None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:06.261499 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 100/207] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:07:06 2022] GET /identity/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce => generated 302 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:06.267183 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95706574-1f86-4036-873f-848f06496a0f None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:06.379190 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95706574-1f86-4036-873f-848f06496a0f None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:06.417499 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d824cf9-2424-40e7-9af0-3e84a5ac4916 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:06.418165 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d824cf9-2424-40e7-9af0-3e84a5ac4916 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:06.418456 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d824cf9-2424-40e7-9af0-3e84a5ac4916 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:06.418740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d824cf9-2424-40e7-9af0-3e84a5ac4916 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:06.419588 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d824cf9-2424-40e7-9af0-3e84a5ac4916 None admin] RBAC: Adding query filter params (role.id=5c52e382f2bc436d95d82f2a2fae8ace, scope.project.id=4c39c7e842b54d0f8d9c70bc00f480ce, user.id=513f8c5508794dee99ec79dd7ad7819f) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:06.419906 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d824cf9-2424-40e7-9af0-3e84a5ac4916 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:06.421426 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d824cf9-2424-40e7-9af0-3e84a5ac4916 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:06.429213 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 108/208] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:07:06 2022] GET /identity/v3/role_assignments?user.id=513f8c5508794dee99ec79dd7ad7819f&scope.project.id=4c39c7e842b54d0f8d9c70bc00f480ce&role.id=5c52e382f2bc436d95d82f2a2fae8ace => generated 259 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:07.855203 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80e35b-e2c6-479b-8163-c1e688eb7cbc None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:07.855203 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80e35b-e2c6-479b-8163-c1e688eb7cbc None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:07.855203 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e80e35b-e2c6-479b-8163-c1e688eb7cbc None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:07.856216 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 101/209] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:07.861731 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e93d8a-d474-4a4a-bef0-0f92a0135dbb None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:07.862525 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e93d8a-d474-4a4a-bef0-0f92a0135dbb None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:07.863008 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e93d8a-d474-4a4a-bef0-0f92a0135dbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:07.881776 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-45e93d8a-d474-4a4a-bef0-0f92a0135dbb None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:07.883276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-45e93d8a-d474-4a4a-bef0-0f92a0135dbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:07.924646 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6093848-06e1-436a-88f1-b7aec76f6a55 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:07.925266 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6093848-06e1-436a-88f1-b7aec76f6a55 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:07.925770 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6093848-06e1-436a-88f1-b7aec76f6a55 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:07.927556 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 102/210] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:07.933027 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b35f0e-ef94-40c2-893b-50f0cbb5170c None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:07.933421 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b35f0e-ef94-40c2-893b-50f0cbb5170c None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:07.933915 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86b35f0e-ef94-40c2-893b-50f0cbb5170c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:07.937086 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:07.957900 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-86b35f0e-ef94-40c2-893b-50f0cbb5170c None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:07.959377 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-86b35f0e-ef94-40c2-893b-50f0cbb5170c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:07.966924 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 109/211] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:07:07.989154 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e93d8a-d474-4a4a-bef0-0f92a0135dbb None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:08.034752 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 103/212] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:07:08.059258 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b35f0e-ef94-40c2-893b-50f0cbb5170c None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:08.103254 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e93d8a-d474-4a4a-bef0-0f92a0135dbb None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:08.154594 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae72b83-d96b-447a-b0bc-222b2d4568b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:08.155281 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae72b83-d96b-447a-b0bc-222b2d4568b8 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:08.155566 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae72b83-d96b-447a-b0bc-222b2d4568b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:08.155855 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae72b83-d96b-447a-b0bc-222b2d4568b8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:08.171251 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae72b83-d96b-447a-b0bc-222b2d4568b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:08.173118 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:08.176343 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86b35f0e-ef94-40c2-893b-50f0cbb5170c None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:08.178745 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-9ae72b83-d96b-447a-b0bc-222b2d4568b8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:07:08.178745 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:08.178745 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:08.178745 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:08.178745 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:08.178745 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:08.178745 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:08.178745 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:08.178745 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:08.178745 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:08.178745 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:08.178745 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:08.178745 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:08.178745 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:08.178745 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:08.178745 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:08.179619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:08.179619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:08.179619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:08.179619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:08.179619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:08.179619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:08.179619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:08.179619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:08.179619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:08.179619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:08.179619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:08.179619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:08.179619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:08.179619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:08.179619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:08.179619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:08.180437 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:08.180437 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:08.180437 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:08.180437 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:08.180437 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:08.180437 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:08.180437 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:08.180437 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:08.180437 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:08.180437 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:08.180437 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:07:08.180437 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:08.180437 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 110/213] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:07:07 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:08.187321 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae72b83-d96b-447a-b0bc-222b2d4568b8 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:08.230834 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85687e-15c9-482f-bcb5-215069d9c5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:08.231491 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85687e-15c9-482f-bcb5-215069d9c5ca None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:08.231774 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85687e-15c9-482f-bcb5-215069d9c5ca None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:08.232050 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab85687e-15c9-482f-bcb5-215069d9c5ca None admin] PATH_INFO: `/v3/domains/default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:08.233961 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab85687e-15c9-482f-bcb5-215069d9c5ca None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:08.235903 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab85687e-15c9-482f-bcb5-215069d9c5ca None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:08.242702 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 104/214] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:07:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:08.242872 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:08.244067 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85687e-15c9-482f-bcb5-215069d9c5ca None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:08.301394 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae72b83-d96b-447a-b0bc-222b2d4568b8 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:08.336237 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519cb89e-7015-4e18-abaf-e9420b380b2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:08.336881 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cb89e-7015-4e18-abaf-e9420b380b2b None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:08.337157 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cb89e-7015-4e18-abaf-e9420b380b2b None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:08.337429 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519cb89e-7015-4e18-abaf-e9420b380b2b None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:08.338142 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519cb89e-7015-4e18-abaf-e9420b380b2b None admin] RBAC: Adding query filter params (name=member) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:08.338488 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519cb89e-7015-4e18-abaf-e9420b380b2b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:08.339861 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519cb89e-7015-4e18-abaf-e9420b380b2b None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:08.348507 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 111/215] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Aug 5 02:07:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:08.353847 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b6793-2898-4c90-8198-19e6d5802dc8 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:08.354083 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b6793-2898-4c90-8198-19e6d5802dc8 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:08.354358 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830b6793-2898-4c90-8198-19e6d5802dc8 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:08.355856 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 112/216] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:08.360574 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b6793-2898-4c90-8198-19e6d5802dc8 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:08.362118 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab85687e-15c9-482f-bcb5-215069d9c5ca None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:08.400126 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4905ac64-fbab-40dc-b15e-22038fc38ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:08.400883 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905ac64-fbab-40dc-b15e-22038fc38ac2 None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:08.401158 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905ac64-fbab-40dc-b15e-22038fc38ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:08.401433 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4905ac64-fbab-40dc-b15e-22038fc38ac2 None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:08.402124 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4905ac64-fbab-40dc-b15e-22038fc38ac2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:08.403550 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4905ac64-fbab-40dc-b15e-22038fc38ac2 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:08.432624 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 105/217] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Aug 5 02:07:08 2022] POST /identity/v3/users => generated 297 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:07:08.432624 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81f420-bfa2-47a1-8439-7ff3c9415241 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:08.432624 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81f420-bfa2-47a1-8439-7ff3c9415241 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:08.432624 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd81f420-bfa2-47a1-8439-7ff3c9415241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:08.447689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-fd81f420-bfa2-47a1-8439-7ff3c9415241 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:08.449108 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-fd81f420-bfa2-47a1-8439-7ff3c9415241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:08.469783 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:08.512754 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830b6793-2898-4c90-8198-19e6d5802dc8 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:08.521864 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:08.538672 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 106/218] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:07:08.540505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21dc933-9ecf-430b-bfb1-ed2ec5849695 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:08.540864 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21dc933-9ecf-430b-bfb1-ed2ec5849695 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:08.541208 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21dc933-9ecf-430b-bfb1-ed2ec5849695 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:08.543456 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 107/219] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:08.550268 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4ef25-9a6c-4889-8026-8522b2217ce7 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:08.550580 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4ef25-9a6c-4889-8026-8522b2217ce7 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:08.550835 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da4ef25-9a6c-4889-8026-8522b2217ce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:08.568520 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b466b-e393-4a28-8307-d55a41802cd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:08.569182 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b466b-e393-4a28-8307-d55a41802cd3 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:08.569467 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b466b-e393-4a28-8307-d55a41802cd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:08.569747 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a8b466b-e393-4a28-8307-d55a41802cd3 None admin] PATH_INFO: `/v3/users/a3ca4980677b477d8a88b905313ee4b6` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:08.578477 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-0da4ef25-9a6c-4889-8026-8522b2217ce7 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:08.580346 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-0da4ef25-9a6c-4889-8026-8522b2217ce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:08.585440 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b466b-e393-4a28-8307-d55a41802cd3 None admin] RBAC: Authorizing `identity:get_user(user_id=a3ca4980677b477d8a88b905313ee4b6)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:08.587595 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a8b466b-e393-4a28-8307-d55a41802cd3 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:08.593915 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 113/220] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:07:08 2022] GET /identity/v3/users/a3ca4980677b477d8a88b905313ee4b6 => generated 297 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:08.593915 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b466b-e393-4a28-8307-d55a41802cd3 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:08.662929 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 108/221] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:07:08.663928 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da4ef25-9a6c-4889-8026-8522b2217ce7 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:08.736473 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a8b466b-e393-4a28-8307-d55a41802cd3 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:08.768245 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:08.780049 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da478224-b1b3-4736-959e-d2202618949d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:08.780835 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da478224-b1b3-4736-959e-d2202618949d None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:08.781118 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da478224-b1b3-4736-959e-d2202618949d None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:08.781379 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da478224-b1b3-4736-959e-d2202618949d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:08.788910 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da4ef25-9a6c-4889-8026-8522b2217ce7 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:08.795000 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da478224-b1b3-4736-959e-d2202618949d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:08.800295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-da478224-b1b3-4736-959e-d2202618949d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:07:08.800295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:08.800295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:08.800295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:08.800295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:08.800295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:08.800295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:08.800295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:08.800295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:08.800295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:08.800295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:08.800295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:08.800295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:08.800295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:08.800295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:08.800295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:08.801254 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:08.801254 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:08.801254 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:08.801254 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:08.801254 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:08.801254 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:08.801254 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:08.801254 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:08.801254 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:08.801254 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:08.801254 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:08.801254 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:08.801254 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:08.801254 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:08.801254 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:08.801254 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:08.802041 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:08.802041 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:08.802041 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:08.802041 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:08.802041 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:08.802041 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:08.802041 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:08.802041 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:08.802041 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:08.802041 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:08.802041 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:07:08.802041 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:08.802632 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 114/222] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Aug 5 02:07:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:08.803178 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da478224-b1b3-4736-959e-d2202618949d None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:08.839455 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:08.843981 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c343f68-ff2c-4187-8b6c-8df1116a8a7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:08.848560 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c343f68-ff2c-4187-8b6c-8df1116a8a7b None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:08.848560 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c343f68-ff2c-4187-8b6c-8df1116a8a7b None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:08.848560 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c343f68-ff2c-4187-8b6c-8df1116a8a7b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:08.925270 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da478224-b1b3-4736-959e-d2202618949d None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:08.933472 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c343f68-ff2c-4187-8b6c-8df1116a8a7b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:08.935500 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c343f68-ff2c-4187-8b6c-8df1116a8a7b None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:08.962881 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3558c-3ffa-41b3-85eb-a9dcf5f0372f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:08.964365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3558c-3ffa-41b3-85eb-a9dcf5f0372f None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:08.964793 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3558c-3ffa-41b3-85eb-a9dcf5f0372f None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:08.965208 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d3558c-3ffa-41b3-85eb-a9dcf5f0372f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:08.976243 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d3558c-3ffa-41b3-85eb-a9dcf5f0372f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:08.981981 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-60d3558c-3ffa-41b3-85eb-a9dcf5f0372f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:07:08.981981 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:08.981981 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:08.981981 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:08.981981 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:08.981981 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:08.981981 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:08.981981 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:08.981981 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:08.981981 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:08.981981 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:08.981981 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:08.981981 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:08.981981 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:08.981981 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:08.981981 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:08.983060 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:08.983060 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:08.983060 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:08.983060 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:08.983060 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:08.983060 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:08.983060 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:08.983060 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:08.983060 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:08.983060 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:08.983060 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:08.983060 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:08.983060 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:08.983060 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:08.983060 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:08.983060 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:08.984042 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:08.984042 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:08.984042 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:08.984042 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:08.984042 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:08.984042 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:08.984042 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:08.984042 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:08.984042 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:08.984042 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:08.984042 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:07:08.984042 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:08.986109 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 115/223] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Aug 5 02:07:08 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:08.987069 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3558c-3ffa-41b3-85eb-a9dcf5f0372f None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:09.041391 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:09.061141 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 109/224] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:07:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:07:09.062086 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c343f68-ff2c-4187-8b6c-8df1116a8a7b None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:09.093615 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:09.112242 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d3558c-3ffa-41b3-85eb-a9dcf5f0372f None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:09.150247 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cfdbcf-137c-4d75-bbee-de73adc73e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:09.151535 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfdbcf-137c-4d75-bbee-de73adc73e8a None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:09.151832 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfdbcf-137c-4d75-bbee-de73adc73e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:09.152202 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cfdbcf-137c-4d75-bbee-de73adc73e8a None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:09.152959 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cfdbcf-137c-4d75-bbee-de73adc73e8a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:09.153265 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cfdbcf-137c-4d75-bbee-de73adc73e8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:09.154653 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cfdbcf-137c-4d75-bbee-de73adc73e8a None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:09.167603 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 116/225] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:07:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:09.173293 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cfdbcf-137c-4d75-bbee-de73adc73e8a None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:09.205559 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c343f68-ff2c-4187-8b6c-8df1116a8a7b None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:09.244934 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd3da2-5ecb-4e96-8e2d-9aa0ed93dfac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:09.245559 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd3da2-5ecb-4e96-8e2d-9aa0ed93dfac None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:09.245916 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd3da2-5ecb-4e96-8e2d-9aa0ed93dfac None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:09.246169 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-effd3da2-5ecb-4e96-8e2d-9aa0ed93dfac None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:09.246933 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd3da2-5ecb-4e96-8e2d-9aa0ed93dfac None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:09.247244 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd3da2-5ecb-4e96-8e2d-9aa0ed93dfac None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:09.248753 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-effd3da2-5ecb-4e96-8e2d-9aa0ed93dfac None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:09.260776 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 110/226] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:07:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:09.261645 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd3da2-5ecb-4e96-8e2d-9aa0ed93dfac None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:09.299438 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cfdbcf-137c-4d75-bbee-de73adc73e8a None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:09.314009 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:09.347591 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe5a4f4-fb48-436a-91f8-b36909cfab6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:09.349214 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5a4f4-fb48-436a-91f8-b36909cfab6f None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:09.349678 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5a4f4-fb48-436a-91f8-b36909cfab6f None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:09.350508 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe5a4f4-fb48-436a-91f8-b36909cfab6f None admin] PATH_INFO: `/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:09.352122 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe5a4f4-fb48-436a-91f8-b36909cfab6f None admin] RBAC: Authorizing `identity:get_project(project_id=4c39c7e842b54d0f8d9c70bc00f480ce)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:09.355185 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe5a4f4-fb48-436a-91f8-b36909cfab6f None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:09.357645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 117/227] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:07:09 2022] GET /identity/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce => generated 302 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:09.358590 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe5a4f4-fb48-436a-91f8-b36909cfab6f None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:09.378548 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-effd3da2-5ecb-4e96-8e2d-9aa0ed93dfac None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:09.382523 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:09.419610 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2a8c5-3898-4ca4-9212-aa40bdfdc823 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:09.420259 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2a8c5-3898-4ca4-9212-aa40bdfdc823 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:09.420584 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2a8c5-3898-4ca4-9212-aa40bdfdc823 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:09.420922 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e2a8c5-3898-4ca4-9212-aa40bdfdc823 None admin] PATH_INFO: `/v3/users/513f8c5508794dee99ec79dd7ad7819f` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:09.422363 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e2a8c5-3898-4ca4-9212-aa40bdfdc823 None admin] RBAC: Authorizing `identity:get_user(user_id=513f8c5508794dee99ec79dd7ad7819f)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:09.423899 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9e2a8c5-3898-4ca4-9212-aa40bdfdc823 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:09.430116 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 111/228] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:07:09 2022] GET /identity/v3/users/513f8c5508794dee99ec79dd7ad7819f => generated 283 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:09.430116 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2a8c5-3898-4ca4-9212-aa40bdfdc823 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:09.499539 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe5a4f4-fb48-436a-91f8-b36909cfab6f None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:09.535050 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9e2a8c5-3898-4ca4-9212-aa40bdfdc823 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:09.536346 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a68e71-34b9-442d-a997-94d422a70534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:09.537237 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a68e71-34b9-442d-a997-94d422a70534 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:09.537772 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a68e71-34b9-442d-a997-94d422a70534 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:09.538227 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a68e71-34b9-442d-a997-94d422a70534 None admin] PATH_INFO: `/v3/users/513f8c5508794dee99ec79dd7ad7819f` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:09.539589 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a68e71-34b9-442d-a997-94d422a70534 None admin] RBAC: Authorizing `identity:get_user(user_id=513f8c5508794dee99ec79dd7ad7819f)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:09.541794 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a68e71-34b9-442d-a997-94d422a70534 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:09.543629 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 118/229] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:07:09 2022] GET /identity/v3/users/513f8c5508794dee99ec79dd7ad7819f => generated 283 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:09.544622 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a68e71-34b9-442d-a997-94d422a70534 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:09.555846 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:09.578750 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01640b-1618-4dea-8c62-90cbf61e1543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:09.579374 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01640b-1618-4dea-8c62-90cbf61e1543 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:09.579654 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01640b-1618-4dea-8c62-90cbf61e1543 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:09.579931 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc01640b-1618-4dea-8c62-90cbf61e1543 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:09.580823 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc01640b-1618-4dea-8c62-90cbf61e1543 None admin] RBAC: Adding query filter params (role.id=33cd9c7fcf9b4bbe9d604952279e8d76, scope.project.id=4c39c7e842b54d0f8d9c70bc00f480ce, user.id=a3ca4980677b477d8a88b905313ee4b6) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:09.581125 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc01640b-1618-4dea-8c62-90cbf61e1543 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:09.582675 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc01640b-1618-4dea-8c62-90cbf61e1543 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:09.589045 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 112/230] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:07:09 2022] GET /identity/v3/role_assignments?user.id=a3ca4980677b477d8a88b905313ee4b6&scope.project.id=4c39c7e842b54d0f8d9c70bc00f480ce&role.id=33cd9c7fcf9b4bbe9d604952279e8d76 => generated 259 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:09.589997 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01640b-1618-4dea-8c62-90cbf61e1543 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:09.640607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:09.661380 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a68e71-34b9-442d-a997-94d422a70534 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:09.699669 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3349646-1881-408e-93db-8a6ab51f9605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:09.700676 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3349646-1881-408e-93db-8a6ab51f9605 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:09.701173 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3349646-1881-408e-93db-8a6ab51f9605 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:09.701590 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3349646-1881-408e-93db-8a6ab51f9605 None admin] PATH_INFO: `/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:09.703200 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3349646-1881-408e-93db-8a6ab51f9605 None admin] RBAC: Authorizing `identity:get_project(project_id=4c39c7e842b54d0f8d9c70bc00f480ce)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:09.704861 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3349646-1881-408e-93db-8a6ab51f9605 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:09.712192 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 119/231] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:07:09 2022] GET /identity/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:09.717702 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3349646-1881-408e-93db-8a6ab51f9605 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:09.844581 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc01640b-1618-4dea-8c62-90cbf61e1543 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:09.844779 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3349646-1881-408e-93db-8a6ab51f9605 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:09.887893 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf571d4-cf2a-43bf-bf3f-4338a83eb16f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:09.891320 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf571d4-cf2a-43bf-bf3f-4338a83eb16f None admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:09.891605 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf571d4-cf2a-43bf-bf3f-4338a83eb16f None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:09.891886 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf571d4-cf2a-43bf-bf3f-4338a83eb16f None admin] PATH_INFO: `/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce/users/513f8c5508794dee99ec79dd7ad7819f/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:09.893975 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf571d4-cf2a-43bf-bf3f-4338a83eb16f None admin] RBAC: Authorizing `identity:create_grant(project_id=4c39c7e842b54d0f8d9c70bc00f480ce, user_id=513f8c5508794dee99ec79dd7ad7819f, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:09.895425 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf571d4-cf2a-43bf-bf3f-4338a83eb16f None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:09.915497 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb5e84-66e2-4bf8-a010-8990b3e7f4d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:09.916152 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb5e84-66e2-4bf8-a010-8990b3e7f4d8 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:09.917178 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb5e84-66e2-4bf8-a010-8990b3e7f4d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:09.924628 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 120/232] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Aug 5 02:07:09 2022] PUT /identity/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce/users/513f8c5508794dee99ec79dd7ad7819f/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:07:09.924911 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb5e84-66e2-4bf8-a010-8990b3e7f4d8 None admin] PATH_INFO: `/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:09.926189 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb5e84-66e2-4bf8-a010-8990b3e7f4d8 None admin] RBAC: Authorizing `identity:get_project(project_id=4c39c7e842b54d0f8d9c70bc00f480ce)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:09.927650 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28bb5e84-66e2-4bf8-a010-8990b3e7f4d8 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:09.929623 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 113/233] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:07:09 2022] GET /identity/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce => generated 302 bytes in 340 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:09.936263 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf571d4-cf2a-43bf-bf3f-4338a83eb16f None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:09.957499 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:10.054441 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf571d4-cf2a-43bf-bf3f-4338a83eb16f None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:10.094586 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5a60f78-61e3-41d0-98f8-2bcaf63bb1a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:10.095187 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a60f78-61e3-41d0-98f8-2bcaf63bb1a1 None admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:10.095468 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a60f78-61e3-41d0-98f8-2bcaf63bb1a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:10.095741 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a60f78-61e3-41d0-98f8-2bcaf63bb1a1 None admin] PATH_INFO: `/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce/users/513f8c5508794dee99ec79dd7ad7819f/roles/5c52e382f2bc436d95d82f2a2fae8ace` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:10.097983 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a60f78-61e3-41d0-98f8-2bcaf63bb1a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=4c39c7e842b54d0f8d9c70bc00f480ce, user_id=513f8c5508794dee99ec79dd7ad7819f, role_id=5c52e382f2bc436d95d82f2a2fae8ace)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:10.099774 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5a60f78-61e3-41d0-98f8-2bcaf63bb1a1 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:10.117109 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 121/234] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Aug 5 02:07:09 2022] PUT /identity/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce/users/513f8c5508794dee99ec79dd7ad7819f/roles/5c52e382f2bc436d95d82f2a2fae8ace => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:07:10.799744 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41de0c-ed16-4712-b260-2b0948206af8 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:10.800883 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41de0c-ed16-4712-b260-2b0948206af8 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:10.801403 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d41de0c-ed16-4712-b260-2b0948206af8 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:10.803192 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 114/235] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:10.811275 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0dca8a-663c-425b-b4c0-2184983707d1 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:10.811816 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0dca8a-663c-425b-b4c0-2184983707d1 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:10.812302 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0dca8a-663c-425b-b4c0-2184983707d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:10.840503 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-7b0dca8a-663c-425b-b4c0-2184983707d1 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:10.842004 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-7b0dca8a-663c-425b-b4c0-2184983707d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:10.922609 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:10.927544 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 122/236] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:07:10.960665 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41de0c-ed16-4712-b260-2b0948206af8 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:10.986120 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e304167-1c5b-4c18-84d6-2e965eea68e2 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:10.987063 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e304167-1c5b-4c18-84d6-2e965eea68e2 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:10.987531 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e304167-1c5b-4c18-84d6-2e965eea68e2 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:10.989418 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 123/237] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:07:10.994552 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb94a58-0279-40d7-b35b-a045aed32f64 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:10.995080 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb94a58-0279-40d7-b35b-a045aed32f64 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:10.995553 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb94a58-0279-40d7-b35b-a045aed32f64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:11.014684 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-2eb94a58-0279-40d7-b35b-a045aed32f64 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:11.016150 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-2eb94a58-0279-40d7-b35b-a045aed32f64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:11.048083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:11.115108 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d41de0c-ed16-4712-b260-2b0948206af8 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:11.154533 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64dcf9c-f8fb-4120-ae2d-af5eebb35da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:11.155420 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64dcf9c-f8fb-4120-ae2d-af5eebb35da1 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:11.155702 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64dcf9c-f8fb-4120-ae2d-af5eebb35da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:11.155975 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64dcf9c-f8fb-4120-ae2d-af5eebb35da1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:11.167369 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 124/238] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:07:11.171800 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64dcf9c-f8fb-4120-ae2d-af5eebb35da1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:11.177051 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-c64dcf9c-f8fb-4120-ae2d-af5eebb35da1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 02:07:11.177051 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:11.177051 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:11.177051 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:11.177051 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:11.177051 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:11.177051 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:11.177051 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:11.177051 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:11.177051 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:11.177051 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:11.177051 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:11.177051 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:11.177051 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:11.177051 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:11.177051 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:11.177914 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:11.177914 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:11.177914 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:11.177914 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:11.177914 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:11.177914 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:11.177914 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:11.177914 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:11.177914 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:11.177914 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:11.177914 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:11.177914 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:11.177914 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:11.177914 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:11.177914 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:11.177914 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:11.179122 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:11.179122 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:11.179122 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:11.179122 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:11.179122 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:11.179122 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:11.179122 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:11.179122 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:11.179122 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:11.179122 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:11.179122 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 02:07:11.179122 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:11.179122 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 115/239] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:07:10 2022] GET /identity/v3/roles/reader => generated 84 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:11.186006 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb94a58-0279-40d7-b35b-a045aed32f64 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:11.208952 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64dcf9c-f8fb-4120-ae2d-af5eebb35da1 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:11.360607 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64dcf9c-f8fb-4120-ae2d-af5eebb35da1 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:11.369167 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:11.384620 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eb94a58-0279-40d7-b35b-a045aed32f64 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:11.404686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe31f75-631a-4c62-bd38-6fbbd156f9fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:11.405788 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe31f75-631a-4c62-bd38-6fbbd156f9fe None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:11.406798 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe31f75-631a-4c62-bd38-6fbbd156f9fe None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:11.407252 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe31f75-631a-4c62-bd38-6fbbd156f9fe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:11.409490 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe31f75-631a-4c62-bd38-6fbbd156f9fe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:11.411506 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe31f75-631a-4c62-bd38-6fbbd156f9fe None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:11.418748 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 116/240] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:07:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:11.435368 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:11.437938 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe31f75-631a-4c62-bd38-6fbbd156f9fe None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:11.442640 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16eb2a-c42a-4ea6-8786-75c933895160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:11.443477 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16eb2a-c42a-4ea6-8786-75c933895160 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:11.443959 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16eb2a-c42a-4ea6-8786-75c933895160 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:11.444433 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c16eb2a-c42a-4ea6-8786-75c933895160 None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:11.445365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c16eb2a-c42a-4ea6-8786-75c933895160 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:11.445839 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c16eb2a-c42a-4ea6-8786-75c933895160 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:11.449135 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c16eb2a-c42a-4ea6-8786-75c933895160 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:11.459039 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 125/241] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Aug 5 02:07:11 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:11.465031 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16eb2a-c42a-4ea6-8786-75c933895160 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:11.576201 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c16eb2a-c42a-4ea6-8786-75c933895160 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:11.612758 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba68ae-1bd8-4aea-9ce5-baf4f1ec052f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:11.613821 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba68ae-1bd8-4aea-9ce5-baf4f1ec052f None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:11.614310 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba68ae-1bd8-4aea-9ce5-baf4f1ec052f None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:11.614757 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ba68ae-1bd8-4aea-9ce5-baf4f1ec052f None admin] PATH_INFO: `/v3/users/15fe2df1f0a0423d9540f483b8d7c92c` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:11.630029 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ba68ae-1bd8-4aea-9ce5-baf4f1ec052f None admin] RBAC: Authorizing `identity:get_user(user_id=15fe2df1f0a0423d9540f483b8d7c92c)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:11.631717 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ba68ae-1bd8-4aea-9ce5-baf4f1ec052f None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:11.633997 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 126/242] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:07:11 2022] GET /identity/v3/users/15fe2df1f0a0423d9540f483b8d7c92c => generated 297 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:07:11.640756 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba68ae-1bd8-4aea-9ce5-baf4f1ec052f None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:11.687627 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe31f75-631a-4c62-bd38-6fbbd156f9fe None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:11.741717 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0c21e-e01f-482d-8d04-20e942c2e406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:11.744980 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0c21e-e01f-482d-8d04-20e942c2e406 None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:11.745772 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0c21e-e01f-482d-8d04-20e942c2e406 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:11.746930 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0c21e-e01f-482d-8d04-20e942c2e406 None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:11.748159 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce0c21e-e01f-482d-8d04-20e942c2e406 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:11.751342 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce0c21e-e01f-482d-8d04-20e942c2e406 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:11.756665 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:11.803232 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 117/243] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Aug 5 02:07:11 2022] POST /identity/v3/users => generated 293 bytes in 366 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:07:11.831873 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ba68ae-1bd8-4aea-9ce5-baf4f1ec052f None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:11.873345 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f6951b-045d-4716-aa3b-dd90a3ea77d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:11.874146 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6951b-045d-4716-aa3b-dd90a3ea77d3 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:11.874524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6951b-045d-4716-aa3b-dd90a3ea77d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:11.874941 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f6951b-045d-4716-aa3b-dd90a3ea77d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:11.950398 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6951b-045d-4716-aa3b-dd90a3ea77d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:11.952174 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f6951b-045d-4716-aa3b-dd90a3ea77d3 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:12.016736 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:12.076653 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 127/244] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:07:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 436 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:07:12.081895 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0c21e-e01f-482d-8d04-20e942c2e406 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:12.130101 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b58456-c837-4855-953c-99a5569626be None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:12.130442 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b58456-c837-4855-953c-99a5569626be None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:12.130666 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b58456-c837-4855-953c-99a5569626be None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:12.132450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 128/245] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:12.137461 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917f486-303b-4ea5-ab39-74536f4f70e9 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:12.137749 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917f486-303b-4ea5-ab39-74536f4f70e9 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:12.138031 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8917f486-303b-4ea5-ab39-74536f4f70e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:12.144298 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:12.160804 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-8917f486-303b-4ea5-ab39-74536f4f70e9 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:12.162336 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-8917f486-303b-4ea5-ab39-74536f4f70e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:12.238765 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0c21e-e01f-482d-8d04-20e942c2e406 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:12.259109 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 129/246] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:07:12.282888 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c9e83-dc38-45ef-b445-3aeda666542b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:12.283920 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c9e83-dc38-45ef-b445-3aeda666542b None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:12.284472 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c9e83-dc38-45ef-b445-3aeda666542b None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:12.284947 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767c9e83-dc38-45ef-b445-3aeda666542b None admin] PATH_INFO: `/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:12.286409 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c9e83-dc38-45ef-b445-3aeda666542b None admin] RBAC: Authorizing `identity:get_project(project_id=4c39c7e842b54d0f8d9c70bc00f480ce)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:12.286516 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917f486-303b-4ea5-ab39-74536f4f70e9 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:12.288147 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-767c9e83-dc38-45ef-b445-3aeda666542b None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:12.292883 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 118/247] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:07:12 2022] GET /identity/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce => generated 302 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:12.299341 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c9e83-dc38-45ef-b445-3aeda666542b None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:12.391560 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:12.413256 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8917f486-303b-4ea5-ab39-74536f4f70e9 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:12.428163 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:12.431882 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767c9e83-dc38-45ef-b445-3aeda666542b None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:12.456409 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f94214a-e079-46a1-9cec-1e49b0c7f3dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:12.457396 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94214a-e079-46a1-9cec-1e49b0c7f3dc None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:12.457903 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94214a-e079-46a1-9cec-1e49b0c7f3dc None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:12.458372 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f94214a-e079-46a1-9cec-1e49b0c7f3dc None admin] PATH_INFO: `/v3/roles/member` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:12.470525 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3013be7d-fba8-4ff1-83ee-af1871e71eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:12.471224 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013be7d-fba8-4ff1-83ee-af1871e71eed None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:12.471507 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013be7d-fba8-4ff1-83ee-af1871e71eed None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:12.471783 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3013be7d-fba8-4ff1-83ee-af1871e71eed None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:12.472619 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3013be7d-fba8-4ff1-83ee-af1871e71eed None admin] RBAC: Adding query filter params (role.id=1070d90fae74403eab5e52609af8ed78, scope.project.id=4c39c7e842b54d0f8d9c70bc00f480ce, user.id=15fe2df1f0a0423d9540f483b8d7c92c) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:12.472933 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3013be7d-fba8-4ff1-83ee-af1871e71eed None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:12.474640 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3013be7d-fba8-4ff1-83ee-af1871e71eed None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:12.476008 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f94214a-e079-46a1-9cec-1e49b0c7f3dc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:12.482337 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 119/248] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:07:12 2022] GET /identity/v3/role_assignments?user.id=15fe2df1f0a0423d9540f483b8d7c92c&scope.project.id=4c39c7e842b54d0f8d9c70bc00f480ce&role.id=1070d90fae74403eab5e52609af8ed78 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:07:12.482979 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-4f94214a-e079-46a1-9cec-1e49b0c7f3dc None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:07:12.482979 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:12.482979 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:12.482979 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:12.482979 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:12.482979 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:12.482979 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:12.482979 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:12.482979 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:12.482979 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:12.482979 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:12.482979 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:12.482979 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:12.482979 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:12.482979 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:12.482979 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:12.484012 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:12.484012 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:12.484012 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:12.484012 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:12.484012 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:12.484012 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:12.484012 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:12.484012 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:12.484012 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:12.484012 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:12.484012 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:12.484012 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:12.484012 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:12.484012 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:12.484012 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:12.484012 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:12.485039 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:12.485039 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:12.485039 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:12.485039 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:12.485039 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:12.485039 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:12.485039 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:12.485039 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:12.485039 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:12.485039 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:12.485039 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:07:12.485039 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:12.491262 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 130/249] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:07:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:07:12.493474 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3013be7d-fba8-4ff1-83ee-af1871e71eed None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:12.508064 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224c098-437f-4737-964c-1a8eed4b4b56 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:12.508414 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224c098-437f-4737-964c-1a8eed4b4b56 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:12.508668 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0224c098-437f-4737-964c-1a8eed4b4b56 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:12.511215 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 131/250] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:12.521901 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872276d-ea9b-43da-bdbc-9f29e3b632d7 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:12.522239 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872276d-ea9b-43da-bdbc-9f29e3b632d7 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:12.522460 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2872276d-ea9b-43da-bdbc-9f29e3b632d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:12.545076 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-2872276d-ea9b-43da-bdbc-9f29e3b632d7 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:12.545686 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-2872276d-ea9b-43da-bdbc-9f29e3b632d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:12.615390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3013be7d-fba8-4ff1-83ee-af1871e71eed None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:12.628081 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 132/251] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:07:12.654016 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872276d-ea9b-43da-bdbc-9f29e3b632d7 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:12.655330 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c35a31-4af9-4a14-ae1d-1d19089d2c08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:12.656361 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c35a31-4af9-4a14-ae1d-1d19089d2c08 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:12.656843 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c35a31-4af9-4a14-ae1d-1d19089d2c08 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:12.657339 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c35a31-4af9-4a14-ae1d-1d19089d2c08 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:12.658393 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c35a31-4af9-4a14-ae1d-1d19089d2c08 None admin] RBAC: Adding query filter params (name=member) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:12.658914 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c35a31-4af9-4a14-ae1d-1d19089d2c08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:12.660557 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c35a31-4af9-4a14-ae1d-1d19089d2c08 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:12.671024 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 120/252] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Aug 5 02:07:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:12.677568 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c35a31-4af9-4a14-ae1d-1d19089d2c08 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:12.708680 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:12.762860 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:12.804379 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c35a31-4af9-4a14-ae1d-1d19089d2c08 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:12.807949 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2872276d-ea9b-43da-bdbc-9f29e3b632d7 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:12.852345 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ebb06-23b0-4466-ba59-77e697493261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:12.852989 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ebb06-23b0-4466-ba59-77e697493261 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:12.853269 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ebb06-23b0-4466-ba59-77e697493261 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:12.854194 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-819ebb06-23b0-4466-ba59-77e697493261 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:12.865485 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-819ebb06-23b0-4466-ba59-77e697493261 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:12.867817 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c490b68-f3e9-4b5f-9df0-b658b5be7b76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:12.868726 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c490b68-f3e9-4b5f-9df0-b658b5be7b76 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:12.869254 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c490b68-f3e9-4b5f-9df0-b658b5be7b76 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:12.869728 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c490b68-f3e9-4b5f-9df0-b658b5be7b76 None admin] PATH_INFO: `/v3/users/a3ca4980677b477d8a88b905313ee4b6` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:12.876363 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-819ebb06-23b0-4466-ba59-77e697493261 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:07:12.876363 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:12.876363 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:12.876363 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:12.876363 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:12.876363 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:12.876363 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:12.876363 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:12.876363 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:12.876363 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:12.876363 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:12.876363 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:12.876363 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:12.876363 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:12.876363 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:12.876363 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:12.877238 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:12.877238 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:12.877238 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:12.877238 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:12.877238 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:12.877238 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:12.877238 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:12.877238 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:12.877238 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:12.877238 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:12.877238 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:12.877238 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:12.877238 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:12.877238 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:12.877238 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:12.877238 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:12.878015 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:12.878015 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:12.878015 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:12.878015 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:12.878015 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:12.878015 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:12.878015 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:12.878015 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:12.878015 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:12.878015 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:12.878015 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:07:12.878015 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:12.878015 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 133/253] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Aug 5 02:07:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:07:12.878670 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ebb06-23b0-4466-ba59-77e697493261 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:12.880011 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c490b68-f3e9-4b5f-9df0-b658b5be7b76 None admin] RBAC: Authorizing `identity:get_user(user_id=a3ca4980677b477d8a88b905313ee4b6)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:12.881836 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c490b68-f3e9-4b5f-9df0-b658b5be7b76 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:12.884052 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 121/254] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:07:12 2022] GET /identity/v3/users/a3ca4980677b477d8a88b905313ee4b6 => generated 297 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:07:12.889814 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c490b68-f3e9-4b5f-9df0-b658b5be7b76 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:12.988515 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-819ebb06-23b0-4466-ba59-77e697493261 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:13.028458 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:13.030149 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c161f8c0-6eff-434f-a9c7-6764b810e1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:13.031110 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161f8c0-6eff-434f-a9c7-6764b810e1a3 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:13.031389 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161f8c0-6eff-434f-a9c7-6764b810e1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:13.031661 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c161f8c0-6eff-434f-a9c7-6764b810e1a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:13.032534 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c161f8c0-6eff-434f-a9c7-6764b810e1a3 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:13.032841 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c161f8c0-6eff-434f-a9c7-6764b810e1a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:13.034408 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c161f8c0-6eff-434f-a9c7-6764b810e1a3 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:13.044354 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:13.045057 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 134/255] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:07:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:13.050810 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c161f8c0-6eff-434f-a9c7-6764b810e1a3 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:13.058363 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c490b68-f3e9-4b5f-9df0-b658b5be7b76 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:13.110011 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8f86fd-2a2c-41df-9a4e-b5a3328479cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:13.111020 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f86fd-2a2c-41df-9a4e-b5a3328479cf None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:13.111481 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f86fd-2a2c-41df-9a4e-b5a3328479cf None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:13.111929 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8f86fd-2a2c-41df-9a4e-b5a3328479cf None admin] PATH_INFO: `/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:13.117064 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f86fd-2a2c-41df-9a4e-b5a3328479cf None admin] RBAC: Authorizing `identity:get_project(project_id=4c39c7e842b54d0f8d9c70bc00f480ce)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:13.118719 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8f86fd-2a2c-41df-9a4e-b5a3328479cf None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:13.121513 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 122/256] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:07:12 2022] GET /identity/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce => generated 302 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:07:13.122867 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727ab94-659a-4109-aecb-31639cd6bdfc None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:13.123325 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727ab94-659a-4109-aecb-31639cd6bdfc None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:13.123773 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e727ab94-659a-4109-aecb-31639cd6bdfc None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:13.132375 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 123/257] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:13.134323 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a62a4-4382-45cc-acd6-06d6ba9f0b58 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:13.134820 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a62a4-4382-45cc-acd6-06d6ba9f0b58 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:13.135272 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06a62a4-4382-45cc-acd6-06d6ba9f0b58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:13.156830 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c161f8c0-6eff-434f-a9c7-6764b810e1a3 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:13.173413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-a06a62a4-4382-45cc-acd6-06d6ba9f0b58 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:13.174935 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-a06a62a4-4382-45cc-acd6-06d6ba9f0b58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:13.192259 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6e458-0562-4fa1-9f39-de595f95a68e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:13.192982 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6e458-0562-4fa1-9f39-de595f95a68e None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:13.193262 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6e458-0562-4fa1-9f39-de595f95a68e None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:13.193535 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6e458-0562-4fa1-9f39-de595f95a68e None admin] PATH_INFO: `/v3/users/513f8c5508794dee99ec79dd7ad7819f` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:13.195133 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a6e458-0562-4fa1-9f39-de595f95a68e None admin] RBAC: Authorizing `identity:get_user(user_id=513f8c5508794dee99ec79dd7ad7819f)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:13.196909 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8a6e458-0562-4fa1-9f39-de595f95a68e None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:13.199902 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 135/258] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:07:13 2022] GET /identity/v3/users/513f8c5508794dee99ec79dd7ad7819f => generated 283 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:07:13.200817 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6e458-0562-4fa1-9f39-de595f95a68e None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:13.284457 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:13.307556 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 124/259] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:07:13.308790 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a62a4-4382-45cc-acd6-06d6ba9f0b58 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:13.316347 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6e458-0562-4fa1-9f39-de595f95a68e None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:13.352222 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfeaca2-e6b2-4678-9c73-8566121dd0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:13.352981 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfeaca2-e6b2-4678-9c73-8566121dd0a3 None admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:13.353257 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfeaca2-e6b2-4678-9c73-8566121dd0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:13.353624 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdfeaca2-e6b2-4678-9c73-8566121dd0a3 None admin] PATH_INFO: `/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce/users/a3ca4980677b477d8a88b905313ee4b6/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:13.356311 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfeaca2-e6b2-4678-9c73-8566121dd0a3 None admin] RBAC: Authorizing `identity:create_grant(project_id=4c39c7e842b54d0f8d9c70bc00f480ce, user_id=a3ca4980677b477d8a88b905313ee4b6, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:13.360346 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdfeaca2-e6b2-4678-9c73-8566121dd0a3 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:13.379158 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 136/260] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Aug 5 02:07:13 2022] PUT /identity/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce/users/a3ca4980677b477d8a88b905313ee4b6/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:07:13.380093 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfeaca2-e6b2-4678-9c73-8566121dd0a3 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:13.502865 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdfeaca2-e6b2-4678-9c73-8566121dd0a3 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:13.523911 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:13.529023 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:13.545016 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06a62a4-4382-45cc-acd6-06d6ba9f0b58 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:13.545799 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42300a8-f858-4f40-87ad-81d4cce70119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:13.546621 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42300a8-f858-4f40-87ad-81d4cce70119 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:13.546970 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42300a8-f858-4f40-87ad-81d4cce70119 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:13.547444 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42300a8-f858-4f40-87ad-81d4cce70119 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:13.559331 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42300a8-f858-4f40-87ad-81d4cce70119 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:13.564913 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-c42300a8-f858-4f40-87ad-81d4cce70119 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:07:13.564913 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:13.564913 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:13.564913 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:13.564913 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:13.564913 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:13.564913 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:13.564913 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:13.564913 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:13.564913 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:13.564913 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:13.564913 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:13.564913 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:13.564913 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:13.564913 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:13.564913 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:13.566090 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:13.566090 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:13.566090 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:13.566090 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:13.566090 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:13.566090 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:13.566090 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:13.566090 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:13.566090 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:13.566090 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:13.566090 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:13.566090 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:13.566090 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:13.566090 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:13.566090 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:13.566090 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:13.567080 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:13.567080 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:13.567080 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:13.567080 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:13.567080 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:13.567080 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:13.567080 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:13.567080 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:13.567080 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:13.567080 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:13.567080 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:07:13.567080 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:13.572364 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 137/261] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Aug 5 02:07:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:13.577386 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42300a8-f858-4f40-87ad-81d4cce70119 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:13.624180 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867f857-521f-4d4c-8cd8-aaa50bb80ca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:13.624843 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867f857-521f-4d4c-8cd8-aaa50bb80ca3 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:13.625174 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867f857-521f-4d4c-8cd8-aaa50bb80ca3 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:13.625449 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8867f857-521f-4d4c-8cd8-aaa50bb80ca3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:13.740375 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8867f857-521f-4d4c-8cd8-aaa50bb80ca3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:13.742724 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8867f857-521f-4d4c-8cd8-aaa50bb80ca3 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:13.777480 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42300a8-f858-4f40-87ad-81d4cce70119 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:13.815631 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a151a71-3884-414b-8c14-fc96279a9571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:13.816488 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a151a71-3884-414b-8c14-fc96279a9571 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:13.816774 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a151a71-3884-414b-8c14-fc96279a9571 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:13.817046 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a151a71-3884-414b-8c14-fc96279a9571 None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:13.817759 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a151a71-3884-414b-8c14-fc96279a9571 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:13.818058 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a151a71-3884-414b-8c14-fc96279a9571 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:13.819433 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a151a71-3884-414b-8c14-fc96279a9571 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:13.831473 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 138/262] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:07:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:13.843004 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a151a71-3884-414b-8c14-fc96279a9571 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:13.890397 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:13.933824 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:13.952663 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 125/263] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:07:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 644 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:07:13.956257 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a151a71-3884-414b-8c14-fc96279a9571 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:13.963402 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867f857-521f-4d4c-8cd8-aaa50bb80ca3 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:14.004869 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e66a2-b3ca-45c3-8539-636fba7f1aa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:14.005944 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e66a2-b3ca-45c3-8539-636fba7f1aa4 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:14.006238 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e66a2-b3ca-45c3-8539-636fba7f1aa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:14.006514 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1e66a2-b3ca-45c3-8539-636fba7f1aa4 None admin] PATH_INFO: `/v3/users/513f8c5508794dee99ec79dd7ad7819f` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:14.007695 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e66a2-b3ca-45c3-8539-636fba7f1aa4 None admin] RBAC: Authorizing `identity:get_user(user_id=513f8c5508794dee99ec79dd7ad7819f)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:14.009297 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1e66a2-b3ca-45c3-8539-636fba7f1aa4 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:14.011390 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 139/264] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:07:13 2022] GET /identity/v3/users/513f8c5508794dee99ec79dd7ad7819f => generated 283 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:14.017224 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e66a2-b3ca-45c3-8539-636fba7f1aa4 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:14.176164 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1e66a2-b3ca-45c3-8539-636fba7f1aa4 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:14.192297 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8867f857-521f-4d4c-8cd8-aaa50bb80ca3 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:14.196110 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:14.259119 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e9217-5705-4050-83d4-feaea1baf78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:14.259799 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e9217-5705-4050-83d4-feaea1baf78a None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:14.260084 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e9217-5705-4050-83d4-feaea1baf78a None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:14.260402 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61e9217-5705-4050-83d4-feaea1baf78a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:14.273941 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00b320-0d01-46b0-95e7-c4f03313ff6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:14.274937 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00b320-0d01-46b0-95e7-c4f03313ff6e None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:14.275957 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00b320-0d01-46b0-95e7-c4f03313ff6e None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:14.276511 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff00b320-0d01-46b0-95e7-c4f03313ff6e None admin] PATH_INFO: `/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:14.281056 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00b320-0d01-46b0-95e7-c4f03313ff6e None admin] RBAC: Authorizing `identity:get_project(project_id=4c39c7e842b54d0f8d9c70bc00f480ce)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:14.282772 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff00b320-0d01-46b0-95e7-c4f03313ff6e None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:14.285004 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 126/265] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:07:13 2022] GET /identity/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce => generated 302 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:07:14.290861 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00b320-0d01-46b0-95e7-c4f03313ff6e None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:14.407404 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:14.412672 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e9217-5705-4050-83d4-feaea1baf78a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:14.414156 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61e9217-5705-4050-83d4-feaea1baf78a None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:14.462052 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff00b320-0d01-46b0-95e7-c4f03313ff6e None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:14.519648 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a14a0-85bd-49d4-a17b-434619f87cf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:14.520291 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a14a0-85bd-49d4-a17b-434619f87cf4 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:14.520600 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a14a0-85bd-49d4-a17b-434619f87cf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:14.520865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a14a0-85bd-49d4-a17b-434619f87cf4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:14.522057 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a14a0-85bd-49d4-a17b-434619f87cf4 None admin] RBAC: Adding query filter params (role.id=e1b75d5eea2a43b2b1b14cf0515350fa, scope.project.id=4c39c7e842b54d0f8d9c70bc00f480ce, user.id=513f8c5508794dee99ec79dd7ad7819f) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:14.522367 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a14a0-85bd-49d4-a17b-434619f87cf4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:14.523943 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a14a0-85bd-49d4-a17b-434619f87cf4 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:14.531078 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 127/266] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:07:14 2022] GET /identity/v3/role_assignments?user.id=513f8c5508794dee99ec79dd7ad7819f&scope.project.id=4c39c7e842b54d0f8d9c70bc00f480ce&role.id=e1b75d5eea2a43b2b1b14cf0515350fa => generated 608 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:14.636843 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 140/267] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:07:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 620 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:07:14.642266 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a14a0-85bd-49d4-a17b-434619f87cf4 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:14.778942 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a14a0-85bd-49d4-a17b-434619f87cf4 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:14.802388 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:14.815111 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7fb5a0-8b3d-4c07-bbd9-9ff1a2f09a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:14.815760 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7fb5a0-8b3d-4c07-bbd9-9ff1a2f09a95 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:14.816489 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7fb5a0-8b3d-4c07-bbd9-9ff1a2f09a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:14.816762 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7fb5a0-8b3d-4c07-bbd9-9ff1a2f09a95 None admin] PATH_INFO: `/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:14.817927 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7fb5a0-8b3d-4c07-bbd9-9ff1a2f09a95 None admin] RBAC: Authorizing `identity:get_project(project_id=4c39c7e842b54d0f8d9c70bc00f480ce)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:14.819355 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7fb5a0-8b3d-4c07-bbd9-9ff1a2f09a95 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:14.821051 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 128/268] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:07:14 2022] GET /identity/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce => generated 302 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:14.827219 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e9217-5705-4050-83d4-feaea1baf78a None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:14.840407 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:14.933653 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61e9217-5705-4050-83d4-feaea1baf78a None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:14.976064 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0ae423-1ef1-43bf-9e51-2f981190183a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:14.976746 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ae423-1ef1-43bf-9e51-2f981190183a None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:14.977022 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ae423-1ef1-43bf-9e51-2f981190183a None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:14.977292 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0ae423-1ef1-43bf-9e51-2f981190183a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:14.978088 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ae423-1ef1-43bf-9e51-2f981190183a None admin] RBAC: Adding query filter params (role.id=5c52e382f2bc436d95d82f2a2fae8ace, scope.project.id=4c39c7e842b54d0f8d9c70bc00f480ce, user.id=513f8c5508794dee99ec79dd7ad7819f) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:14.978458 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ae423-1ef1-43bf-9e51-2f981190183a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:14.980660 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0ae423-1ef1-43bf-9e51-2f981190183a None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:14.987474 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 141/269] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:07:14 2022] GET /identity/v3/role_assignments?user.id=513f8c5508794dee99ec79dd7ad7819f&scope.project.id=4c39c7e842b54d0f8d9c70bc00f480ce&role.id=5c52e382f2bc436d95d82f2a2fae8ace => generated 608 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:15.390266 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da6c40-a408-4afe-858f-cb73e506500c None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:15.390783 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da6c40-a408-4afe-858f-cb73e506500c None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:15.390858 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6da6c40-a408-4afe-858f-cb73e506500c None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:15.392435 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 129/270] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:15.397595 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47fef6-4369-4219-abac-0b55c1e618a8 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:15.397989 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47fef6-4369-4219-abac-0b55c1e618a8 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:15.398168 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c47fef6-4369-4219-abac-0b55c1e618a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:15.418233 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-4c47fef6-4369-4219-abac-0b55c1e618a8 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:15.419425 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-4c47fef6-4369-4219-abac-0b55c1e618a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:15.479087 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c78f6-f1f2-4755-9d14-0d5be450f025 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:15.479392 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c78f6-f1f2-4755-9d14-0d5be450f025 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:15.479642 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f86c78f6-f1f2-4755-9d14-0d5be450f025 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:15.481224 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 130/271] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:15.496906 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d89887-fb79-4c97-b9a9-0ccfc444655b None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:15.497179 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 142/272] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:07:15.497616 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d89887-fb79-4c97-b9a9-0ccfc444655b None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:15.498060 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7d89887-fb79-4c97-b9a9-0ccfc444655b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:15.523177 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-d7d89887-fb79-4c97-b9a9-0ccfc444655b None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:15.524447 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-d7d89887-fb79-4c97-b9a9-0ccfc444655b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:15.526385 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47fef6-4369-4219-abac-0b55c1e618a8 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:15.529700 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:15.608284 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 131/273] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:07:15.609883 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a704a8b-2148-42d7-91ca-7119e1ac124f None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:15.610175 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a704a8b-2148-42d7-91ca-7119e1ac124f None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:15.610449 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a704a8b-2148-42d7-91ca-7119e1ac124f None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:15.611722 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 132/274] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:15.617136 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc6e66-d879-4a52-af22-e0005615ac1d None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:15.617426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc6e66-d879-4a52-af22-e0005615ac1d None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:15.617706 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc6e66-d879-4a52-af22-e0005615ac1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:15.640705 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-67cc6e66-d879-4a52-af22-e0005615ac1d None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:15.641837 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-67cc6e66-d879-4a52-af22-e0005615ac1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:15.647923 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c47fef6-4369-4219-abac-0b55c1e618a8 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:15.685774 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2119b228-8b11-4276-b43f-04c8807f3910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:15.686418 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119b228-8b11-4276-b43f-04c8807f3910 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:15.686693 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119b228-8b11-4276-b43f-04c8807f3910 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:15.686965 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2119b228-8b11-4276-b43f-04c8807f3910 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:15.698026 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2119b228-8b11-4276-b43f-04c8807f3910 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:15.703189 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-2119b228-8b11-4276-b43f-04c8807f3910 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:07:15.703189 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:15.703189 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:15.703189 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:15.703189 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:15.703189 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:15.703189 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:15.703189 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:15.703189 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:15.703189 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:15.703189 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:15.703189 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:15.703189 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:15.703189 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:15.703189 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:15.703189 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:15.704074 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:15.704074 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:15.704074 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:15.704074 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:15.704074 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:15.704074 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:15.704074 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:15.704074 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:15.704074 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:15.704074 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:15.704074 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:15.704074 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:15.704074 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:15.704074 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:15.704074 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:15.704074 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:15.704892 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:15.704892 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:15.704892 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:15.704892 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:15.704892 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:15.704892 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:15.704892 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:15.704892 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:15.704892 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:15.704892 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:15.704892 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:07:15.704892 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:15.704892 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 143/275] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:07:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:07:15.705616 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2119b228-8b11-4276-b43f-04c8807f3910 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:15.721011 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 133/276] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:07:15.722652 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc6e66-d879-4a52-af22-e0005615ac1d None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:15.773854 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:15.786339 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:15.813981 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2119b228-8b11-4276-b43f-04c8807f3910 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:15.847124 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc6e66-d879-4a52-af22-e0005615ac1d None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:15.854632 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385cb52-9cd3-4de8-b979-970a94038d62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:15.855268 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385cb52-9cd3-4de8-b979-970a94038d62 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:15.855548 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385cb52-9cd3-4de8-b979-970a94038d62 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:15.855824 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9385cb52-9cd3-4de8-b979-970a94038d62 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:15.857011 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9385cb52-9cd3-4de8-b979-970a94038d62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:15.858455 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9385cb52-9cd3-4de8-b979-970a94038d62 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:15.864695 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 144/277] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:07:15 2022] GET /identity/v3/domains/default => generated 199 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:15.864695 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385cb52-9cd3-4de8-b979-970a94038d62 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:15.891860 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f9c56-14d3-4935-9f27-99552e177f5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:15.892732 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f9c56-14d3-4935-9f27-99552e177f5d None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:15.893019 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f9c56-14d3-4935-9f27-99552e177f5d None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:15.893281 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4f9c56-14d3-4935-9f27-99552e177f5d None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:15.894034 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f9c56-14d3-4935-9f27-99552e177f5d None admin] RBAC: Adding query filter params (name=member) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:15.894339 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f9c56-14d3-4935-9f27-99552e177f5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:15.895750 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4f9c56-14d3-4935-9f27-99552e177f5d None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:15.904218 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 134/278] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Aug 5 02:07:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:15.905034 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f9c56-14d3-4935-9f27-99552e177f5d None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:15.972430 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9385cb52-9cd3-4de8-b979-970a94038d62 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:16.005709 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:16.011240 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86046d69-cd5c-42ff-a2ed-ff70c059aa52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:16.011872 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86046d69-cd5c-42ff-a2ed-ff70c059aa52 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:16.012148 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86046d69-cd5c-42ff-a2ed-ff70c059aa52 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:16.012442 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86046d69-cd5c-42ff-a2ed-ff70c059aa52 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:16.022160 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4f9c56-14d3-4935-9f27-99552e177f5d None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:16.027733 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86046d69-cd5c-42ff-a2ed-ff70c059aa52 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:16.032763 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-86046d69-cd5c-42ff-a2ed-ff70c059aa52 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 02:07:16.032763 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:16.032763 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:16.032763 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:16.032763 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:16.032763 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:16.032763 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:16.032763 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:16.032763 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:16.032763 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:16.032763 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:16.032763 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:16.032763 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:16.032763 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:16.032763 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:16.032763 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:16.033664 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:16.033664 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:16.033664 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:16.033664 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:16.033664 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:16.033664 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:16.033664 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:16.033664 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:16.033664 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:16.033664 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:16.033664 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:16.033664 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:16.033664 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:16.033664 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:16.033664 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:16.033664 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:16.034482 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:16.034482 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:16.034482 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:16.034482 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:16.034482 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:16.034482 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:16.034482 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:16.034482 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:16.034482 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:16.034482 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:16.034482 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 02:07:16.034482 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:16.034482 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 145/279] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:07:15 2022] GET /identity/v3/roles/reader => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:16.035322 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86046d69-cd5c-42ff-a2ed-ff70c059aa52 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:16.035685 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:16.059937 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c07acbe9-1b49-4281-97e5-7014b7b3b8a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:16.060593 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07acbe9-1b49-4281-97e5-7014b7b3b8a3 None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:16.060869 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07acbe9-1b49-4281-97e5-7014b7b3b8a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:16.061144 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c07acbe9-1b49-4281-97e5-7014b7b3b8a3 None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:16.061817 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07acbe9-1b49-4281-97e5-7014b7b3b8a3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:16.063236 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c07acbe9-1b49-4281-97e5-7014b7b3b8a3 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:16.085419 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 135/280] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Aug 5 02:07:15 2022] POST /identity/v3/users => generated 293 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:07:16.086603 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b37c9e-ffac-41e7-856a-03d1d8efe0d6 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:16.086884 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b37c9e-ffac-41e7-856a-03d1d8efe0d6 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:16.087156 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b37c9e-ffac-41e7-856a-03d1d8efe0d6 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:16.088828 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 136/281] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:16.089586 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b37c9e-ffac-41e7-856a-03d1d8efe0d6 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:16.147955 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86046d69-cd5c-42ff-a2ed-ff70c059aa52 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:16.189843 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85beceb6-1f4f-45b3-8cff-e958ebfddd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:16.190790 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85beceb6-1f4f-45b3-8cff-e958ebfddd60 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:16.191267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85beceb6-1f4f-45b3-8cff-e958ebfddd60 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:16.191691 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85beceb6-1f4f-45b3-8cff-e958ebfddd60 None admin] PATH_INFO: `/v3/users/0b8571afcf984d46a82511581e8e116c` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:16.206628 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85beceb6-1f4f-45b3-8cff-e958ebfddd60 None admin] RBAC: Authorizing `identity:get_user(user_id=0b8571afcf984d46a82511581e8e116c)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:16.208395 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85beceb6-1f4f-45b3-8cff-e958ebfddd60 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:16.210685 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b37c9e-ffac-41e7-856a-03d1d8efe0d6 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:16.210884 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 146/282] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:07:16 2022] GET /identity/v3/users/0b8571afcf984d46a82511581e8e116c => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:16.212428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859095f9-cdc5-4bf1-9adf-48bbeb2f6553 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:16.212753 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859095f9-cdc5-4bf1-9adf-48bbeb2f6553 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:16.213035 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859095f9-cdc5-4bf1-9adf-48bbeb2f6553 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:16.232214 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-859095f9-cdc5-4bf1-9adf-48bbeb2f6553 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:16.233569 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-859095f9-cdc5-4bf1-9adf-48bbeb2f6553 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:16.255818 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2911877b-0fff-42e1-b38b-91b6b33b8d58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:16.256917 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911877b-0fff-42e1-b38b-91b6b33b8d58 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:16.257213 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911877b-0fff-42e1-b38b-91b6b33b8d58 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:16.257745 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2911877b-0fff-42e1-b38b-91b6b33b8d58 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:16.258476 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2911877b-0fff-42e1-b38b-91b6b33b8d58 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:16.258931 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2911877b-0fff-42e1-b38b-91b6b33b8d58 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:16.263104 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2911877b-0fff-42e1-b38b-91b6b33b8d58 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:16.272536 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 137/283] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Aug 5 02:07:16 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:16.273980 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2911877b-0fff-42e1-b38b-91b6b33b8d58 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:16.284640 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:16.312684 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:16.312926 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 147/284] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:07:16.320486 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859095f9-cdc5-4bf1-9adf-48bbeb2f6553 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:16.414345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2911877b-0fff-42e1-b38b-91b6b33b8d58 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:16.451425 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859095f9-cdc5-4bf1-9adf-48bbeb2f6553 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:16.461403 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc6181-60cc-4e7f-a222-4d3d43672d2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:16.463283 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc6181-60cc-4e7f-a222-4d3d43672d2a None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:16.464199 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc6181-60cc-4e7f-a222-4d3d43672d2a None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:16.464730 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fc6181-60cc-4e7f-a222-4d3d43672d2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:16.465928 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fc6181-60cc-4e7f-a222-4d3d43672d2a None admin] RBAC: Adding query filter params (role.id=33cd9c7fcf9b4bbe9d604952279e8d76, user.id=0b8571afcf984d46a82511581e8e116c, scope.system=all) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:16.466806 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fc6181-60cc-4e7f-a222-4d3d43672d2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:16.468918 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fc6181-60cc-4e7f-a222-4d3d43672d2a None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:16.476190 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 138/285] 10.222.0.15 () {56 vars in 1308 bytes} [Fri Aug 5 02:07:16 2022] GET /identity/v3/role_assignments?user.id=0b8571afcf984d46a82511581e8e116c&scope.system=all&role.id=33cd9c7fcf9b4bbe9d604952279e8d76 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:16.476846 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc6181-60cc-4e7f-a222-4d3d43672d2a None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:16.506257 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f68f5-7e75-4a14-9cf0-fc2e31546217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:16.507404 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f68f5-7e75-4a14-9cf0-fc2e31546217 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:16.507668 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f68f5-7e75-4a14-9cf0-fc2e31546217 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:16.507948 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-236f68f5-7e75-4a14-9cf0-fc2e31546217 None admin] PATH_INFO: `/v3/users/15fe2df1f0a0423d9540f483b8d7c92c` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:16.510497 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f68f5-7e75-4a14-9cf0-fc2e31546217 None admin] RBAC: Authorizing `identity:get_user(user_id=15fe2df1f0a0423d9540f483b8d7c92c)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:16.512253 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-236f68f5-7e75-4a14-9cf0-fc2e31546217 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:16.515744 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 148/286] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:07:16 2022] GET /identity/v3/users/15fe2df1f0a0423d9540f483b8d7c92c => generated 297 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:16.522253 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f68f5-7e75-4a14-9cf0-fc2e31546217 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:16.623399 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:16.684833 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:16.690748 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-236f68f5-7e75-4a14-9cf0-fc2e31546217 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:16.692667 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fc6181-60cc-4e7f-a222-4d3d43672d2a None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:16.727535 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0f43a-8ca5-4f68-97bc-4d95abe24375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:16.728548 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0f43a-8ca5-4f68-97bc-4d95abe24375 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:16.729042 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0f43a-8ca5-4f68-97bc-4d95abe24375 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:16.729786 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f0f43a-8ca5-4f68-97bc-4d95abe24375 None admin] PATH_INFO: `/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:16.731581 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0f43a-8ca5-4f68-97bc-4d95abe24375 None admin] RBAC: Authorizing `identity:get_project(project_id=4c39c7e842b54d0f8d9c70bc00f480ce)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:16.733535 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f0f43a-8ca5-4f68-97bc-4d95abe24375 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:16.735719 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 149/287] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:07:16 2022] GET /identity/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:16.739092 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2d05e-e0c4-45eb-8f91-8c6b894f2ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:16.740034 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2d05e-e0c4-45eb-8f91-8c6b894f2ef0 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:16.740518 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2d05e-e0c4-45eb-8f91-8c6b894f2ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:16.740950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce2d05e-e0c4-45eb-8f91-8c6b894f2ef0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:16.741083 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0f43a-8ca5-4f68-97bc-4d95abe24375 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:16.755131 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce2d05e-e0c4-45eb-8f91-8c6b894f2ef0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:16.761723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-dce2d05e-e0c4-45eb-8f91-8c6b894f2ef0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:07:16.761723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:16.761723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:16.761723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:16.761723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:16.761723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:16.761723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:16.761723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:16.761723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:16.761723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:16.761723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:16.761723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:16.761723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:16.761723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:16.761723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:16.761723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:16.762583 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:16.762583 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:16.762583 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:16.762583 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:16.762583 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:16.762583 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:16.762583 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:16.762583 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:16.762583 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:16.762583 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:16.762583 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:16.762583 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:16.762583 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:16.762583 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:16.762583 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:16.762583 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:16.763358 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:16.763358 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:16.763358 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:16.763358 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:16.763358 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:16.763358 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:16.763358 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:16.763358 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:16.763358 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:16.763358 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:16.763358 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:07:16.763358 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:16.765996 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 139/288] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:07:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:16.773477 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2d05e-e0c4-45eb-8f91-8c6b894f2ef0 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:16.919379 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce2d05e-e0c4-45eb-8f91-8c6b894f2ef0 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:16.956402 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d3455-f526-45b6-85ed-914badba430f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:16.957050 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d3455-f526-45b6-85ed-914badba430f None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:16.957404 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d3455-f526-45b6-85ed-914badba430f None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:16.957750 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-151d3455-f526-45b6-85ed-914badba430f None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:16.958547 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151d3455-f526-45b6-85ed-914badba430f None admin] RBAC: Adding query filter params (name=member) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:16.958923 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151d3455-f526-45b6-85ed-914badba430f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:16.960409 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-151d3455-f526-45b6-85ed-914badba430f None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:16.975984 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f0f43a-8ca5-4f68-97bc-4d95abe24375 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:16.980211 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 140/289] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Aug 5 02:07:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:16.989812 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d3455-f526-45b6-85ed-914badba430f None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:17.010035 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:17.028447 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:17.040023 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d1730-b553-4e23-a1ca-15c209684a9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:17.041271 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d1730-b553-4e23-a1ca-15c209684a9f None admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:17.041562 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d1730-b553-4e23-a1ca-15c209684a9f None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:17.041836 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35d1730-b553-4e23-a1ca-15c209684a9f None admin] PATH_INFO: `/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce/users/15fe2df1f0a0423d9540f483b8d7c92c/roles/1070d90fae74403eab5e52609af8ed78` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:17.044535 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d1730-b553-4e23-a1ca-15c209684a9f None admin] RBAC: Authorizing `identity:create_grant(project_id=4c39c7e842b54d0f8d9c70bc00f480ce, user_id=15fe2df1f0a0423d9540f483b8d7c92c, role_id=1070d90fae74403eab5e52609af8ed78)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:17.046012 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35d1730-b553-4e23-a1ca-15c209684a9f None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:17.069870 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 150/290] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Aug 5 02:07:16 2022] PUT /identity/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce/users/15fe2df1f0a0423d9540f483b8d7c92c/roles/1070d90fae74403eab5e52609af8ed78 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:07:17.163434 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-151d3455-f526-45b6-85ed-914badba430f None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:17.214597 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13917271-ad6b-4f81-8c89-d833f1189242 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:17.215173 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13917271-ad6b-4f81-8c89-d833f1189242 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:17.215455 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13917271-ad6b-4f81-8c89-d833f1189242 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:17.215729 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13917271-ad6b-4f81-8c89-d833f1189242 None admin] PATH_INFO: `/v3/users/a3ca4980677b477d8a88b905313ee4b6` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:17.220397 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13917271-ad6b-4f81-8c89-d833f1189242 None admin] RBAC: Authorizing `identity:get_user(user_id=a3ca4980677b477d8a88b905313ee4b6)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:17.221896 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13917271-ad6b-4f81-8c89-d833f1189242 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:17.224148 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 141/291] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:07:16 2022] GET /identity/v3/users/a3ca4980677b477d8a88b905313ee4b6 => generated 297 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:07:17.230000 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d1730-b553-4e23-a1ca-15c209684a9f None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:17.371378 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35d1730-b553-4e23-a1ca-15c209684a9f None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:17.411408 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a56bf5-da1e-48b9-8176-386144dd9605 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:17.412039 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a56bf5-da1e-48b9-8176-386144dd9605 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:17.412463 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a56bf5-da1e-48b9-8176-386144dd9605 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:17.412741 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a56bf5-da1e-48b9-8176-386144dd9605 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:17.464808 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:17.491483 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a56bf5-da1e-48b9-8176-386144dd9605 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:17.493166 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81a56bf5-da1e-48b9-8176-386144dd9605 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:17.631128 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 151/292] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:07:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:07:17.637466 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13917271-ad6b-4f81-8c89-d833f1189242 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:17.775730 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:17.796581 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13917271-ad6b-4f81-8c89-d833f1189242 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:17.835736 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916850f9-ffaa-480f-a2a2-d1b388d33d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:17.835736 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916850f9-ffaa-480f-a2a2-d1b388d33d75 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:17.835736 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916850f9-ffaa-480f-a2a2-d1b388d33d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:17.835736 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916850f9-ffaa-480f-a2a2-d1b388d33d75 None admin] PATH_INFO: `/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:17.836000 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916850f9-ffaa-480f-a2a2-d1b388d33d75 None admin] RBAC: Authorizing `identity:get_project(project_id=4c39c7e842b54d0f8d9c70bc00f480ce)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:17.836514 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916850f9-ffaa-480f-a2a2-d1b388d33d75 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:17.839498 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 142/293] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:07:17 2022] GET /identity/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce => generated 302 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:17.846677 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a56bf5-da1e-48b9-8176-386144dd9605 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:17.970598 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:18.003130 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a56bf5-da1e-48b9-8176-386144dd9605 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:18.056574 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49108dea-9693-4dc0-ae37-2f05264d5643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:18.057351 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49108dea-9693-4dc0-ae37-2f05264d5643 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:18.057646 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49108dea-9693-4dc0-ae37-2f05264d5643 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:18.057921 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49108dea-9693-4dc0-ae37-2f05264d5643 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:18.058713 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49108dea-9693-4dc0-ae37-2f05264d5643 None admin] RBAC: Adding query filter params (role.id=33cd9c7fcf9b4bbe9d604952279e8d76, scope.project.id=4c39c7e842b54d0f8d9c70bc00f480ce, user.id=a3ca4980677b477d8a88b905313ee4b6) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:18.059019 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49108dea-9693-4dc0-ae37-2f05264d5643 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:18.060478 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49108dea-9693-4dc0-ae37-2f05264d5643 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:18.070872 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 152/294] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:07:17 2022] GET /identity/v3/role_assignments?user.id=a3ca4980677b477d8a88b905313ee4b6&scope.project.id=4c39c7e842b54d0f8d9c70bc00f480ce&role.id=33cd9c7fcf9b4bbe9d604952279e8d76 => generated 608 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:18.498119 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08457f93-2aa2-4b8f-88fb-81ef866a2576 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:18.498398 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08457f93-2aa2-4b8f-88fb-81ef866a2576 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:18.498716 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08457f93-2aa2-4b8f-88fb-81ef866a2576 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:18.500357 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 143/295] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:18.505694 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cae0a9-1c14-41f8-a64d-fccca239fa65 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:18.506141 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cae0a9-1c14-41f8-a64d-fccca239fa65 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:18.506311 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cae0a9-1c14-41f8-a64d-fccca239fa65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:18.528844 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-a5cae0a9-1c14-41f8-a64d-fccca239fa65 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:18.530036 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-a5cae0a9-1c14-41f8-a64d-fccca239fa65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:18.610908 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 153/296] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:07:18.635507 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08457f93-2aa2-4b8f-88fb-81ef866a2576 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:18.734200 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a3721-ae1e-464b-8c7f-9f59cc3dde95 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:18.734551 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a3721-ae1e-464b-8c7f-9f59cc3dde95 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:18.734752 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96a3721-ae1e-464b-8c7f-9f59cc3dde95 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:18.736106 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 154/297] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:07:18.741057 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d584f-ffb5-4ccf-be09-d182edd8d0eb None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:18.741339 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d584f-ffb5-4ccf-be09-d182edd8d0eb None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:18.741614 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d13d584f-ffb5-4ccf-be09-d182edd8d0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:18.751263 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08457f93-2aa2-4b8f-88fb-81ef866a2576 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:18.761444 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-d13d584f-ffb5-4ccf-be09-d182edd8d0eb None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:18.762629 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-d13d584f-ffb5-4ccf-be09-d182edd8d0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:18.797148 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6375624-ee6f-435d-bae3-de070d3b4df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:18.797796 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6375624-ee6f-435d-bae3-de070d3b4df5 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:18.798080 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6375624-ee6f-435d-bae3-de070d3b4df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:18.798625 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6375624-ee6f-435d-bae3-de070d3b4df5 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:18.813114 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6375624-ee6f-435d-bae3-de070d3b4df5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:18.818553 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-b6375624-ee6f-435d-bae3-de070d3b4df5 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 02:07:18.818553 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:18.818553 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:18.818553 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:18.818553 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:18.818553 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:18.818553 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:18.818553 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:18.818553 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:18.818553 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:18.818553 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:18.818553 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:18.818553 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:18.818553 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:18.818553 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:18.818553 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:18.819431 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:18.819431 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:18.819431 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:18.819431 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:18.819431 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:18.819431 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:18.819431 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:18.819431 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:18.819431 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:18.819431 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:18.819431 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:18.819431 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:18.819431 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:18.819431 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:18.819431 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:18.819431 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:18.820219 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:18.820219 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:18.820219 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:18.820219 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:18.820219 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:18.820219 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:18.820219 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:18.820219 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:18.820219 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:18.820219 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:18.820219 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 02:07:18.820219 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:18.820219 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 144/298] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:07:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:18.826332 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6375624-ee6f-435d-bae3-de070d3b4df5 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:18.833725 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:18.842145 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 155/299] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:07:18.842970 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:18.864409 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d584f-ffb5-4ccf-be09-d182edd8d0eb None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:18.951360 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6375624-ee6f-435d-bae3-de070d3b4df5 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:18.991694 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b927763-2ead-440b-a70d-e81bf8415a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:18.992146 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d13d584f-ffb5-4ccf-be09-d182edd8d0eb None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:18.992936 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b927763-2ead-440b-a70d-e81bf8415a4a None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:18.993435 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b927763-2ead-440b-a70d-e81bf8415a4a None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:18.994193 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b927763-2ead-440b-a70d-e81bf8415a4a None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:18.995198 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b927763-2ead-440b-a70d-e81bf8415a4a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:18.995601 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b927763-2ead-440b-a70d-e81bf8415a4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:18.997023 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b927763-2ead-440b-a70d-e81bf8415a4a None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:19.007128 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 145/300] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Aug 5 02:07:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:19.008248 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc87dac-4c9a-42eb-8977-dbcd6c698699 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:19.008584 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc87dac-4c9a-42eb-8977-dbcd6c698699 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:19.008859 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc87dac-4c9a-42eb-8977-dbcd6c698699 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:19.010746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 146/301] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:19.015739 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677bd95f-a7c2-40d0-9b7a-700e7924a205 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:19.016027 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677bd95f-a7c2-40d0-9b7a-700e7924a205 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:19.016307 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-677bd95f-a7c2-40d0-9b7a-700e7924a205 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:19.035434 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-677bd95f-a7c2-40d0-9b7a-700e7924a205 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:19.036642 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-677bd95f-a7c2-40d0-9b7a-700e7924a205 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:19.037648 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af757f6-c046-4be4-80fa-05d10bb85f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:19.038289 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af757f6-c046-4be4-80fa-05d10bb85f65 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:19.038728 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af757f6-c046-4be4-80fa-05d10bb85f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:19.039008 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af757f6-c046-4be4-80fa-05d10bb85f65 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:19.041069 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af757f6-c046-4be4-80fa-05d10bb85f65 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:19.042501 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0af757f6-c046-4be4-80fa-05d10bb85f65 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:19.048249 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 156/302] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:07:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:19.049240 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af757f6-c046-4be4-80fa-05d10bb85f65 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:19.113332 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 147/303] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:07:19.119866 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:19.125235 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677bd95f-a7c2-40d0-9b7a-700e7924a205 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:19.128704 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:19.159428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af757f6-c046-4be4-80fa-05d10bb85f65 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:19.200856 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81db5f2-49dc-4828-a09b-b36b61b8e937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:19.201788 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81db5f2-49dc-4828-a09b-b36b61b8e937 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:19.202236 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81db5f2-49dc-4828-a09b-b36b61b8e937 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:19.202715 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81db5f2-49dc-4828-a09b-b36b61b8e937 None admin] PATH_INFO: `/v3/users/f20856e61ef1431583a1bbcc65aa8d18` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:19.217944 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81db5f2-49dc-4828-a09b-b36b61b8e937 None admin] RBAC: Authorizing `identity:get_user(user_id=f20856e61ef1431583a1bbcc65aa8d18)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:19.219652 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d81db5f2-49dc-4828-a09b-b36b61b8e937 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:19.221357 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 157/304] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:07:19 2022] GET /identity/v3/users/f20856e61ef1431583a1bbcc65aa8d18 => generated 293 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:19.222124 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81db5f2-49dc-4828-a09b-b36b61b8e937 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:19.243388 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-677bd95f-a7c2-40d0-9b7a-700e7924a205 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:19.280525 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4a66d-d685-4b89-8e4c-c1005cc35729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:19.281575 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4a66d-d685-4b89-8e4c-c1005cc35729 None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:19.281858 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4a66d-d685-4b89-8e4c-c1005cc35729 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:19.282280 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd4a66d-d685-4b89-8e4c-c1005cc35729 None admin] PATH_INFO: `/v3/groups` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:19.282948 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd4a66d-d685-4b89-8e4c-c1005cc35729 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:19.284604 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd4a66d-d685-4b89-8e4c-c1005cc35729 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:19.300234 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 148/305] 10.222.0.15 () {60 vars in 1134 bytes} [Fri Aug 5 02:07:19 2022] POST /identity/v3/groups => generated 229 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:07:19.305531 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4a66d-d685-4b89-8e4c-c1005cc35729 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:19.339102 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81db5f2-49dc-4828-a09b-b36b61b8e937 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:19.373041 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:19.385147 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ba7db-2a1e-4e94-84f9-f2728145a94c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:19.386037 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ba7db-2a1e-4e94-84f9-f2728145a94c None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:19.386411 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ba7db-2a1e-4e94-84f9-f2728145a94c None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:19.386928 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1ba7db-2a1e-4e94-84f9-f2728145a94c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:19.399365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d1ba7db-2a1e-4e94-84f9-f2728145a94c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:19.405384 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-3d1ba7db-2a1e-4e94-84f9-f2728145a94c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:07:19.405384 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:19.405384 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:19.405384 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:19.405384 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:19.405384 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:19.405384 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:19.405384 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:19.405384 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:19.405384 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:19.405384 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:19.405384 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:19.405384 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:19.405384 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:19.405384 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:19.405384 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:19.406529 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:19.406529 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:19.406529 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:19.406529 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:19.406529 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:19.406529 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:19.406529 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:19.406529 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:19.406529 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:19.406529 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:19.406529 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:19.406529 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:19.406529 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:19.406529 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:19.406529 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:19.406529 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:19.407521 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:19.407521 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:19.407521 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:19.407521 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:19.407521 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:19.407521 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:19.407521 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:19.407521 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:19.407521 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:19.407521 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:19.407521 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:07:19.407521 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:19.411767 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:19.413050 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 158/306] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:07:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:19.415791 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ba7db-2a1e-4e94-84f9-f2728145a94c None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:19.479714 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd4a66d-d685-4b89-8e4c-c1005cc35729 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:19.524801 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c153b25-efd6-40ce-8bc1-ba12dd69f624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:19.525517 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c153b25-efd6-40ce-8bc1-ba12dd69f624 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:19.526003 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c153b25-efd6-40ce-8bc1-ba12dd69f624 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:19.526285 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c153b25-efd6-40ce-8bc1-ba12dd69f624 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:19.527085 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c153b25-efd6-40ce-8bc1-ba12dd69f624 None admin] RBAC: Adding query filter params (role.id=1070d90fae74403eab5e52609af8ed78, user.id=f20856e61ef1431583a1bbcc65aa8d18, scope.system=all) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:19.527397 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c153b25-efd6-40ce-8bc1-ba12dd69f624 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:19.528936 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c153b25-efd6-40ce-8bc1-ba12dd69f624 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:19.534805 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 149/307] 10.222.0.15 () {56 vars in 1308 bytes} [Fri Aug 5 02:07:19 2022] GET /identity/v3/role_assignments?user.id=f20856e61ef1431583a1bbcc65aa8d18&scope.system=all&role.id=1070d90fae74403eab5e52609af8ed78 => generated 226 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:19.548486 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1ba7db-2a1e-4e94-84f9-f2728145a94c None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:19.565103 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b22420-b951-4ec8-b5ba-0909d8ad6dea None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:19.565383 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b22420-b951-4ec8-b5ba-0909d8ad6dea None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:19.565656 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b22420-b951-4ec8-b5ba-0909d8ad6dea None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:19.567335 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 150/308] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:07:19.573232 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180ab72-2108-4132-8a5e-56406db98aa6 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:19.573516 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180ab72-2108-4132-8a5e-56406db98aa6 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:19.573794 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5180ab72-2108-4132-8a5e-56406db98aa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:19.588360 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6701454e-dc60-4009-b6a1-e74721f507e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:19.589092 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701454e-dc60-4009-b6a1-e74721f507e3 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:19.589371 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701454e-dc60-4009-b6a1-e74721f507e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:19.589641 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6701454e-dc60-4009-b6a1-e74721f507e3 None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:19.590379 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6701454e-dc60-4009-b6a1-e74721f507e3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:19.590687 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6701454e-dc60-4009-b6a1-e74721f507e3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:19.592125 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6701454e-dc60-4009-b6a1-e74721f507e3 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:19.594465 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-5180ab72-2108-4132-8a5e-56406db98aa6 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:19.596318 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-5180ab72-2108-4132-8a5e-56406db98aa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:19.602580 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 159/309] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Aug 5 02:07:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:19.609216 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6701454e-dc60-4009-b6a1-e74721f507e3 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:19.675807 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:19.688451 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 151/310] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:07:19.709522 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180ab72-2108-4132-8a5e-56406db98aa6 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:19.748508 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6701454e-dc60-4009-b6a1-e74721f507e3 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:19.777019 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:19.804846 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61879280-952a-40ee-bfa4-03bf5656be63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:19.805983 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61879280-952a-40ee-bfa4-03bf5656be63 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:19.807249 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61879280-952a-40ee-bfa4-03bf5656be63 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:19.807924 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61879280-952a-40ee-bfa4-03bf5656be63 None admin] PATH_INFO: `/v3/users/0b8571afcf984d46a82511581e8e116c` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:19.809719 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61879280-952a-40ee-bfa4-03bf5656be63 None admin] RBAC: Authorizing `identity:get_user(user_id=0b8571afcf984d46a82511581e8e116c)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:19.811318 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61879280-952a-40ee-bfa4-03bf5656be63 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:19.818748 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 160/311] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:07:19 2022] GET /identity/v3/users/0b8571afcf984d46a82511581e8e116c => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:19.820245 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61879280-952a-40ee-bfa4-03bf5656be63 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:19.842192 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5180ab72-2108-4132-8a5e-56406db98aa6 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:19.879839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118ec50-7e16-4d34-a8e8-77cd855287ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:19.881485 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118ec50-7e16-4d34-a8e8-77cd855287ed None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:19.881842 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118ec50-7e16-4d34-a8e8-77cd855287ed None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:19.882121 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7118ec50-7e16-4d34-a8e8-77cd855287ed None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:19.893282 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7118ec50-7e16-4d34-a8e8-77cd855287ed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:19.898523 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-7118ec50-7e16-4d34-a8e8-77cd855287ed None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 02:07:19.898523 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:19.898523 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:19.898523 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:19.898523 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:19.898523 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:19.898523 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:19.898523 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:19.898523 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:19.898523 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:19.898523 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:19.898523 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:19.898523 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:19.898523 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:19.898523 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:19.898523 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:19.899392 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:19.899392 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:19.899392 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:19.899392 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:19.899392 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:19.899392 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:19.899392 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:19.899392 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:19.899392 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:19.899392 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:19.899392 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:19.899392 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:19.899392 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:19.899392 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:19.899392 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:19.899392 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:19.900248 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:19.900248 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:19.900248 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:19.900248 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:19.900248 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:19.900248 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:19.900248 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:19.900248 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:19.900248 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:19.900248 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:19.900248 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 02:07:19.900248 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:19.904804 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 152/312] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:07:19 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:07:19.906196 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118ec50-7e16-4d34-a8e8-77cd855287ed None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:19.948415 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61879280-952a-40ee-bfa4-03bf5656be63 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:19.966648 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:19.987731 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6628ef4-c59d-468c-b60c-816f130ec0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:19.989019 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6628ef4-c59d-468c-b60c-816f130ec0c5 None admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:19.989520 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6628ef4-c59d-468c-b60c-816f130ec0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:19.989986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6628ef4-c59d-468c-b60c-816f130ec0c5 None admin] PATH_INFO: `/v3/system/users/0b8571afcf984d46a82511581e8e116c/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:19.991755 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6628ef4-c59d-468c-b60c-816f130ec0c5 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=0b8571afcf984d46a82511581e8e116c, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:19.993469 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6628ef4-c59d-468c-b60c-816f130ec0c5 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:20.012618 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 161/313] 10.222.0.15 () {58 vars in 1334 bytes} [Fri Aug 5 02:07:19 2022] PUT /identity/v3/system/users/0b8571afcf984d46a82511581e8e116c/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:07:20.022658 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7118ec50-7e16-4d34-a8e8-77cd855287ed None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:20.044944 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:20.065973 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555a5e01-3385-47c2-84c4-0ad84429cbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:20.066530 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a5e01-3385-47c2-84c4-0ad84429cbfc None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:20.066814 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a5e01-3385-47c2-84c4-0ad84429cbfc None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:20.067143 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555a5e01-3385-47c2-84c4-0ad84429cbfc None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:20.067894 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555a5e01-3385-47c2-84c4-0ad84429cbfc None admin] RBAC: Adding query filter params (name=reader) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:20.068205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555a5e01-3385-47c2-84c4-0ad84429cbfc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:20.069928 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555a5e01-3385-47c2-84c4-0ad84429cbfc None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:20.080003 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 153/314] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Aug 5 02:07:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:20.085961 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6628ef4-c59d-468c-b60c-816f130ec0c5 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:20.197984 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6628ef4-c59d-468c-b60c-816f130ec0c5 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:20.233678 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d947d3f3-591f-4657-95f7-8382570ca239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:20.234327 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947d3f3-591f-4657-95f7-8382570ca239 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:20.234607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947d3f3-591f-4657-95f7-8382570ca239 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:20.234882 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d947d3f3-591f-4657-95f7-8382570ca239 None admin] PATH_INFO: `/v3/users/15fe2df1f0a0423d9540f483b8d7c92c` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:20.236053 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d947d3f3-591f-4657-95f7-8382570ca239 None admin] RBAC: Authorizing `identity:get_user(user_id=15fe2df1f0a0423d9540f483b8d7c92c)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:20.237522 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d947d3f3-591f-4657-95f7-8382570ca239 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:20.239510 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 162/315] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:07:20 2022] GET /identity/v3/users/15fe2df1f0a0423d9540f483b8d7c92c => generated 297 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:20.246510 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555a5e01-3385-47c2-84c4-0ad84429cbfc None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:20.351099 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555a5e01-3385-47c2-84c4-0ad84429cbfc None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:20.386403 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b924cc-210d-4bc9-a5e6-17598d9ef00b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:20.387022 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b924cc-210d-4bc9-a5e6-17598d9ef00b None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:20.387300 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b924cc-210d-4bc9-a5e6-17598d9ef00b None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:20.387569 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b924cc-210d-4bc9-a5e6-17598d9ef00b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:20.436967 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:20.456643 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b924cc-210d-4bc9-a5e6-17598d9ef00b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:20.458104 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b924cc-210d-4bc9-a5e6-17598d9ef00b None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:20.561650 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 154/316] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:07:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 05 02:07:20.567205 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d947d3f3-591f-4657-95f7-8382570ca239 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:20.620961 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:20.678940 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d947d3f3-591f-4657-95f7-8382570ca239 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:20.714061 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e23ea4-bb7b-42ee-953f-9206cb33f20c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:20.714711 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e23ea4-bb7b-42ee-953f-9206cb33f20c None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:20.714995 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e23ea4-bb7b-42ee-953f-9206cb33f20c None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:20.715274 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e23ea4-bb7b-42ee-953f-9206cb33f20c None admin] PATH_INFO: `/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:20.716472 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e23ea4-bb7b-42ee-953f-9206cb33f20c None admin] RBAC: Authorizing `identity:get_project(project_id=4c39c7e842b54d0f8d9c70bc00f480ce)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:20.717926 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e23ea4-bb7b-42ee-953f-9206cb33f20c None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:20.719956 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 163/317] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:07:20 2022] GET /identity/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:20.725962 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b924cc-210d-4bc9-a5e6-17598d9ef00b None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:20.811726 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:20.835672 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b924cc-210d-4bc9-a5e6-17598d9ef00b None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:20.866540 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f69e4307-6154-4ae4-8e1a-7cc40eaf8cb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:20.867163 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e4307-6154-4ae4-8e1a-7cc40eaf8cb2 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:20.867449 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e4307-6154-4ae4-8e1a-7cc40eaf8cb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:20.867728 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f69e4307-6154-4ae4-8e1a-7cc40eaf8cb2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:20.869061 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e4307-6154-4ae4-8e1a-7cc40eaf8cb2 None admin] RBAC: Adding query filter params (role.id=1070d90fae74403eab5e52609af8ed78, scope.project.id=4c39c7e842b54d0f8d9c70bc00f480ce, user.id=15fe2df1f0a0423d9540f483b8d7c92c) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:20.869633 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e4307-6154-4ae4-8e1a-7cc40eaf8cb2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:20.871124 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f69e4307-6154-4ae4-8e1a-7cc40eaf8cb2 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:20.877209 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 155/318] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:07:20 2022] GET /identity/v3/role_assignments?user.id=15fe2df1f0a0423d9540f483b8d7c92c&scope.project.id=4c39c7e842b54d0f8d9c70bc00f480ce&role.id=1070d90fae74403eab5e52609af8ed78 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:21.433462 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc4ce9-368e-4d0b-b44b-0ca0369db1a5 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:21.433838 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc4ce9-368e-4d0b-b44b-0ca0369db1a5 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:21.434030 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57fc4ce9-368e-4d0b-b44b-0ca0369db1a5 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:21.435404 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 164/319] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:21.440366 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6839aa-0577-47b8-af2c-a599191126e7 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:21.440651 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6839aa-0577-47b8-af2c-a599191126e7 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:21.440921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6839aa-0577-47b8-af2c-a599191126e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:21.459029 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-5c6839aa-0577-47b8-af2c-a599191126e7 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:21.460205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-5c6839aa-0577-47b8-af2c-a599191126e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:21.526575 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 156/320] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:07:21.548561 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fc4ce9-368e-4d0b-b44b-0ca0369db1a5 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:21.648073 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57fc4ce9-368e-4d0b-b44b-0ca0369db1a5 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:21.664707 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:21.684259 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e0f14-2754-412f-9a54-0c434fe9f533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:21.684848 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e0f14-2754-412f-9a54-0c434fe9f533 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:21.685127 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e0f14-2754-412f-9a54-0c434fe9f533 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:21.685399 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4e0f14-2754-412f-9a54-0c434fe9f533 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:21.686521 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4e0f14-2754-412f-9a54-0c434fe9f533 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:21.687941 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4e0f14-2754-412f-9a54-0c434fe9f533 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:21.693948 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 165/321] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:07:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:21.694073 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adbe14a-8050-46a0-bfdf-ead77c891098 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:21.694073 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adbe14a-8050-46a0-bfdf-ead77c891098 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:21.694073 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6adbe14a-8050-46a0-bfdf-ead77c891098 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:21.694073 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 157/322] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:07:21.697398 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e0f14-2754-412f-9a54-0c434fe9f533 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:21.697931 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9636f39-1184-4c90-830b-61a7d63e467c None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:21.698213 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9636f39-1184-4c90-830b-61a7d63e467c None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:21.698508 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9636f39-1184-4c90-830b-61a7d63e467c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:21.716372 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-f9636f39-1184-4c90-830b-61a7d63e467c None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:21.717547 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-f9636f39-1184-4c90-830b-61a7d63e467c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:21.791324 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 158/323] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:07:21.806863 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4e0f14-2754-412f-9a54-0c434fe9f533 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:21.813348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9636f39-1184-4c90-830b-61a7d63e467c None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:21.817724 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:21.848905 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea6db0-cd82-4118-ad69-08f390895713 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:21.849535 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea6db0-cd82-4118-ad69-08f390895713 None admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:21.849820 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea6db0-cd82-4118-ad69-08f390895713 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:21.850098 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bea6db0-cd82-4118-ad69-08f390895713 None admin] PATH_INFO: `/v3/groups` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:21.850763 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea6db0-cd82-4118-ad69-08f390895713 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:21.852228 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bea6db0-cd82-4118-ad69-08f390895713 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:21.870098 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 166/324] 10.222.0.15 () {60 vars in 1134 bytes} [Fri Aug 5 02:07:21 2022] POST /identity/v3/groups => generated 226 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:07:21.945297 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9636f39-1184-4c90-830b-61a7d63e467c None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:21.982490 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b72a94-907a-44f6-8f8e-19e2051ba873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:21.983150 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b72a94-907a-44f6-8f8e-19e2051ba873 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:21.983432 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b72a94-907a-44f6-8f8e-19e2051ba873 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:21.983701 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b72a94-907a-44f6-8f8e-19e2051ba873 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:21.996041 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b72a94-907a-44f6-8f8e-19e2051ba873 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:22.001423 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-64b72a94-907a-44f6-8f8e-19e2051ba873 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 02:07:22.001423 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:22.001423 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:22.001423 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:22.001423 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:22.001423 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:22.001423 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:22.001423 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:22.001423 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:22.001423 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:22.001423 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:22.001423 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:22.001423 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:22.001423 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:22.001423 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:22.001423 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:22.002339 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:22.002339 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:22.002339 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:22.002339 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:22.002339 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:22.002339 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:22.002339 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:22.002339 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:22.002339 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:22.002339 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:22.002339 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:22.002339 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:22.002339 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:22.002339 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:22.002339 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:22.002339 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:22.003133 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:22.003133 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:22.003133 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:22.003133 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:22.003133 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:22.003133 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:22.003133 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:22.003133 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:22.003133 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:22.003133 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:22.003133 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 02:07:22.003133 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:22.003133 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 159/325] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:07:21 2022] GET /identity/v3/roles/reader => generated 84 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:07:22.009250 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea6db0-cd82-4118-ad69-08f390895713 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:22.062980 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:22.097390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567a26b-1a3b-43a1-a1c4-7835f45f1eca None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:22.098433 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567a26b-1a3b-43a1-a1c4-7835f45f1eca None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:22.098817 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8567a26b-1a3b-43a1-a1c4-7835f45f1eca None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:22.100416 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 160/326] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:07:22.106280 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda651a-4355-4abb-96cc-1ed4806c0375 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:22.106566 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda651a-4355-4abb-96cc-1ed4806c0375 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:22.106906 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cda651a-4355-4abb-96cc-1ed4806c0375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:22.131447 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bea6db0-cd82-4118-ad69-08f390895713 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:22.131921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-4cda651a-4355-4abb-96cc-1ed4806c0375 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:22.133297 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-4cda651a-4355-4abb-96cc-1ed4806c0375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:22.175204 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff268b3b-72a4-4a9a-b650-7d29fa992c40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:22.175838 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff268b3b-72a4-4a9a-b650-7d29fa992c40 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:22.176120 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff268b3b-72a4-4a9a-b650-7d29fa992c40 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:22.176427 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff268b3b-72a4-4a9a-b650-7d29fa992c40 None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:22.177170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff268b3b-72a4-4a9a-b650-7d29fa992c40 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:22.177480 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff268b3b-72a4-4a9a-b650-7d29fa992c40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:22.179046 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff268b3b-72a4-4a9a-b650-7d29fa992c40 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:22.190716 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 167/327] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Aug 5 02:07:22 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:22.197100 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff268b3b-72a4-4a9a-b650-7d29fa992c40 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:22.213010 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:22.232348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 161/328] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:07:22.249491 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda651a-4355-4abb-96cc-1ed4806c0375 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:22.316511 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff268b3b-72a4-4a9a-b650-7d29fa992c40 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:22.323799 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:22.357670 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382923f-4bb8-49dd-91e4-cc5052ed5f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:22.358319 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382923f-4bb8-49dd-91e4-cc5052ed5f6f None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:22.358598 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382923f-4bb8-49dd-91e4-cc5052ed5f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:22.358868 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c382923f-4bb8-49dd-91e4-cc5052ed5f6f None admin] PATH_INFO: `/v3/users/f20856e61ef1431583a1bbcc65aa8d18` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:22.360092 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c382923f-4bb8-49dd-91e4-cc5052ed5f6f None admin] RBAC: Authorizing `identity:get_user(user_id=f20856e61ef1431583a1bbcc65aa8d18)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:22.361596 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c382923f-4bb8-49dd-91e4-cc5052ed5f6f None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:22.364367 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 168/329] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:07:22 2022] GET /identity/v3/users/f20856e61ef1431583a1bbcc65aa8d18 => generated 293 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:07:22.373429 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382923f-4bb8-49dd-91e4-cc5052ed5f6f None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:22.383276 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cda651a-4355-4abb-96cc-1ed4806c0375 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:22.428812 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e4b86-bfb9-49dc-89c1-a31880ef47a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:22.429699 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e4b86-bfb9-49dc-89c1-a31880ef47a8 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:22.430140 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e4b86-bfb9-49dc-89c1-a31880ef47a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:22.430550 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587e4b86-bfb9-49dc-89c1-a31880ef47a8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:22.447754 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587e4b86-bfb9-49dc-89c1-a31880ef47a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:22.455496 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-587e4b86-bfb9-49dc-89c1-a31880ef47a8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:07:22.455496 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:22.455496 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:22.455496 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:22.455496 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:22.455496 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:22.455496 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:22.455496 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:22.455496 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:22.455496 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:22.455496 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:22.455496 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:22.455496 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:22.455496 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:22.455496 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:22.455496 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:22.456567 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:22.456567 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:22.456567 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:22.456567 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:22.456567 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:22.456567 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:22.456567 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:22.456567 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:22.456567 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:22.456567 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:22.456567 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:22.456567 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:22.456567 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:22.456567 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:22.456567 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:22.456567 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:22.457339 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:22.457339 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:22.457339 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:22.457339 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:22.457339 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:22.457339 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:22.457339 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:22.457339 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:22.457339 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:22.457339 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:22.457339 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:07:22.457339 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:22.460409 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 162/330] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:07:22 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:07:22.466241 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e4b86-bfb9-49dc-89c1-a31880ef47a8 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:22.527309 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c382923f-4bb8-49dd-91e4-cc5052ed5f6f None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:22.542956 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:22.581312 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a3178-5021-41ed-9136-5901a06200a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:22.582530 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a3178-5021-41ed-9136-5901a06200a4 None admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:22.583020 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a3178-5021-41ed-9136-5901a06200a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:22.583821 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44a3178-5021-41ed-9136-5901a06200a4 None admin] PATH_INFO: `/v3/system/users/f20856e61ef1431583a1bbcc65aa8d18/roles/1070d90fae74403eab5e52609af8ed78` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:22.585913 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a3178-5021-41ed-9136-5901a06200a4 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=f20856e61ef1431583a1bbcc65aa8d18, role_id=1070d90fae74403eab5e52609af8ed78)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:22.587807 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44a3178-5021-41ed-9136-5901a06200a4 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:22.598835 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 169/331] 10.222.0.15 () {58 vars in 1334 bytes} [Fri Aug 5 02:07:22 2022] PUT /identity/v3/system/users/f20856e61ef1431583a1bbcc65aa8d18/roles/1070d90fae74403eab5e52609af8ed78 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:07:22.616857 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587e4b86-bfb9-49dc-89c1-a31880ef47a8 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:22.662370 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc3be6b-b219-4d33-8e38-47c977c97c0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:22.663326 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3be6b-b219-4d33-8e38-47c977c97c0f None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:22.663844 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3be6b-b219-4d33-8e38-47c977c97c0f None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:22.664585 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc3be6b-b219-4d33-8e38-47c977c97c0f None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:22.666817 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc3be6b-b219-4d33-8e38-47c977c97c0f None admin] RBAC: Adding query filter params (name=member) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:22.667326 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc3be6b-b219-4d33-8e38-47c977c97c0f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:22.669090 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc3be6b-b219-4d33-8e38-47c977c97c0f None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:22.682280 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 163/332] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Aug 5 02:07:22 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:22.688127 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a3178-5021-41ed-9136-5901a06200a4 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:22.740376 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:22.818838 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44a3178-5021-41ed-9136-5901a06200a4 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:22.858617 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f0dbb1-d00a-4079-9709-7cf355c2b1a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:22.859345 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0dbb1-d00a-4079-9709-7cf355c2b1a4 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:22.859690 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0dbb1-d00a-4079-9709-7cf355c2b1a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:22.860025 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f0dbb1-d00a-4079-9709-7cf355c2b1a4 None admin] PATH_INFO: `/v3/users/0b8571afcf984d46a82511581e8e116c` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:22.861293 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f0dbb1-d00a-4079-9709-7cf355c2b1a4 None admin] RBAC: Authorizing `identity:get_user(user_id=0b8571afcf984d46a82511581e8e116c)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:22.862810 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f0dbb1-d00a-4079-9709-7cf355c2b1a4 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:22.864916 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 170/333] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:07:22 2022] GET /identity/v3/users/0b8571afcf984d46a82511581e8e116c => generated 293 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:07:22.871758 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc3be6b-b219-4d33-8e38-47c977c97c0f None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:22.990321 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc3be6b-b219-4d33-8e38-47c977c97c0f None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:23.007868 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:23.030553 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa8ca4d-764a-4446-9ca1-f32834326664 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:23.031258 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8ca4d-764a-4446-9ca1-f32834326664 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:23.031601 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8ca4d-764a-4446-9ca1-f32834326664 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:23.032000 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa8ca4d-764a-4446-9ca1-f32834326664 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:23.032885 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa8ca4d-764a-4446-9ca1-f32834326664 None admin] RBAC: Adding query filter params (role.id=33cd9c7fcf9b4bbe9d604952279e8d76, user.id=0b8571afcf984d46a82511581e8e116c, scope.system=all) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:23.033255 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa8ca4d-764a-4446-9ca1-f32834326664 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:23.034736 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa8ca4d-764a-4446-9ca1-f32834326664 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:23.052066 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 164/334] 10.222.0.15 () {56 vars in 1308 bytes} [Fri Aug 5 02:07:22 2022] GET /identity/v3/role_assignments?user.id=0b8571afcf984d46a82511581e8e116c&scope.system=all&role.id=33cd9c7fcf9b4bbe9d604952279e8d76 => generated 510 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:07:24.303837 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1aa66b-0503-4a83-a687-516420a7f8f8 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:24.304586 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1aa66b-0503-4a83-a687-516420a7f8f8 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:24.304586 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1aa66b-0503-4a83-a687-516420a7f8f8 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:24.306126 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 171/335] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:24.312819 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e408968-c2c1-4b98-a43e-bdc966c16fbf None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:24.312819 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e408968-c2c1-4b98-a43e-bdc966c16fbf None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:24.312819 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e408968-c2c1-4b98-a43e-bdc966c16fbf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:24.333220 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-6e408968-c2c1-4b98-a43e-bdc966c16fbf None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:24.334797 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-6e408968-c2c1-4b98-a43e-bdc966c16fbf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:24.414451 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 165/336] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:07:24.441313 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1aa66b-0503-4a83-a687-516420a7f8f8 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:24.488697 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f06c0-c334-4485-8db4-6dac9d515c8b None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:24.489307 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f06c0-c334-4485-8db4-6dac9d515c8b None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:24.490157 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f06c0-c334-4485-8db4-6dac9d515c8b None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:24.492628 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 166/337] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:24.504761 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b55572-4e85-4e41-ac76-1013a4bab41d None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:24.505352 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b55572-4e85-4e41-ac76-1013a4bab41d None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:24.505821 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b55572-4e85-4e41-ac76-1013a4bab41d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:24.531686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-b2b55572-4e85-4e41-ac76-1013a4bab41d None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:24.534401 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-b2b55572-4e85-4e41-ac76-1013a4bab41d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:24.577472 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1aa66b-0503-4a83-a687-516420a7f8f8 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:24.588124 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:24.636373 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 167/338] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:07:24.637270 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d649f5-8450-48df-b612-d706c8c26b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:24.638081 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d649f5-8450-48df-b612-d706c8c26b79 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:24.638490 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d649f5-8450-48df-b612-d706c8c26b79 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:24.638892 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d649f5-8450-48df-b612-d706c8c26b79 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:24.650612 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d649f5-8450-48df-b612-d706c8c26b79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:24.656457 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-e4d649f5-8450-48df-b612-d706c8c26b79 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:07:24.656457 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:24.656457 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:24.656457 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:24.656457 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:24.656457 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:24.656457 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:24.656457 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:24.656457 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:24.656457 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:24.656457 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:24.656457 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:24.656457 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:24.656457 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:24.656457 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:24.656457 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:24.657509 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:24.657509 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:24.657509 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:24.657509 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:24.657509 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:24.657509 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:24.657509 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:24.657509 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:24.657509 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:24.657509 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:24.657509 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:24.657509 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:24.657509 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:24.657509 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:24.657509 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:24.657509 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:24.658475 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:24.658475 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:24.658475 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:24.658475 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:24.658475 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:24.658475 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:24.658475 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:24.658475 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:24.658475 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:24.658475 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:24.658475 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:07:24.658475 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:24.660774 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 172/339] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:07:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:24.669255 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b55572-4e85-4e41-ac76-1013a4bab41d None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:24.669548 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d649f5-8450-48df-b612-d706c8c26b79 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:24.716525 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:24.796907 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d649f5-8450-48df-b612-d706c8c26b79 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:24.816241 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b55572-4e85-4e41-ac76-1013a4bab41d None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:24.833879 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171a7da-8ce4-4f5d-a2e9-780ee14c5e03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:24.840359 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171a7da-8ce4-4f5d-a2e9-780ee14c5e03 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:24.840359 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171a7da-8ce4-4f5d-a2e9-780ee14c5e03 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:24.840359 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5171a7da-8ce4-4f5d-a2e9-780ee14c5e03 None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:24.840359 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171a7da-8ce4-4f5d-a2e9-780ee14c5e03 None admin] RBAC: Adding query filter params (name=member) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:24.840359 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171a7da-8ce4-4f5d-a2e9-780ee14c5e03 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:24.840359 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5171a7da-8ce4-4f5d-a2e9-780ee14c5e03 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:24.849083 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 173/340] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Aug 5 02:07:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:24.853908 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171a7da-8ce4-4f5d-a2e9-780ee14c5e03 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:24.884692 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68898d4e-0008-414c-bb23-0d570987fb4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:24.885349 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68898d4e-0008-414c-bb23-0d570987fb4f None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:24.885633 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68898d4e-0008-414c-bb23-0d570987fb4f None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:24.885905 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68898d4e-0008-414c-bb23-0d570987fb4f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:24.886457 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:24.913268 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68898d4e-0008-414c-bb23-0d570987fb4f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:24.918630 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-68898d4e-0008-414c-bb23-0d570987fb4f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:07:24.918630 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:24.918630 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:24.918630 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:24.918630 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:24.918630 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:24.918630 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:24.918630 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:24.918630 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:24.918630 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:24.918630 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:24.918630 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:24.918630 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:24.918630 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:24.918630 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:24.918630 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:24.919527 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:24.919527 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:24.919527 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:24.919527 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:24.919527 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:24.919527 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:24.919527 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:24.919527 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:24.919527 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:24.919527 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:24.919527 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:24.919527 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:24.919527 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:24.919527 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:24.919527 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:24.919527 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:24.920348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:24.920348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:24.920348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:24.920348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:24.920348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:24.920348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:24.920348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:24.920348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:24.920348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:24.920348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:24.920348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:07:24.920348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:24.924778 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 168/341] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Aug 5 02:07:24 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:24.932104 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68898d4e-0008-414c-bb23-0d570987fb4f None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:24.966161 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5171a7da-8ce4-4f5d-a2e9-780ee14c5e03 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:25.003140 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e51c4-b39b-4d37-af13-04bb59242cdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:25.003812 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e51c4-b39b-4d37-af13-04bb59242cdd None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:25.004093 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e51c4-b39b-4d37-af13-04bb59242cdd None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:25.004397 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3e51c4-b39b-4d37-af13-04bb59242cdd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:25.103521 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:25.112266 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68898d4e-0008-414c-bb23-0d570987fb4f None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:25.127382 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e51c4-b39b-4d37-af13-04bb59242cdd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:25.128990 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3e51c4-b39b-4d37-af13-04bb59242cdd None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:25.174740 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3665f9ec-7ab2-482d-b9d0-5a14b7d0c974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:25.175379 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665f9ec-7ab2-482d-b9d0-5a14b7d0c974 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:25.175658 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665f9ec-7ab2-482d-b9d0-5a14b7d0c974 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:25.175929 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3665f9ec-7ab2-482d-b9d0-5a14b7d0c974 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:25.176687 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3665f9ec-7ab2-482d-b9d0-5a14b7d0c974 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:25.176992 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3665f9ec-7ab2-482d-b9d0-5a14b7d0c974 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:25.178366 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3665f9ec-7ab2-482d-b9d0-5a14b7d0c974 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:25.192804 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 169/342] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:07:24 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:25.198778 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3665f9ec-7ab2-482d-b9d0-5a14b7d0c974 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:25.200386 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:25.323288 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3665f9ec-7ab2-482d-b9d0-5a14b7d0c974 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:25.358569 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 174/343] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:07:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 505 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 05 02:07:25.363778 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e51c4-b39b-4d37-af13-04bb59242cdd None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:25.364134 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c87c9-b569-47e8-997b-acbe4d2a6674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:25.364810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c87c9-b569-47e8-997b-acbe4d2a6674 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:25.365094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c87c9-b569-47e8-997b-acbe4d2a6674 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:25.365369 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-977c87c9-b569-47e8-997b-acbe4d2a6674 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:25.397516 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:25.452598 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c87c9-b569-47e8-997b-acbe4d2a6674 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:25.454231 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-977c87c9-b569-47e8-997b-acbe4d2a6674 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:25.575510 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 170/344] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:07:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:07:25.578014 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3e51c4-b39b-4d37-af13-04bb59242cdd None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:25.580819 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c87c9-b569-47e8-997b-acbe4d2a6674 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:25.642789 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:25.651857 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:25.662987 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ef3ac-e7a4-4f5d-95e4-326f33988b52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:25.664040 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ef3ac-e7a4-4f5d-95e4-326f33988b52 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:25.664556 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ef3ac-e7a4-4f5d-95e4-326f33988b52 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:25.665087 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ef3ac-e7a4-4f5d-95e4-326f33988b52 None admin] PATH_INFO: `/v3/projects/758af4bbce9a439eb91820fb4527231a` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:25.668539 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ef3ac-e7a4-4f5d-95e4-326f33988b52 None admin] RBAC: Authorizing `identity:get_project(project_id=758af4bbce9a439eb91820fb4527231a)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:25.670252 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ef3ac-e7a4-4f5d-95e4-326f33988b52 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:25.672196 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 175/345] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:07:25 2022] GET /identity/v3/projects/758af4bbce9a439eb91820fb4527231a => generated 298 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:07:25.680063 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ef3ac-e7a4-4f5d-95e4-326f33988b52 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:25.703206 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-977c87c9-b569-47e8-997b-acbe4d2a6674 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:25.767899 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c4d2a-466a-4982-9575-0e9c5063499c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:25.772618 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c4d2a-466a-4982-9575-0e9c5063499c None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:25.772912 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c4d2a-466a-4982-9575-0e9c5063499c None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:25.773193 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-055c4d2a-466a-4982-9575-0e9c5063499c None admin] PATH_INFO: `/v3/projects/758af4bbce9a439eb91820fb4527231a` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:25.774483 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c4d2a-466a-4982-9575-0e9c5063499c None admin] RBAC: Authorizing `identity:get_project(project_id=758af4bbce9a439eb91820fb4527231a)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:25.776498 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-055c4d2a-466a-4982-9575-0e9c5063499c None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:25.778600 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 171/346] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:07:25 2022] GET /identity/v3/projects/758af4bbce9a439eb91820fb4527231a => generated 298 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:25.783920 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c4d2a-466a-4982-9575-0e9c5063499c None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:25.904124 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ef3ac-e7a4-4f5d-95e4-326f33988b52 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:25.971113 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-055c4d2a-466a-4982-9575-0e9c5063499c None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:25.981962 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519da8ed-b295-4708-aabd-8b5a7e9d2165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:25.982848 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519da8ed-b295-4708-aabd-8b5a7e9d2165 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:25.983295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519da8ed-b295-4708-aabd-8b5a7e9d2165 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:25.983708 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519da8ed-b295-4708-aabd-8b5a7e9d2165 None admin] PATH_INFO: `/v3/groups/16b64e2ef0ca4e57bb35fad474876314` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:25.997675 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519da8ed-b295-4708-aabd-8b5a7e9d2165 None admin] RBAC: Authorizing `identity:get_group(group_id=16b64e2ef0ca4e57bb35fad474876314)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:25.999158 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519da8ed-b295-4708-aabd-8b5a7e9d2165 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:26.000470 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:26.000999 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 176/347] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Aug 5 02:07:25 2022] GET /identity/v3/groups/16b64e2ef0ca4e57bb35fad474876314 => generated 226 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:26.002318 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ded33-a016-4c82-954b-a6cd8750ba15 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:26.002770 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ded33-a016-4c82-954b-a6cd8750ba15 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:26.003185 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af6ded33-a016-4c82-954b-a6cd8750ba15 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:26.009678 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 177/348] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:26 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:26.011313 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fad876-c7b9-4e44-a350-24e93c439acf None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:26.011594 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fad876-c7b9-4e44-a350-24e93c439acf None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:26.012014 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15fad876-c7b9-4e44-a350-24e93c439acf None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:26.013524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 178/349] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:26.016618 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92391b2c-f54d-46fc-af2c-47f697b422fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:26.017444 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92391b2c-f54d-46fc-af2c-47f697b422fc None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:26.018146 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92391b2c-f54d-46fc-af2c-47f697b422fc None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:26.018652 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92391b2c-f54d-46fc-af2c-47f697b422fc None admin] PATH_INFO: `/v3/groups/16b64e2ef0ca4e57bb35fad474876314` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:26.019311 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8c3cc-9d48-438e-a7f8-676f310ed03a None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:26.019652 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8c3cc-9d48-438e-a7f8-676f310ed03a None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:26.019993 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01a8c3cc-9d48-438e-a7f8-676f310ed03a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:26.020517 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92391b2c-f54d-46fc-af2c-47f697b422fc None admin] RBAC: Authorizing `identity:get_group(group_id=16b64e2ef0ca4e57bb35fad474876314)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:26.022149 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92391b2c-f54d-46fc-af2c-47f697b422fc None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:26.024505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 172/350] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Aug 5 02:07:25 2022] GET /identity/v3/groups/16b64e2ef0ca4e57bb35fad474876314 => generated 226 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:07:26.026670 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8444a-587f-40fa-8be1-eeaa5c6ffb95 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:26.027098 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8444a-587f-40fa-8be1-eeaa5c6ffb95 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:26.027522 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53b8444a-587f-40fa-8be1-eeaa5c6ffb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:26.046308 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-01a8c3cc-9d48-438e-a7f8-676f310ed03a None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:26.047819 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-01a8c3cc-9d48-438e-a7f8-676f310ed03a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:26.048400 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-53b8444a-587f-40fa-8be1-eeaa5c6ffb95 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:26.049545 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-53b8444a-587f-40fa-8be1-eeaa5c6ffb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:26.122716 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 173/351] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:07:26.123360 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:26.123563 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8444a-587f-40fa-8be1-eeaa5c6ffb95 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:26.129885 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 179/352] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:07:26.130985 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a8c3cc-9d48-438e-a7f8-676f310ed03a None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:26.248349 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53b8444a-587f-40fa-8be1-eeaa5c6ffb95 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:26.255206 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01a8c3cc-9d48-438e-a7f8-676f310ed03a None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:26.277113 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:26.286692 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d8007-ef61-4a5e-8339-e7c37f2b06d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:26.287520 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d8007-ef61-4a5e-8339-e7c37f2b06d1 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:26.287939 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d8007-ef61-4a5e-8339-e7c37f2b06d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:26.288415 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1d8007-ef61-4a5e-8339-e7c37f2b06d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:26.289600 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d8007-ef61-4a5e-8339-e7c37f2b06d1 None admin] RBAC: Adding query filter params (group.id=16b64e2ef0ca4e57bb35fad474876314, role.id=33cd9c7fcf9b4bbe9d604952279e8d76, scope.project.id=758af4bbce9a439eb91820fb4527231a) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:26.290106 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d8007-ef61-4a5e-8339-e7c37f2b06d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:26.291669 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1d8007-ef61-4a5e-8339-e7c37f2b06d1 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:26.291929 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d68f25-b480-430a-96c0-fe41e864b204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:26.292778 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d68f25-b480-430a-96c0-fe41e864b204 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:26.293227 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d68f25-b480-430a-96c0-fe41e864b204 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:26.293666 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d68f25-b480-430a-96c0-fe41e864b204 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:26.294620 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d68f25-b480-430a-96c0-fe41e864b204 None admin] RBAC: Adding query filter params (group.id=16b64e2ef0ca4e57bb35fad474876314, role.id=5c52e382f2bc436d95d82f2a2fae8ace, scope.project.id=758af4bbce9a439eb91820fb4527231a) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:26.295097 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d68f25-b480-430a-96c0-fe41e864b204 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:26.296744 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d68f25-b480-430a-96c0-fe41e864b204 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:26.297265 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 174/353] 10.222.0.15 () {56 vars in 1376 bytes} [Fri Aug 5 02:07:26 2022] GET /identity/v3/role_assignments?group.id=16b64e2ef0ca4e57bb35fad474876314&scope.project.id=758af4bbce9a439eb91820fb4527231a&role.id=33cd9c7fcf9b4bbe9d604952279e8d76 => generated 260 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:26.298060 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d8007-ef61-4a5e-8339-e7c37f2b06d1 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:26.307936 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 180/354] 10.222.0.15 () {56 vars in 1376 bytes} [Fri Aug 5 02:07:26 2022] GET /identity/v3/role_assignments?group.id=16b64e2ef0ca4e57bb35fad474876314&scope.project.id=758af4bbce9a439eb91820fb4527231a&role.id=5c52e382f2bc436d95d82f2a2fae8ace => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:26.309212 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d68f25-b480-430a-96c0-fe41e864b204 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:26.392494 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:26.416855 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1d8007-ef61-4a5e-8339-e7c37f2b06d1 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:26.456753 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe99d62-9749-4fd4-8bb9-395264368fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:26.457676 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe99d62-9749-4fd4-8bb9-395264368fa7 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:26.458206 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe99d62-9749-4fd4-8bb9-395264368fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:26.458652 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe99d62-9749-4fd4-8bb9-395264368fa7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:26.462835 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d68f25-b480-430a-96c0-fe41e864b204 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:26.474225 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe99d62-9749-4fd4-8bb9-395264368fa7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:26.480921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-8fe99d62-9749-4fd4-8bb9-395264368fa7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 02:07:26.480921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:26.480921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:26.480921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:26.480921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:26.480921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:26.480921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:26.480921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:26.480921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:26.480921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:26.480921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:26.480921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:26.480921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:26.480921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:26.480921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:26.480921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:26.482029 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:26.482029 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:26.482029 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:26.482029 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:26.482029 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:26.482029 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:26.482029 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:26.482029 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:26.482029 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:26.482029 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:26.482029 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:26.482029 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:26.482029 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:26.482029 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:26.482029 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:26.482029 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:26.482935 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:26.482935 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:26.482935 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:26.482935 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:26.482935 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:26.482935 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:26.482935 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:26.482935 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:26.482935 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:26.482935 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:26.482935 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 05 02:07:26.482935 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:26.485452 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 175/355] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:07:26 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:26.494367 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe99d62-9749-4fd4-8bb9-395264368fa7 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:26.534002 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af8e371-22a8-470f-9204-45e34598ab74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:26.534689 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8e371-22a8-470f-9204-45e34598ab74 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:26.534977 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8e371-22a8-470f-9204-45e34598ab74 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:26.535254 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8e371-22a8-470f-9204-45e34598ab74 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:26.564306 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af8e371-22a8-470f-9204-45e34598ab74 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:26.570655 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:26.574663 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-4af8e371-22a8-470f-9204-45e34598ab74 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:07:26.574663 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:26.574663 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:26.574663 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:26.574663 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:26.574663 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:26.574663 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:26.574663 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:26.574663 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:26.574663 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:26.574663 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:26.574663 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:26.574663 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:26.574663 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:26.574663 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:26.574663 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:26.575693 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:26.575693 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:26.575693 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:26.575693 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:26.575693 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:26.575693 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:26.575693 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:26.575693 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:26.575693 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:26.575693 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:26.575693 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:26.575693 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:26.575693 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:26.575693 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:26.575693 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:26.575693 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:26.576690 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:26.576690 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:26.576690 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:26.576690 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:26.576690 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:26.576690 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:26.576690 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:26.576690 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:26.576690 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:26.576690 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:26.576690 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:07:26.576690 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:26.576690 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 181/356] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:07:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 264 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:26.578973 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af8e371-22a8-470f-9204-45e34598ab74 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:26.655538 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe99d62-9749-4fd4-8bb9-395264368fa7 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:26.703219 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c35a38a-63f0-4a16-bb7c-01512aa45e68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:26.703854 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35a38a-63f0-4a16-bb7c-01512aa45e68 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:26.704134 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35a38a-63f0-4a16-bb7c-01512aa45e68 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:26.704468 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c35a38a-63f0-4a16-bb7c-01512aa45e68 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:26.705198 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c35a38a-63f0-4a16-bb7c-01512aa45e68 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:26.705505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c35a38a-63f0-4a16-bb7c-01512aa45e68 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:26.707009 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c35a38a-63f0-4a16-bb7c-01512aa45e68 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:26.718562 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 176/357] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Aug 5 02:07:26 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:26.720049 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402748e5-e591-4ef1-bdf6-511c409c46b0 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:26.720439 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402748e5-e591-4ef1-bdf6-511c409c46b0 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:26.720715 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402748e5-e591-4ef1-bdf6-511c409c46b0 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:26.722253 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 177/358] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:26.723772 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402748e5-e591-4ef1-bdf6-511c409c46b0 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:26.774068 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af8e371-22a8-470f-9204-45e34598ab74 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:26.789762 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:26.813036 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624bd315-5531-44b3-86da-2ec139620578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:26.813831 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624bd315-5531-44b3-86da-2ec139620578 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:26.814174 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624bd315-5531-44b3-86da-2ec139620578 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:26.814556 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624bd315-5531-44b3-86da-2ec139620578 None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:26.815368 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624bd315-5531-44b3-86da-2ec139620578 None admin] RBAC: Adding query filter params (name=member) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:26.815910 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624bd315-5531-44b3-86da-2ec139620578 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:26.817409 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-624bd315-5531-44b3-86da-2ec139620578 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:26.838078 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 182/359] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Aug 5 02:07:26 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:26.838078 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605faa4-3c6f-47e5-8398-0b27407821be None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:26.838078 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605faa4-3c6f-47e5-8398-0b27407821be None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:26.838078 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e605faa4-3c6f-47e5-8398-0b27407821be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:26.849370 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402748e5-e591-4ef1-bdf6-511c409c46b0 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:26.860020 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:26.862063 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-e605faa4-3c6f-47e5-8398-0b27407821be None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:26.864107 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-e605faa4-3c6f-47e5-8398-0b27407821be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:26.909090 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18af1d-a093-4e3c-a7f8-0a05a252142a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:26.909766 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18af1d-a093-4e3c-a7f8-0a05a252142a None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:26.910052 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18af1d-a093-4e3c-a7f8-0a05a252142a None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:26.910332 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de18af1d-a093-4e3c-a7f8-0a05a252142a None admin] PATH_INFO: `/v3/users/f20856e61ef1431583a1bbcc65aa8d18` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:26.911588 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de18af1d-a093-4e3c-a7f8-0a05a252142a None admin] RBAC: Authorizing `identity:get_user(user_id=f20856e61ef1431583a1bbcc65aa8d18)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:26.913065 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de18af1d-a093-4e3c-a7f8-0a05a252142a None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:26.914683 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 178/360] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:07:26 2022] GET /identity/v3/users/f20856e61ef1431583a1bbcc65aa8d18 => generated 293 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:07:26.915580 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18af1d-a093-4e3c-a7f8-0a05a252142a None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:26.942921 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 183/361] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:07:26.943991 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605faa4-3c6f-47e5-8398-0b27407821be None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:27.055179 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e605faa4-3c6f-47e5-8398-0b27407821be None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:27.064272 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:27.078776 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de18af1d-a093-4e3c-a7f8-0a05a252142a None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:27.095309 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034083f0-620f-4fdf-87b4-e90d421c9245 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:27.096181 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034083f0-620f-4fdf-87b4-e90d421c9245 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:27.096630 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034083f0-620f-4fdf-87b4-e90d421c9245 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:27.097079 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034083f0-620f-4fdf-87b4-e90d421c9245 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:27.098348 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034083f0-620f-4fdf-87b4-e90d421c9245 None admin] RBAC: Adding query filter params (role.id=1070d90fae74403eab5e52609af8ed78, user.id=f20856e61ef1431583a1bbcc65aa8d18, scope.system=all) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:27.098810 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034083f0-620f-4fdf-87b4-e90d421c9245 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:27.100461 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034083f0-620f-4fdf-87b4-e90d421c9245 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:27.116081 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 184/362] 10.222.0.15 () {56 vars in 1308 bytes} [Fri Aug 5 02:07:26 2022] GET /identity/v3/role_assignments?user.id=f20856e61ef1431583a1bbcc65aa8d18&scope.system=all&role.id=1070d90fae74403eab5e52609af8ed78 => generated 510 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:27.117176 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034083f0-620f-4fdf-87b4-e90d421c9245 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:27.150346 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259ad68-ac9b-4393-8370-5a3e2e3ab902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:27.151006 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259ad68-ac9b-4393-8370-5a3e2e3ab902 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:27.151289 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259ad68-ac9b-4393-8370-5a3e2e3ab902 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:27.151558 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5259ad68-ac9b-4393-8370-5a3e2e3ab902 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:27.228983 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:27.236946 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034083f0-620f-4fdf-87b4-e90d421c9245 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:27.269585 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5259ad68-ac9b-4393-8370-5a3e2e3ab902 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:27.270816 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5259ad68-ac9b-4393-8370-5a3e2e3ab902 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:27.278548 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be7825-fdfb-434a-adb6-a52bf1e074c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:27.279469 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be7825-fdfb-434a-adb6-a52bf1e074c6 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:27.279908 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be7825-fdfb-434a-adb6-a52bf1e074c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:27.280430 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be7825-fdfb-434a-adb6-a52bf1e074c6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:27.292795 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24be7825-fdfb-434a-adb6-a52bf1e074c6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:27.298928 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-24be7825-fdfb-434a-adb6-a52bf1e074c6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:07:27.298928 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:27.298928 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:27.298928 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:27.298928 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:27.298928 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:27.298928 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:27.298928 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:27.298928 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:27.298928 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:27.298928 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:27.298928 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:27.298928 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:27.298928 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:27.298928 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:27.298928 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:27.300073 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:27.300073 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:27.300073 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:27.300073 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:27.300073 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:27.300073 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:27.300073 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:27.300073 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:27.300073 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:27.300073 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:27.300073 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:27.300073 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:27.300073 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:27.300073 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:27.300073 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:27.300073 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:27.300971 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:27.300971 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:27.300971 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:27.300971 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:27.300971 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:27.300971 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:27.300971 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:27.300971 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:27.300971 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:27.300971 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:27.300971 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:07:27.300971 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:27.303021 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 185/363] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Aug 5 02:07:27 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:27.309452 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be7825-fdfb-434a-adb6-a52bf1e074c6 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:27.341748 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:27.401276 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 179/364] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:07:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:07:27.408497 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259ad68-ac9b-4393-8370-5a3e2e3ab902 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:27.429758 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be7825-fdfb-434a-adb6-a52bf1e074c6 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:27.469225 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea61e11a-867f-47df-915a-9501184b9cd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:27.469850 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61e11a-867f-47df-915a-9501184b9cd0 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:27.470168 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61e11a-867f-47df-915a-9501184b9cd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:27.470445 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea61e11a-867f-47df-915a-9501184b9cd0 None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:27.471159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea61e11a-867f-47df-915a-9501184b9cd0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:27.471459 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea61e11a-867f-47df-915a-9501184b9cd0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:27.473111 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea61e11a-867f-47df-915a-9501184b9cd0 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:27.482920 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 186/365] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:07:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:27.484234 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d72774-a52f-475e-8312-e6f438456912 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:27.484543 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d72774-a52f-475e-8312-e6f438456912 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:27.484816 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2d72774-a52f-475e-8312-e6f438456912 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:27.486140 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 187/366] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:27.489182 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d72774-a52f-475e-8312-e6f438456912 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:27.528281 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:27.543780 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5259ad68-ac9b-4393-8370-5a3e2e3ab902 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:27.593695 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd810e0e-3ce4-4027-900d-89468b98c9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:27.594276 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd810e0e-3ce4-4027-900d-89468b98c9cb None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:27.594554 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd810e0e-3ce4-4027-900d-89468b98c9cb None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:27.594822 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd810e0e-3ce4-4027-900d-89468b98c9cb None admin] PATH_INFO: `/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:27.595997 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd810e0e-3ce4-4027-900d-89468b98c9cb None admin] RBAC: Authorizing `identity:get_project(project_id=4c39c7e842b54d0f8d9c70bc00f480ce)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:27.597757 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd810e0e-3ce4-4027-900d-89468b98c9cb None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:27.600483 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 180/367] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:07:27 2022] GET /identity/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:27.601666 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e25c6-1608-4cff-837e-bd43ffbc9eba None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:27.602440 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e25c6-1608-4cff-837e-bd43ffbc9eba None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:27.603358 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c6e25c6-1608-4cff-837e-bd43ffbc9eba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:27.614091 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:27.630575 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-3c6e25c6-1608-4cff-837e-bd43ffbc9eba None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:27.631782 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-3c6e25c6-1608-4cff-837e-bd43ffbc9eba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:27.633160 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2d72774-a52f-475e-8312-e6f438456912 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:27.678358 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc2c50-3ba6-4c58-89f4-dd17e9eeffc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:27.679032 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc2c50-3ba6-4c58-89f4-dd17e9eeffc9 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:27.679312 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc2c50-3ba6-4c58-89f4-dd17e9eeffc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:27.679583 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cc2c50-3ba6-4c58-89f4-dd17e9eeffc9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:27.722185 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 181/368] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:07:27.723375 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e25c6-1608-4cff-837e-bd43ffbc9eba None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:27.771965 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc2c50-3ba6-4c58-89f4-dd17e9eeffc9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:27.773515 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cc2c50-3ba6-4c58-89f4-dd17e9eeffc9 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:27.824998 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:27.872299 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c6e25c6-1608-4cff-837e-bd43ffbc9eba None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:27.897974 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:27.920929 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 188/369] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:07:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 433 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:07:27.922067 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc2c50-3ba6-4c58-89f4-dd17e9eeffc9 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:27.922180 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999435c6-e654-44ea-bff4-4780f86b05db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:27.922789 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999435c6-e654-44ea-bff4-4780f86b05db None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:27.923066 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999435c6-e654-44ea-bff4-4780f86b05db None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:27.923318 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-999435c6-e654-44ea-bff4-4780f86b05db None admin] PATH_INFO: `/v3/groups/16b64e2ef0ca4e57bb35fad474876314` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:27.926084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999435c6-e654-44ea-bff4-4780f86b05db None admin] RBAC: Authorizing `identity:get_group(group_id=16b64e2ef0ca4e57bb35fad474876314)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:27.927550 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-999435c6-e654-44ea-bff4-4780f86b05db None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:27.929612 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 182/370] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Aug 5 02:07:27 2022] GET /identity/v3/groups/16b64e2ef0ca4e57bb35fad474876314 => generated 226 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:27.930445 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999435c6-e654-44ea-bff4-4780f86b05db None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:28.046877 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cc2c50-3ba6-4c58-89f4-dd17e9eeffc9 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:28.067300 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-999435c6-e654-44ea-bff4-4780f86b05db None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:28.099238 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa27533-f3af-4102-b092-f6315e759dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:28.099898 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa27533-f3af-4102-b092-f6315e759dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:28.100179 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa27533-f3af-4102-b092-f6315e759dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:28.100492 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa27533-f3af-4102-b092-f6315e759dd9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:28.117812 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa27533-f3af-4102-b092-f6315e759dd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:28.121177 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff8e7d-31f2-485b-acad-685f883c2127 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:28.122068 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff8e7d-31f2-485b-acad-685f883c2127 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:28.122618 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff8e7d-31f2-485b-acad-685f883c2127 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:28.123112 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eff8e7d-31f2-485b-acad-685f883c2127 None admin] PATH_INFO: `/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:28.123636 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-bfa27533-f3af-4102-b092-f6315e759dd9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:07:28.123636 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:28.123636 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:28.123636 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:28.123636 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:28.123636 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:28.123636 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:28.123636 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:28.123636 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:28.123636 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:28.123636 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:28.123636 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:28.123636 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:28.123636 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:28.123636 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:28.123636 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:28.124572 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:28.124572 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:28.124572 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:28.124572 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:28.124572 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:28.124572 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:28.124572 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:28.124572 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:28.124572 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:28.124572 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:28.124572 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:28.124572 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:28.124572 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:28.124572 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:28.124572 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:28.124572 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:28.125396 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:28.125396 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:28.125396 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:28.125396 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:28.125396 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:28.125396 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:28.125396 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:28.125396 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:28.125396 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:28.125396 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:28.125396 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:07:28.125396 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:28.127511 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff8e7d-31f2-485b-acad-685f883c2127 None admin] RBAC: Authorizing `identity:get_project(project_id=4c39c7e842b54d0f8d9c70bc00f480ce)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:28.129315 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eff8e7d-31f2-485b-acad-685f883c2127 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:28.129992 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 189/371] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Aug 5 02:07:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:28.130922 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa27533-f3af-4102-b092-f6315e759dd9 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:28.135430 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 183/372] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:07:27 2022] GET /identity/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce => generated 302 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:28.136956 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff8e7d-31f2-485b-acad-685f883c2127 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:28.156591 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:28.192119 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:28.251842 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa27533-f3af-4102-b092-f6315e759dd9 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:28.260465 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eff8e7d-31f2-485b-acad-685f883c2127 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:28.291302 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b130e-1d52-4652-b061-fc3316ace08f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:28.291929 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b130e-1d52-4652-b061-fc3316ace08f None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:28.292274 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b130e-1d52-4652-b061-fc3316ace08f None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:28.292590 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3b130e-1d52-4652-b061-fc3316ace08f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:28.293465 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3b130e-1d52-4652-b061-fc3316ace08f None admin] RBAC: Adding query filter params (group.id=16b64e2ef0ca4e57bb35fad474876314, role.id=33cd9c7fcf9b4bbe9d604952279e8d76, scope.project.id=4c39c7e842b54d0f8d9c70bc00f480ce) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:28.293692 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3b130e-1d52-4652-b061-fc3316ace08f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:28.295142 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3b130e-1d52-4652-b061-fc3316ace08f None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:28.299572 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c0608-e365-48ef-be19-1e1c697711d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:28.300482 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c0608-e365-48ef-be19-1e1c697711d5 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:28.300977 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c0608-e365-48ef-be19-1e1c697711d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:28.301456 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf2c0608-e365-48ef-be19-1e1c697711d5 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:28.302122 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 190/373] 10.222.0.15 () {56 vars in 1376 bytes} [Fri Aug 5 02:07:28 2022] GET /identity/v3/role_assignments?group.id=16b64e2ef0ca4e57bb35fad474876314&scope.project.id=4c39c7e842b54d0f8d9c70bc00f480ce&role.id=33cd9c7fcf9b4bbe9d604952279e8d76 => generated 260 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:28.302610 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c0608-e365-48ef-be19-1e1c697711d5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:28.303096 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b130e-1d52-4652-b061-fc3316ace08f None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:28.303316 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c0608-e365-48ef-be19-1e1c697711d5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:28.304998 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf2c0608-e365-48ef-be19-1e1c697711d5 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:28.316035 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 184/374] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:07:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:28.323467 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c0608-e365-48ef-be19-1e1c697711d5 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:28.411263 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:28.437829 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3b130e-1d52-4652-b061-fc3316ace08f None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:28.456350 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:28.456537 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf2c0608-e365-48ef-be19-1e1c697711d5 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:28.490642 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7971a-5a1d-4eb0-bb36-0c9a986104bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:28.492130 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7971a-5a1d-4eb0-bb36-0c9a986104bc None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:28.492787 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7971a-5a1d-4eb0-bb36-0c9a986104bc None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:28.494275 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a7971a-5a1d-4eb0-bb36-0c9a986104bc None admin] PATH_INFO: `/v3/groups/16b64e2ef0ca4e57bb35fad474876314` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:28.496584 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a7971a-5a1d-4eb0-bb36-0c9a986104bc None admin] RBAC: Authorizing `identity:get_group(group_id=16b64e2ef0ca4e57bb35fad474876314)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:28.498656 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a7971a-5a1d-4eb0-bb36-0c9a986104bc None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:28.502215 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 191/375] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Aug 5 02:07:28 2022] GET /identity/v3/groups/16b64e2ef0ca4e57bb35fad474876314 => generated 226 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:28.506961 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ea109-ff60-425b-992d-551b0e8a253a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:28.507585 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7971a-5a1d-4eb0-bb36-0c9a986104bc None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:28.507705 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ea109-ff60-425b-992d-551b0e8a253a None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:28.508025 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ea109-ff60-425b-992d-551b0e8a253a None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:28.508436 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64ea109-ff60-425b-992d-551b0e8a253a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:28.608696 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ea109-ff60-425b-992d-551b0e8a253a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:28.610987 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64ea109-ff60-425b-992d-551b0e8a253a None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:28.636244 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a7971a-5a1d-4eb0-bb36-0c9a986104bc None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:28.675736 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bd2cc-e89e-473f-948c-6857b32dc71b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:28.676619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bd2cc-e89e-473f-948c-6857b32dc71b None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:28.676983 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bd2cc-e89e-473f-948c-6857b32dc71b None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:28.677362 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816bd2cc-e89e-473f-948c-6857b32dc71b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:28.678220 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816bd2cc-e89e-473f-948c-6857b32dc71b None admin] RBAC: Adding query filter params (group.id=16b64e2ef0ca4e57bb35fad474876314, role.id=5c52e382f2bc436d95d82f2a2fae8ace, scope.project.id=4c39c7e842b54d0f8d9c70bc00f480ce) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:28.678698 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816bd2cc-e89e-473f-948c-6857b32dc71b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:28.680157 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816bd2cc-e89e-473f-948c-6857b32dc71b None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:28.686716 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 192/376] 10.222.0.15 () {56 vars in 1376 bytes} [Fri Aug 5 02:07:28 2022] GET /identity/v3/role_assignments?group.id=16b64e2ef0ca4e57bb35fad474876314&scope.project.id=4c39c7e842b54d0f8d9c70bc00f480ce&role.id=5c52e382f2bc436d95d82f2a2fae8ace => generated 260 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:28.695977 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:28.744474 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 185/377] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:07:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:07:28.746113 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bd2cc-e89e-473f-948c-6857b32dc71b None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:28.804783 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:28.880109 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816bd2cc-e89e-473f-948c-6857b32dc71b None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:28.926885 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f6519-19ab-4c08-80e3-78a4712b47e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:28.927465 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f6519-19ab-4c08-80e3-78a4712b47e2 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:28.927749 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f6519-19ab-4c08-80e3-78a4712b47e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:28.928027 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-178f6519-19ab-4c08-80e3-78a4712b47e2 None admin] PATH_INFO: `/v3/projects/a0be9d6a2aae470aa8143374d4c4992b` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:28.929238 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f6519-19ab-4c08-80e3-78a4712b47e2 None admin] RBAC: Authorizing `identity:get_project(project_id=a0be9d6a2aae470aa8143374d4c4992b)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:28.931005 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-178f6519-19ab-4c08-80e3-78a4712b47e2 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:28.932800 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 193/378] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:07:28 2022] GET /identity/v3/projects/a0be9d6a2aae470aa8143374d4c4992b => generated 344 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:28.938745 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ea109-ff60-425b-992d-551b0e8a253a None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:29.056878 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64ea109-ff60-425b-992d-551b0e8a253a None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:29.096810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0af6c02-d8e1-4fad-b62e-2dd712f4add2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:29.097713 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af6c02-d8e1-4fad-b62e-2dd712f4add2 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:29.097999 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af6c02-d8e1-4fad-b62e-2dd712f4add2 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:29.098273 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0af6c02-d8e1-4fad-b62e-2dd712f4add2 None admin] PATH_INFO: `/v3/groups/9998f61e2dd742d1a38d56654f52f0c8` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:29.107138 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af6c02-d8e1-4fad-b62e-2dd712f4add2 None admin] RBAC: Authorizing `identity:get_group(group_id=9998f61e2dd742d1a38d56654f52f0c8)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:29.108708 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0af6c02-d8e1-4fad-b62e-2dd712f4add2 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:29.113508 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 186/379] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Aug 5 02:07:28 2022] GET /identity/v3/groups/9998f61e2dd742d1a38d56654f52f0c8 => generated 229 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:29.116751 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f6519-19ab-4c08-80e3-78a4712b47e2 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:29.278135 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-178f6519-19ab-4c08-80e3-78a4712b47e2 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:29.290044 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:29.292831 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90600e1c-a67e-4bbf-b9d6-e21b24b4b6f6 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:29.293121 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90600e1c-a67e-4bbf-b9d6-e21b24b4b6f6 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:29.293547 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90600e1c-a67e-4bbf-b9d6-e21b24b4b6f6 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:29.295044 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 187/380] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:29.301367 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfd181-988b-46cd-8417-410a35e8ae9c None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:29.301726 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfd181-988b-46cd-8417-410a35e8ae9c None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:29.302207 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22cfd181-988b-46cd-8417-410a35e8ae9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:29.325147 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b49b17ae-0829-490f-9871-71d4b8cf6f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:29.326075 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b17ae-0829-490f-9871-71d4b8cf6f26 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:29.326537 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b17ae-0829-490f-9871-71d4b8cf6f26 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:29.326966 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b49b17ae-0829-490f-9871-71d4b8cf6f26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:29.327843 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-22cfd181-988b-46cd-8417-410a35e8ae9c None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:29.328126 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b17ae-0829-490f-9871-71d4b8cf6f26 None admin] RBAC: Adding query filter params (group.id=9998f61e2dd742d1a38d56654f52f0c8, role.id=e1b75d5eea2a43b2b1b14cf0515350fa, scope.project.id=a0be9d6a2aae470aa8143374d4c4992b) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:29.328636 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b17ae-0829-490f-9871-71d4b8cf6f26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:29.329282 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-22cfd181-988b-46cd-8417-410a35e8ae9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:29.330458 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b49b17ae-0829-490f-9871-71d4b8cf6f26 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:29.342500 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 194/381] 10.222.0.15 () {56 vars in 1376 bytes} [Fri Aug 5 02:07:29 2022] GET /identity/v3/role_assignments?group.id=9998f61e2dd742d1a38d56654f52f0c8&scope.project.id=a0be9d6a2aae470aa8143374d4c4992b&role.id=e1b75d5eea2a43b2b1b14cf0515350fa => generated 260 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:29.369124 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00df57-e27d-4084-a275-ee7e5253802c None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:29.369771 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00df57-e27d-4084-a275-ee7e5253802c None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:29.370263 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d00df57-e27d-4084-a275-ee7e5253802c None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:29.371825 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 195/382] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:07:29.377404 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1ae32-92b2-48d8-861c-2e2726493013 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:29.378017 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1ae32-92b2-48d8-861c-2e2726493013 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:29.378493 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad1ae32-92b2-48d8-861c-2e2726493013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:29.382114 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:29.424400 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-1ad1ae32-92b2-48d8-861c-2e2726493013 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:29.427413 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-1ad1ae32-92b2-48d8-861c-2e2726493013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:29.481026 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 188/383] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:07:29.511885 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cfd181-988b-46cd-8417-410a35e8ae9c None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:29.561751 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 196/384] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:07:29.586382 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1ae32-92b2-48d8-861c-2e2726493013 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:29.631561 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22cfd181-988b-46cd-8417-410a35e8ae9c None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:29.673053 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7d186-3c5f-44bf-89b4-85162979643f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:29.674000 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7d186-3c5f-44bf-89b4-85162979643f None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:29.674284 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7d186-3c5f-44bf-89b4-85162979643f None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:29.674556 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e7d186-3c5f-44bf-89b4-85162979643f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:29.693595 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e7d186-3c5f-44bf-89b4-85162979643f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:29.698390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-a1e7d186-3c5f-44bf-89b4-85162979643f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:07:29.698390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:29.698390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:29.698390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:29.698390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:29.698390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:29.698390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:29.698390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:29.698390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:29.698390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:29.698390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:29.698390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:29.698390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:29.698390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:29.698390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:29.698390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:29.699345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:29.699345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:29.699345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:29.699345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:29.699345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:29.699345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:29.699345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:29.699345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:29.699345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:29.699345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:29.699345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:29.699345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:29.699345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:29.699345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:29.699345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:29.699345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:29.700132 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:29.700132 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:29.700132 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:29.700132 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:29.700132 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:29.700132 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:29.700132 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:29.700132 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:29.700132 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:29.700132 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:29.700132 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:07:29.700132 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:29.700132 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 189/385] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:07:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:07:29.706192 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7d186-3c5f-44bf-89b4-85162979643f None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:29.740685 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:29.820156 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e7d186-3c5f-44bf-89b4-85162979643f None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:29.832253 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad1ae32-92b2-48d8-861c-2e2726493013 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:29.844195 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:29.869647 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71274b03-d42d-40ee-8d02-eefec4f3c743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:29.870268 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71274b03-d42d-40ee-8d02-eefec4f3c743 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:29.870542 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71274b03-d42d-40ee-8d02-eefec4f3c743 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:29.870816 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71274b03-d42d-40ee-8d02-eefec4f3c743 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:29.871536 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71274b03-d42d-40ee-8d02-eefec4f3c743 None admin] RBAC: Adding query filter params (name=member) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:29.871839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71274b03-d42d-40ee-8d02-eefec4f3c743 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:29.873245 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71274b03-d42d-40ee-8d02-eefec4f3c743 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:29.887941 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 190/386] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Aug 5 02:07:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:07:29.893207 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71274b03-d42d-40ee-8d02-eefec4f3c743 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:29.894818 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387030bb-378d-47ae-9128-441613964212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:29.895480 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387030bb-378d-47ae-9128-441613964212 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:29.895753 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387030bb-378d-47ae-9128-441613964212 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:29.896020 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387030bb-378d-47ae-9128-441613964212 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:29.908738 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387030bb-378d-47ae-9128-441613964212 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:29.913887 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-387030bb-378d-47ae-9128-441613964212 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:07:29.913887 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:29.913887 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:29.913887 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:29.913887 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:29.913887 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:29.913887 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:29.913887 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:29.913887 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:29.913887 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:29.913887 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:29.913887 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:29.913887 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:29.913887 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:29.913887 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:29.913887 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:29.914814 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:29.914814 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:29.914814 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:29.914814 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:29.914814 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:29.914814 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:29.914814 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:29.914814 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:29.914814 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:29.914814 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:29.914814 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:29.914814 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:29.914814 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:29.914814 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:29.914814 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:29.914814 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:29.916139 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:29.916139 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:29.916139 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:29.916139 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:29.916139 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:29.916139 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:29.916139 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:29.916139 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:29.916139 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:29.916139 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:29.916139 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:07:29.916139 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:29.916139 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 197/387] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Aug 5 02:07:29 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:07:29.921634 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387030bb-378d-47ae-9128-441613964212 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:30.013334 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:30.044721 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387030bb-378d-47ae-9128-441613964212 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:30.056169 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71274b03-d42d-40ee-8d02-eefec4f3c743 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:30.111070 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd0295-babb-4a47-8706-8934f4e5c897 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:30.112982 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd0295-babb-4a47-8706-8934f4e5c897 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:30.114068 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd0295-babb-4a47-8706-8934f4e5c897 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:30.114508 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fcd0295-babb-4a47-8706-8934f4e5c897 None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:30.115989 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd0295-babb-4a47-8706-8934f4e5c897 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:30.116626 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd0295-babb-4a47-8706-8934f4e5c897 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:30.120194 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fcd0295-babb-4a47-8706-8934f4e5c897 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:30.125964 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e5ce5-1d4d-4e11-ae3d-61a954e5eee2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:30.126795 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e5ce5-1d4d-4e11-ae3d-61a954e5eee2 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:30.127234 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e5ce5-1d4d-4e11-ae3d-61a954e5eee2 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:30.127656 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-555e5ce5-1d4d-4e11-ae3d-61a954e5eee2 None admin] PATH_INFO: `/v3/groups/16b64e2ef0ca4e57bb35fad474876314` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:30.132159 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e5ce5-1d4d-4e11-ae3d-61a954e5eee2 None admin] RBAC: Authorizing `identity:get_group(group_id=16b64e2ef0ca4e57bb35fad474876314)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:30.134324 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-555e5ce5-1d4d-4e11-ae3d-61a954e5eee2 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:30.137563 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 191/388] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Aug 5 02:07:29 2022] GET /identity/v3/groups/16b64e2ef0ca4e57bb35fad474876314 => generated 226 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:30.142309 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 198/389] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:07:29 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:30.144175 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e5ce5-1d4d-4e11-ae3d-61a954e5eee2 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:30.151018 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd0295-babb-4a47-8706-8934f4e5c897 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:30.204184 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:30.286519 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-555e5ce5-1d4d-4e11-ae3d-61a954e5eee2 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:30.330597 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6492ca2-9027-4e5f-a200-eb2c72294d68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:30.332209 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6492ca2-9027-4e5f-a200-eb2c72294d68 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:30.332667 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6492ca2-9027-4e5f-a200-eb2c72294d68 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:30.333081 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6492ca2-9027-4e5f-a200-eb2c72294d68 None admin] PATH_INFO: `/v3/projects/758af4bbce9a439eb91820fb4527231a` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:30.334590 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6492ca2-9027-4e5f-a200-eb2c72294d68 None admin] RBAC: Authorizing `identity:get_project(project_id=758af4bbce9a439eb91820fb4527231a)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:30.336202 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6492ca2-9027-4e5f-a200-eb2c72294d68 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:30.339377 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 192/390] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:07:30 2022] GET /identity/v3/projects/758af4bbce9a439eb91820fb4527231a => generated 298 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:30.350746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6492ca2-9027-4e5f-a200-eb2c72294d68 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:30.356880 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fcd0295-babb-4a47-8706-8934f4e5c897 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:30.389469 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:30.431041 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd906e4-4b31-49c9-b9d0-e896a23c8531 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:30.431854 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd906e4-4b31-49c9-b9d0-e896a23c8531 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:30.432136 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd906e4-4b31-49c9-b9d0-e896a23c8531 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:30.432434 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd906e4-4b31-49c9-b9d0-e896a23c8531 None admin] PATH_INFO: `/v3/groups/16b64e2ef0ca4e57bb35fad474876314` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:30.437052 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd906e4-4b31-49c9-b9d0-e896a23c8531 None admin] RBAC: Authorizing `identity:get_group(group_id=16b64e2ef0ca4e57bb35fad474876314)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:30.438804 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd906e4-4b31-49c9-b9d0-e896a23c8531 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:30.444464 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 199/391] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Aug 5 02:07:30 2022] GET /identity/v3/groups/16b64e2ef0ca4e57bb35fad474876314 => generated 226 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:07:30.454412 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd906e4-4b31-49c9-b9d0-e896a23c8531 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:30.510378 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6492ca2-9027-4e5f-a200-eb2c72294d68 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:30.561526 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35df70-2a44-4ad3-a0ac-94328c48983d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:30.562621 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35df70-2a44-4ad3-a0ac-94328c48983d None admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:30.563399 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35df70-2a44-4ad3-a0ac-94328c48983d None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:30.563873 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a35df70-2a44-4ad3-a0ac-94328c48983d None admin] PATH_INFO: `/v3/projects/758af4bbce9a439eb91820fb4527231a/groups/16b64e2ef0ca4e57bb35fad474876314/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:30.566676 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a35df70-2a44-4ad3-a0ac-94328c48983d None admin] RBAC: Authorizing `identity:create_grant(project_id=758af4bbce9a439eb91820fb4527231a, group_id=16b64e2ef0ca4e57bb35fad474876314, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:30.568627 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a35df70-2a44-4ad3-a0ac-94328c48983d None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:30.590495 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 193/392] 10.222.0.15 () {58 vars in 1442 bytes} [Fri Aug 5 02:07:30 2022] PUT /identity/v3/projects/758af4bbce9a439eb91820fb4527231a/groups/16b64e2ef0ca4e57bb35fad474876314/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:07:30.608632 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:30.616168 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd906e4-4b31-49c9-b9d0-e896a23c8531 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:30.666936 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e852fa9f-9034-4410-8700-0827d80b7c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:30.667563 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852fa9f-9034-4410-8700-0827d80b7c02 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:30.667902 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852fa9f-9034-4410-8700-0827d80b7c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:30.668182 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e852fa9f-9034-4410-8700-0827d80b7c02 None admin] PATH_INFO: `/v3/projects/758af4bbce9a439eb91820fb4527231a` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:30.669516 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e852fa9f-9034-4410-8700-0827d80b7c02 None admin] RBAC: Authorizing `identity:get_project(project_id=758af4bbce9a439eb91820fb4527231a)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:30.671148 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e852fa9f-9034-4410-8700-0827d80b7c02 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:30.675217 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 200/393] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:07:30 2022] GET /identity/v3/projects/758af4bbce9a439eb91820fb4527231a => generated 298 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:07:30.679653 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35df70-2a44-4ad3-a0ac-94328c48983d None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:30.798864 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:30.819737 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a35df70-2a44-4ad3-a0ac-94328c48983d None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:30.863202 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0765bb66-f27f-4739-91ce-9abcdec62e11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:30.863883 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765bb66-f27f-4739-91ce-9abcdec62e11 None admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:30.864162 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765bb66-f27f-4739-91ce-9abcdec62e11 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:30.864472 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0765bb66-f27f-4739-91ce-9abcdec62e11 None admin] PATH_INFO: `/v3/projects/758af4bbce9a439eb91820fb4527231a/groups/16b64e2ef0ca4e57bb35fad474876314/roles/5c52e382f2bc436d95d82f2a2fae8ace` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:30.866679 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765bb66-f27f-4739-91ce-9abcdec62e11 None admin] RBAC: Authorizing `identity:create_grant(project_id=758af4bbce9a439eb91820fb4527231a, group_id=16b64e2ef0ca4e57bb35fad474876314, role_id=5c52e382f2bc436d95d82f2a2fae8ace)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:30.868765 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0765bb66-f27f-4739-91ce-9abcdec62e11 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:30.886447 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 194/394] 10.222.0.15 () {58 vars in 1442 bytes} [Fri Aug 5 02:07:30 2022] PUT /identity/v3/projects/758af4bbce9a439eb91820fb4527231a/groups/16b64e2ef0ca4e57bb35fad474876314/roles/5c52e382f2bc436d95d82f2a2fae8ace => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:07:31.248188 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b1e2d-b71d-478e-95ad-ded052e811d3 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:31.248759 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b1e2d-b71d-478e-95ad-ded052e811d3 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:31.249173 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca7b1e2d-b71d-478e-95ad-ded052e811d3 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:31.251001 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 201/395] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:31.255962 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875042d-d15f-4465-b718-0f7778fdbd89 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:31.256465 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875042d-d15f-4465-b718-0f7778fdbd89 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:31.256894 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b875042d-d15f-4465-b718-0f7778fdbd89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:31.281306 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-b875042d-d15f-4465-b718-0f7778fdbd89 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:31.282715 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-b875042d-d15f-4465-b718-0f7778fdbd89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:31.364462 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 195/396] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:07:31.398415 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b1e2d-b71d-478e-95ad-ded052e811d3 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:31.522197 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca7b1e2d-b71d-478e-95ad-ded052e811d3 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:31.544378 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15467dec-3c7b-4fa5-86f5-9ca866b962c4 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:31.544378 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15467dec-3c7b-4fa5-86f5-9ca866b962c4 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:31.544378 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15467dec-3c7b-4fa5-86f5-9ca866b962c4 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:31.545821 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 196/397] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:31.550271 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf96bff-bb2c-422d-90c6-a0352693eba4 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:31.550664 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf96bff-bb2c-422d-90c6-a0352693eba4 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:31.551003 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf96bff-bb2c-422d-90c6-a0352693eba4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:31.567974 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb20e1-dc87-442c-a118-e2cbc41d28b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:31.574121 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb20e1-dc87-442c-a118-e2cbc41d28b0 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:31.574408 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb20e1-dc87-442c-a118-e2cbc41d28b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:31.574746 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22eb20e1-dc87-442c-a118-e2cbc41d28b0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:31.590232 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-daf96bff-bb2c-422d-90c6-a0352693eba4 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:31.591429 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-daf96bff-bb2c-422d-90c6-a0352693eba4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:31.595230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22eb20e1-dc87-442c-a118-e2cbc41d28b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:31.600976 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-22eb20e1-dc87-442c-a118-e2cbc41d28b0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:07:31.600976 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:31.600976 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:31.600976 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:31.600976 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:31.600976 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:31.600976 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:31.600976 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:31.600976 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:31.600976 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:31.600976 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:31.600976 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:31.600976 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:31.600976 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:31.600976 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:31.600976 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:31.601912 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:31.601912 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:31.601912 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:31.601912 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:31.601912 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:31.601912 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:31.601912 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:31.601912 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:31.601912 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:31.601912 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:31.601912 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:31.601912 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:31.601912 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:31.601912 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:31.601912 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:31.601912 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:31.603064 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:31.603064 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:31.603064 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:31.603064 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:31.603064 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:31.603064 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:31.603064 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:31.603064 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:31.603064 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:31.603064 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:31.603064 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:07:31.603064 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:31.603064 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 202/398] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:07:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:31.610327 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb20e1-dc87-442c-a118-e2cbc41d28b0 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:31.650312 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:31.746509 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22eb20e1-dc87-442c-a118-e2cbc41d28b0 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:31.776699 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 197/399] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:07:31.791044 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa524d9-2255-4c7d-b27d-6e9f382ce6b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:31.791987 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa524d9-2255-4c7d-b27d-6e9f382ce6b6 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:31.792541 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa524d9-2255-4c7d-b27d-6e9f382ce6b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:31.793088 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa524d9-2255-4c7d-b27d-6e9f382ce6b6 None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:31.794008 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa524d9-2255-4c7d-b27d-6e9f382ce6b6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:31.794510 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa524d9-2255-4c7d-b27d-6e9f382ce6b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:31.796138 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa524d9-2255-4c7d-b27d-6e9f382ce6b6 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:31.809231 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 203/400] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Aug 5 02:07:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:31.811239 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf96bff-bb2c-422d-90c6-a0352693eba4 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:31.816586 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:31.822098 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa524d9-2255-4c7d-b27d-6e9f382ce6b6 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:31.941116 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:31.966632 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa524d9-2255-4c7d-b27d-6e9f382ce6b6 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:31.989250 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf96bff-bb2c-422d-90c6-a0352693eba4 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:32.045164 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d337f2b-3c5b-40c6-8a6f-6891be265bf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:32.045970 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb97b3-19f7-4e22-b0bd-5ad39e0af3ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:32.046240 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d337f2b-3c5b-40c6-8a6f-6891be265bf5 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:32.046629 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb97b3-19f7-4e22-b0bd-5ad39e0af3ad None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:32.046843 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d337f2b-3c5b-40c6-8a6f-6891be265bf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:32.046957 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb97b3-19f7-4e22-b0bd-5ad39e0af3ad None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:32.047173 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfb97b3-19f7-4e22-b0bd-5ad39e0af3ad None admin] PATH_INFO: `/v3/groups/16b64e2ef0ca4e57bb35fad474876314` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:32.047494 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d337f2b-3c5b-40c6-8a6f-6891be265bf5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:32.048406 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb97b3-19f7-4e22-b0bd-5ad39e0af3ad None admin] RBAC: Authorizing `identity:get_group(group_id=16b64e2ef0ca4e57bb35fad474876314)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:32.049884 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfb97b3-19f7-4e22-b0bd-5ad39e0af3ad None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:32.051834 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 204/401] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Aug 5 02:07:31 2022] GET /identity/v3/groups/16b64e2ef0ca4e57bb35fad474876314 => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:32.061355 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb97b3-19f7-4e22-b0bd-5ad39e0af3ad None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:32.062092 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d337f2b-3c5b-40c6-8a6f-6891be265bf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:32.067413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-5d337f2b-3c5b-40c6-8a6f-6891be265bf5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:07:32.067413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:32.067413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:32.067413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:32.067413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:32.067413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:32.067413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:32.067413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:32.067413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:32.067413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:32.067413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:32.067413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:32.067413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:32.067413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:32.067413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:32.067413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:32.068526 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:32.068526 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:32.068526 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:32.068526 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:32.068526 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:32.068526 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:32.068526 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:32.068526 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:32.068526 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:32.068526 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:32.068526 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:32.068526 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:32.068526 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:32.068526 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:32.068526 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:32.068526 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:32.069515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:32.069515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:32.069515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:32.069515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:32.069515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:32.069515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:32.069515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:32.069515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:32.069515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:32.069515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:32.069515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:07:32.069515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:32.077250 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 198/402] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Aug 5 02:07:31 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:32.079332 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d337f2b-3c5b-40c6-8a6f-6891be265bf5 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:32.154281 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:32.200449 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d337f2b-3c5b-40c6-8a6f-6891be265bf5 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:32.238842 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1648a6-2ae8-4caf-9a16-213dab68ac4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:32.239706 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1648a6-2ae8-4caf-9a16-213dab68ac4a None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:32.240151 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1648a6-2ae8-4caf-9a16-213dab68ac4a None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:32.240606 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1648a6-2ae8-4caf-9a16-213dab68ac4a None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:32.241469 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1648a6-2ae8-4caf-9a16-213dab68ac4a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:32.242031 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1648a6-2ae8-4caf-9a16-213dab68ac4a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:32.244925 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1648a6-2ae8-4caf-9a16-213dab68ac4a None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:32.259447 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 199/403] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:07:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:32.259447 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ead52-2cff-46a6-a49b-15dd827a9abb None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:32.259447 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ead52-2cff-46a6-a49b-15dd827a9abb None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:32.259447 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9ead52-2cff-46a6-a49b-15dd827a9abb None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:32.260087 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 200/404] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:32.262449 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfb97b3-19f7-4e22-b0bd-5ad39e0af3ad None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:32.264437 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ead52-2cff-46a6-a49b-15dd827a9abb None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:32.310996 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2272df95-717a-47ff-97cb-2c9123d96be9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:32.311980 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272df95-717a-47ff-97cb-2c9123d96be9 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:32.312490 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272df95-717a-47ff-97cb-2c9123d96be9 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:32.313000 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2272df95-717a-47ff-97cb-2c9123d96be9 None admin] PATH_INFO: `/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:32.314368 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2272df95-717a-47ff-97cb-2c9123d96be9 None admin] RBAC: Authorizing `identity:get_project(project_id=4c39c7e842b54d0f8d9c70bc00f480ce)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:32.316961 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2272df95-717a-47ff-97cb-2c9123d96be9 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:32.319231 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 205/405] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:07:32 2022] GET /identity/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:32.320684 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a2dc1-1afe-41d7-b75c-f52fe34e035f None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:32.321853 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a2dc1-1afe-41d7-b75c-f52fe34e035f None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:32.322337 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4a2dc1-1afe-41d7-b75c-f52fe34e035f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:32.343386 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-2c4a2dc1-1afe-41d7-b75c-f52fe34e035f None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:32.345466 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-2c4a2dc1-1afe-41d7-b75c-f52fe34e035f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:32.365993 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:32.397062 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9ead52-2cff-46a6-a49b-15dd827a9abb None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:32.429521 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:32.431514 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 206/406] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:07:32.432793 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a2dc1-1afe-41d7-b75c-f52fe34e035f None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:32.443210 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226da676-5a55-4fe1-912b-35f5d476faa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:32.443867 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226da676-5a55-4fe1-912b-35f5d476faa9 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:32.444160 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226da676-5a55-4fe1-912b-35f5d476faa9 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:32.444459 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-226da676-5a55-4fe1-912b-35f5d476faa9 None admin] PATH_INFO: `/v3/groups/16b64e2ef0ca4e57bb35fad474876314` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:32.445620 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226da676-5a55-4fe1-912b-35f5d476faa9 None admin] RBAC: Authorizing `identity:get_group(group_id=16b64e2ef0ca4e57bb35fad474876314)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:32.448048 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-226da676-5a55-4fe1-912b-35f5d476faa9 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:32.453490 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 201/407] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Aug 5 02:07:32 2022] GET /identity/v3/groups/16b64e2ef0ca4e57bb35fad474876314 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:32.455633 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226da676-5a55-4fe1-912b-35f5d476faa9 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:32.572790 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4a2dc1-1afe-41d7-b75c-f52fe34e035f None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:32.592785 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-226da676-5a55-4fe1-912b-35f5d476faa9 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:32.624711 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717ce33-2da2-417a-a7ea-006462bd3ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:32.625391 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717ce33-2da2-417a-a7ea-006462bd3ffa None admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:32.625676 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717ce33-2da2-417a-a7ea-006462bd3ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:32.625948 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a717ce33-2da2-417a-a7ea-006462bd3ffa None admin] PATH_INFO: `/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce/groups/16b64e2ef0ca4e57bb35fad474876314/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:32.629428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a717ce33-2da2-417a-a7ea-006462bd3ffa None admin] RBAC: Authorizing `identity:create_grant(project_id=4c39c7e842b54d0f8d9c70bc00f480ce, group_id=16b64e2ef0ca4e57bb35fad474876314, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:32.631132 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a717ce33-2da2-417a-a7ea-006462bd3ffa None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:32.652795 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d87b0-08f5-4ed8-850a-ed8a612a802a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:32.653832 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d87b0-08f5-4ed8-850a-ed8a612a802a None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:32.654444 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d87b0-08f5-4ed8-850a-ed8a612a802a None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:32.654790 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 207/408] 10.222.0.15 () {58 vars in 1442 bytes} [Fri Aug 5 02:07:32 2022] PUT /identity/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce/groups/16b64e2ef0ca4e57bb35fad474876314/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:07:32.655324 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d37d87b0-08f5-4ed8-850a-ed8a612a802a None admin] PATH_INFO: `/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:32.655655 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717ce33-2da2-417a-a7ea-006462bd3ffa None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:32.657169 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d87b0-08f5-4ed8-850a-ed8a612a802a None admin] RBAC: Authorizing `identity:get_project(project_id=4c39c7e842b54d0f8d9c70bc00f480ce)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:32.659588 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d37d87b0-08f5-4ed8-850a-ed8a612a802a None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:32.666776 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 202/409] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:07:32 2022] GET /identity/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce => generated 302 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:32.671399 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:32.673609 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d87b0-08f5-4ed8-850a-ed8a612a802a None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:32.775698 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:32.780965 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a717ce33-2da2-417a-a7ea-006462bd3ffa None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:32.820749 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b2ac2-16b2-406d-b089-62285e42a852 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:32.821500 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b2ac2-16b2-406d-b089-62285e42a852 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:32.821783 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b2ac2-16b2-406d-b089-62285e42a852 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:32.822061 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0b2ac2-16b2-406d-b089-62285e42a852 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:32.840594 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0b2ac2-16b2-406d-b089-62285e42a852 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:32.844757 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d37d87b0-08f5-4ed8-850a-ed8a612a802a None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:32.847175 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-bc0b2ac2-16b2-406d-b089-62285e42a852 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:07:32.847175 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:32.847175 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:32.847175 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:32.847175 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:32.847175 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:32.847175 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:32.847175 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:32.847175 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:32.847175 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:32.847175 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:32.847175 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:32.847175 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:32.847175 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:32.847175 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:32.847175 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:32.848317 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:32.848317 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:32.848317 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:32.848317 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:32.848317 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:32.848317 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:32.848317 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:32.848317 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:32.848317 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:32.848317 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:32.848317 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:32.848317 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:32.848317 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:32.848317 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:32.848317 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:32.848317 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:32.849564 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:32.849564 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:32.849564 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:32.849564 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:32.849564 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:32.849564 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:32.849564 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:32.849564 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:32.849564 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:32.849564 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:32.849564 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:07:32.849564 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:32.849564 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 208/410] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Aug 5 02:07:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:32.857267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b2ac2-16b2-406d-b089-62285e42a852 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:32.918019 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc5326-bb6c-4d38-a14f-6b4dbdee1f13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:32.918718 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc5326-bb6c-4d38-a14f-6b4dbdee1f13 None admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:32.918998 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc5326-bb6c-4d38-a14f-6b4dbdee1f13 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:32.919277 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63dc5326-bb6c-4d38-a14f-6b4dbdee1f13 None admin] PATH_INFO: `/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce/groups/16b64e2ef0ca4e57bb35fad474876314/roles/5c52e382f2bc436d95d82f2a2fae8ace` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:32.925028 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc5326-bb6c-4d38-a14f-6b4dbdee1f13 None admin] RBAC: Authorizing `identity:create_grant(project_id=4c39c7e842b54d0f8d9c70bc00f480ce, group_id=16b64e2ef0ca4e57bb35fad474876314, role_id=5c52e382f2bc436d95d82f2a2fae8ace)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:32.926500 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63dc5326-bb6c-4d38-a14f-6b4dbdee1f13 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:32.968220 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 203/411] 10.222.0.15 () {58 vars in 1442 bytes} [Fri Aug 5 02:07:32 2022] PUT /identity/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce/groups/16b64e2ef0ca4e57bb35fad474876314/roles/5c52e382f2bc436d95d82f2a2fae8ace => generated 0 bytes in 296 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:07:32.973762 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:33.009353 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0b2ac2-16b2-406d-b089-62285e42a852 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:33.048691 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3374b8-0302-48a1-90b8-94b473cdeeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:33.049325 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3374b8-0302-48a1-90b8-94b473cdeeb8 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:33.049650 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3374b8-0302-48a1-90b8-94b473cdeeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:33.049940 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3374b8-0302-48a1-90b8-94b473cdeeb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:33.050682 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3374b8-0302-48a1-90b8-94b473cdeeb8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:33.050989 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3374b8-0302-48a1-90b8-94b473cdeeb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:33.052525 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3374b8-0302-48a1-90b8-94b473cdeeb8 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:33.063453 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 209/412] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:07:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:33.068821 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc5326-bb6c-4d38-a14f-6b4dbdee1f13 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:33.183291 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017219bc-af79-4b07-b57d-17f78ebc8e34 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:33.183642 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017219bc-af79-4b07-b57d-17f78ebc8e34 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:33.184143 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-017219bc-af79-4b07-b57d-17f78ebc8e34 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:33.186336 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 210/413] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:07:33.191715 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63dc5326-bb6c-4d38-a14f-6b4dbdee1f13 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:33.194896 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2fc844-bdf8-48ef-adc8-5350ccde710f None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:33.195389 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2fc844-bdf8-48ef-adc8-5350ccde710f None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:33.196416 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2fc844-bdf8-48ef-adc8-5350ccde710f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:33.229777 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-fa2fc844-bdf8-48ef-adc8-5350ccde710f None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:33.231421 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-fa2fc844-bdf8-48ef-adc8-5350ccde710f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:33.231982 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:33.251752 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a08ea-e8d0-45b3-8040-079740d635e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:33.252424 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a08ea-e8d0-45b3-8040-079740d635e5 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:33.252706 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a08ea-e8d0-45b3-8040-079740d635e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:33.252980 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962a08ea-e8d0-45b3-8040-079740d635e5 None admin] PATH_INFO: `/v3/groups/9998f61e2dd742d1a38d56654f52f0c8` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:33.254155 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a08ea-e8d0-45b3-8040-079740d635e5 None admin] RBAC: Authorizing `identity:get_group(group_id=9998f61e2dd742d1a38d56654f52f0c8)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:33.255571 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-962a08ea-e8d0-45b3-8040-079740d635e5 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:33.257551 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 204/414] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Aug 5 02:07:33 2022] GET /identity/v3/groups/9998f61e2dd742d1a38d56654f52f0c8 => generated 229 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:33.263732 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a08ea-e8d0-45b3-8040-079740d635e5 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:33.331281 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 211/415] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:07:33.366397 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2fc844-bdf8-48ef-adc8-5350ccde710f None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:33.431249 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962a08ea-e8d0-45b3-8040-079740d635e5 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:33.485819 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:33.487470 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1152b730-9be1-4afd-8c39-e197e034e048 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:33.488284 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152b730-9be1-4afd-8c39-e197e034e048 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:33.490690 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152b730-9be1-4afd-8c39-e197e034e048 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:33.490690 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1152b730-9be1-4afd-8c39-e197e034e048 None admin] PATH_INFO: `/v3/projects/a0be9d6a2aae470aa8143374d4c4992b` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:33.493197 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1152b730-9be1-4afd-8c39-e197e034e048 None admin] RBAC: Authorizing `identity:get_project(project_id=a0be9d6a2aae470aa8143374d4c4992b)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:33.494909 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1152b730-9be1-4afd-8c39-e197e034e048 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:33.496845 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 205/416] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:07:33 2022] GET /identity/v3/projects/a0be9d6a2aae470aa8143374d4c4992b => generated 344 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:07:33.509561 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1152b730-9be1-4afd-8c39-e197e034e048 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:33.531982 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2fc844-bdf8-48ef-adc8-5350ccde710f None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:33.576822 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec79c3d-8fe3-4ba1-8868-1be08bda4ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:33.577559 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec79c3d-8fe3-4ba1-8868-1be08bda4ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:33.577843 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec79c3d-8fe3-4ba1-8868-1be08bda4ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:33.578122 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec79c3d-8fe3-4ba1-8868-1be08bda4ea8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:33.591060 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:33.608412 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec79c3d-8fe3-4ba1-8868-1be08bda4ea8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:33.615767 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-8ec79c3d-8fe3-4ba1-8868-1be08bda4ea8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:07:33.615767 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:33.615767 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:33.615767 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:33.615767 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:33.615767 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:33.615767 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:33.615767 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:33.615767 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:33.615767 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:33.615767 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:33.615767 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:33.615767 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:33.615767 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:33.615767 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:33.615767 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:33.616667 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:33.616667 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:33.616667 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:33.616667 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:33.616667 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:33.616667 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:33.616667 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:33.616667 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:33.616667 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:33.616667 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:33.616667 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:33.616667 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:33.616667 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:33.616667 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:33.616667 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:33.616667 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:33.618391 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:33.618391 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:33.618391 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:33.618391 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:33.618391 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:33.618391 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:33.618391 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:33.618391 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:33.618391 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:33.618391 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:33.618391 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:07:33.618391 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:33.618391 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 212/417] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:07:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 251 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:07:33.626112 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec79c3d-8fe3-4ba1-8868-1be08bda4ea8 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:33.667453 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1152b730-9be1-4afd-8c39-e197e034e048 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:33.707523 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02cad90-c2a1-4ef3-b399-176b2a68d1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:33.708204 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cad90-c2a1-4ef3-b399-176b2a68d1af None admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:33.708565 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cad90-c2a1-4ef3-b399-176b2a68d1af None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:33.708844 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02cad90-c2a1-4ef3-b399-176b2a68d1af None admin] PATH_INFO: `/v3/projects/a0be9d6a2aae470aa8143374d4c4992b/groups/9998f61e2dd742d1a38d56654f52f0c8/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:33.710790 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02cad90-c2a1-4ef3-b399-176b2a68d1af None admin] RBAC: Authorizing `identity:create_grant(project_id=a0be9d6a2aae470aa8143374d4c4992b, group_id=9998f61e2dd742d1a38d56654f52f0c8, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:33.712405 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02cad90-c2a1-4ef3-b399-176b2a68d1af None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:33.730824 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 206/418] 10.222.0.15 () {58 vars in 1442 bytes} [Fri Aug 5 02:07:33 2022] PUT /identity/v3/projects/a0be9d6a2aae470aa8143374d4c4992b/groups/9998f61e2dd742d1a38d56654f52f0c8/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:07:33.732488 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64aa79e-0109-43d2-ac2d-65399e7b1aef None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:33.732885 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64aa79e-0109-43d2-ac2d-65399e7b1aef None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:33.733232 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64aa79e-0109-43d2-ac2d-65399e7b1aef None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:33.734942 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 207/419] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:33.740947 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2abae9-6c61-4aff-a23a-efbf08267cfa None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:33.741119 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2abae9-6c61-4aff-a23a-efbf08267cfa None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:33.741405 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc2abae9-6c61-4aff-a23a-efbf08267cfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:33.761421 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-cc2abae9-6c61-4aff-a23a-efbf08267cfa None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:33.762821 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-cc2abae9-6c61-4aff-a23a-efbf08267cfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:33.777241 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec79c3d-8fe3-4ba1-8868-1be08bda4ea8 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:33.804507 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:33.819309 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ceac6-0089-4648-9637-98283f77b020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:33.820430 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ceac6-0089-4648-9637-98283f77b020 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:33.821144 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ceac6-0089-4648-9637-98283f77b020 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:33.821682 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5ceac6-0089-4648-9637-98283f77b020 None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:33.822590 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ceac6-0089-4648-9637-98283f77b020 None admin] RBAC: Adding query filter params (name=member) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:33.823129 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ceac6-0089-4648-9637-98283f77b020 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:33.824861 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5ceac6-0089-4648-9637-98283f77b020 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:33.836192 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 213/420] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Aug 5 02:07:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:33.844761 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 208/421] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:07:33.845901 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ceac6-0089-4648-9637-98283f77b020 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:33.870446 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2abae9-6c61-4aff-a23a-efbf08267cfa None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:33.928773 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:33.992875 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc2abae9-6c61-4aff-a23a-efbf08267cfa None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:34.029782 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5ceac6-0089-4648-9637-98283f77b020 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:34.045127 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44fbed-8196-4b3a-9469-73714d8d1f58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:34.045790 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44fbed-8196-4b3a-9469-73714d8d1f58 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:34.046071 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44fbed-8196-4b3a-9469-73714d8d1f58 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:34.046347 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be44fbed-8196-4b3a-9469-73714d8d1f58 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:34.072639 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be44fbed-8196-4b3a-9469-73714d8d1f58 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:34.084936 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-be44fbed-8196-4b3a-9469-73714d8d1f58 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:07:34.084936 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:34.084936 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:34.084936 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:34.084936 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:34.084936 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:34.084936 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:34.084936 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:34.084936 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:34.084936 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:34.084936 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:34.084936 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:34.084936 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:34.084936 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:34.084936 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:34.084936 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:34.085841 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:34.085841 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:34.085841 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:34.085841 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:34.085841 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:34.085841 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:34.085841 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:34.085841 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:34.085841 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:34.085841 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:34.085841 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:34.085841 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:34.085841 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:34.085841 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:34.085841 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:34.085841 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:34.086746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:34.086746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:34.086746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:34.086746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:34.086746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:34.086746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:34.086746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:34.086746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:34.086746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:34.086746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:34.086746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:07:34.086746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:34.092347 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 209/422] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Aug 5 02:07:33 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:34.095451 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4136f87-910b-44ff-a470-ede8cd874d16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:34.096129 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4136f87-910b-44ff-a470-ede8cd874d16 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:34.096440 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4136f87-910b-44ff-a470-ede8cd874d16 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:34.096717 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4136f87-910b-44ff-a470-ede8cd874d16 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:34.099512 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44fbed-8196-4b3a-9469-73714d8d1f58 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:34.159177 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:34.196232 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4136f87-910b-44ff-a470-ede8cd874d16 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:34.199520 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4136f87-910b-44ff-a470-ede8cd874d16 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:34.245671 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be44fbed-8196-4b3a-9469-73714d8d1f58 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:34.261175 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:34.283991 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188dbcba-bf1a-4471-84ab-7fd7d339cdb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:34.284989 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188dbcba-bf1a-4471-84ab-7fd7d339cdb8 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:34.285492 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188dbcba-bf1a-4471-84ab-7fd7d339cdb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:34.285956 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188dbcba-bf1a-4471-84ab-7fd7d339cdb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:34.286866 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188dbcba-bf1a-4471-84ab-7fd7d339cdb8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:34.287361 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188dbcba-bf1a-4471-84ab-7fd7d339cdb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:34.289098 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188dbcba-bf1a-4471-84ab-7fd7d339cdb8 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:34.300114 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 210/423] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:07:34 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:07:34.305404 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188dbcba-bf1a-4471-84ab-7fd7d339cdb8 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:34.416842 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188dbcba-bf1a-4471-84ab-7fd7d339cdb8 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:34.463363 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 214/424] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:07:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:07:34.469028 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4136f87-910b-44ff-a470-ede8cd874d16 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:34.505133 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d4639-c907-4685-8520-5124db7aad22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:34.505691 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d4639-c907-4685-8520-5124db7aad22 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:34.505978 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d4639-c907-4685-8520-5124db7aad22 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:34.506248 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c7d4639-c907-4685-8520-5124db7aad22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:34.566912 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:34.586893 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4136f87-910b-44ff-a470-ede8cd874d16 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:34.603841 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:34.627178 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f21c2c-fe3f-45f7-b82c-a738e891680e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:34.627842 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f21c2c-fe3f-45f7-b82c-a738e891680e None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:34.628089 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f21c2c-fe3f-45f7-b82c-a738e891680e None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:34.628395 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3f21c2c-fe3f-45f7-b82c-a738e891680e None admin] PATH_INFO: `/v3/projects/758af4bbce9a439eb91820fb4527231a` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:34.629554 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f21c2c-fe3f-45f7-b82c-a738e891680e None admin] RBAC: Authorizing `identity:get_project(project_id=758af4bbce9a439eb91820fb4527231a)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:34.630996 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3f21c2c-fe3f-45f7-b82c-a738e891680e None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:34.633135 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 215/425] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:07:34 2022] GET /identity/v3/projects/758af4bbce9a439eb91820fb4527231a => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:34.645277 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f21c2c-fe3f-45f7-b82c-a738e891680e None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:34.667657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7d4639-c907-4685-8520-5124db7aad22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:34.669129 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c7d4639-c907-4685-8520-5124db7aad22 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:34.856307 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3f21c2c-fe3f-45f7-b82c-a738e891680e None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:34.872970 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 211/426] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:07:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 568 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 05 02:07:34.878135 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d4639-c907-4685-8520-5124db7aad22 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:34.924313 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176a034-2502-4be3-94d3-8b77ddac0b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:34.924976 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176a034-2502-4be3-94d3-8b77ddac0b29 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:34.925255 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176a034-2502-4be3-94d3-8b77ddac0b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:34.925531 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176a034-2502-4be3-94d3-8b77ddac0b29 None admin] PATH_INFO: `/v3/groups/16b64e2ef0ca4e57bb35fad474876314` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:34.927486 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176a034-2502-4be3-94d3-8b77ddac0b29 None admin] RBAC: Authorizing `identity:get_group(group_id=16b64e2ef0ca4e57bb35fad474876314)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:34.928971 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176a034-2502-4be3-94d3-8b77ddac0b29 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:34.931910 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 216/427] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Aug 5 02:07:34 2022] GET /identity/v3/groups/16b64e2ef0ca4e57bb35fad474876314 => generated 226 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:34.937513 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176a034-2502-4be3-94d3-8b77ddac0b29 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:34.964144 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:35.001661 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:35.054952 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c7d4639-c907-4685-8520-5124db7aad22 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:35.096272 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60b553-f95f-459f-abe5-543cc97a5135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:35.096864 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60b553-f95f-459f-abe5-543cc97a5135 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:35.097384 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60b553-f95f-459f-abe5-543cc97a5135 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:35.097665 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a60b553-f95f-459f-abe5-543cc97a5135 None admin] PATH_INFO: `/v3/projects/758af4bbce9a439eb91820fb4527231a` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:35.101572 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a60b553-f95f-459f-abe5-543cc97a5135 None admin] RBAC: Authorizing `identity:get_project(project_id=758af4bbce9a439eb91820fb4527231a)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:35.103185 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a60b553-f95f-459f-abe5-543cc97a5135 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:35.106419 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 212/428] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:07:34 2022] GET /identity/v3/projects/758af4bbce9a439eb91820fb4527231a => generated 298 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:07:35.113251 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60b553-f95f-459f-abe5-543cc97a5135 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:35.121580 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176a034-2502-4be3-94d3-8b77ddac0b29 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:35.158166 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1ae61e-dca4-4b1b-a2c7-46abf9af4384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:35.159163 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ae61e-dca4-4b1b-a2c7-46abf9af4384 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:35.159687 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ae61e-dca4-4b1b-a2c7-46abf9af4384 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:35.160166 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1ae61e-dca4-4b1b-a2c7-46abf9af4384 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:35.161245 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ae61e-dca4-4b1b-a2c7-46abf9af4384 None admin] RBAC: Adding query filter params (group.id=16b64e2ef0ca4e57bb35fad474876314, role.id=33cd9c7fcf9b4bbe9d604952279e8d76, scope.project.id=758af4bbce9a439eb91820fb4527231a) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:35.161823 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ae61e-dca4-4b1b-a2c7-46abf9af4384 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:35.163546 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f1ae61e-dca4-4b1b-a2c7-46abf9af4384 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:35.170971 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 217/429] 10.222.0.15 () {56 vars in 1376 bytes} [Fri Aug 5 02:07:34 2022] GET /identity/v3/role_assignments?group.id=16b64e2ef0ca4e57bb35fad474876314&scope.project.id=758af4bbce9a439eb91820fb4527231a&role.id=33cd9c7fcf9b4bbe9d604952279e8d76 => generated 611 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:35.263084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a60b553-f95f-459f-abe5-543cc97a5135 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:35.294581 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a082f-26c3-4075-bf4d-dd910dff77a4 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:35.295240 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a082f-26c3-4075-bf4d-dd910dff77a4 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:35.295741 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886a082f-26c3-4075-bf4d-dd910dff77a4 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:35.297769 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 218/430] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:07:35.306004 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091d013-aeec-426f-8569-fde54a9ca13e None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:35.306308 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091d013-aeec-426f-8569-fde54a9ca13e None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:35.306560 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9091d013-aeec-426f-8569-fde54a9ca13e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:35.310239 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc743c6-88da-4c14-a87b-1c5bc4770ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:35.310898 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc743c6-88da-4c14-a87b-1c5bc4770ea5 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:35.311183 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc743c6-88da-4c14-a87b-1c5bc4770ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:35.311459 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc743c6-88da-4c14-a87b-1c5bc4770ea5 None admin] PATH_INFO: `/v3/groups/16b64e2ef0ca4e57bb35fad474876314` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:35.312703 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc743c6-88da-4c14-a87b-1c5bc4770ea5 None admin] RBAC: Authorizing `identity:get_group(group_id=16b64e2ef0ca4e57bb35fad474876314)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:35.314174 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc743c6-88da-4c14-a87b-1c5bc4770ea5 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:35.316158 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 213/431] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Aug 5 02:07:35 2022] GET /identity/v3/groups/16b64e2ef0ca4e57bb35fad474876314 => generated 226 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:35.322810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc743c6-88da-4c14-a87b-1c5bc4770ea5 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:35.332280 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:35.349719 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-9091d013-aeec-426f-8569-fde54a9ca13e None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:35.351011 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-9091d013-aeec-426f-8569-fde54a9ca13e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:35.428869 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 219/432] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:07:35.429064 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc743c6-88da-4c14-a87b-1c5bc4770ea5 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:35.452811 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091d013-aeec-426f-8569-fde54a9ca13e None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:35.466406 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dff72c-af4f-468a-b743-ea944abe0e69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:35.467064 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dff72c-af4f-468a-b743-ea944abe0e69 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:35.467343 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dff72c-af4f-468a-b743-ea944abe0e69 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:35.467711 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dff72c-af4f-468a-b743-ea944abe0e69 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:35.468532 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dff72c-af4f-468a-b743-ea944abe0e69 None admin] RBAC: Adding query filter params (group.id=16b64e2ef0ca4e57bb35fad474876314, role.id=5c52e382f2bc436d95d82f2a2fae8ace, scope.project.id=758af4bbce9a439eb91820fb4527231a) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:35.468839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dff72c-af4f-468a-b743-ea944abe0e69 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:35.470418 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dff72c-af4f-468a-b743-ea944abe0e69 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:35.471169 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:35.482333 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 214/433] 10.222.0.15 () {56 vars in 1376 bytes} [Fri Aug 5 02:07:35 2022] GET /identity/v3/role_assignments?group.id=16b64e2ef0ca4e57bb35fad474876314&scope.project.id=758af4bbce9a439eb91820fb4527231a&role.id=5c52e382f2bc436d95d82f2a2fae8ace => generated 611 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:07:35.550885 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910ffdd-a324-42fe-a328-4430bbd24380 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:35.551165 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910ffdd-a324-42fe-a328-4430bbd24380 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:35.551445 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b910ffdd-a324-42fe-a328-4430bbd24380 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:35.554177 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 215/434] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:07:35.559742 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841d56b-ec4d-4547-a0ff-bfb7a1700d0d None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:35.560024 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841d56b-ec4d-4547-a0ff-bfb7a1700d0d None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:35.560382 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d841d56b-ec4d-4547-a0ff-bfb7a1700d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:35.579470 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9091d013-aeec-426f-8569-fde54a9ca13e None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:35.582116 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-d841d56b-ec4d-4547-a0ff-bfb7a1700d0d None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:35.583311 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-d841d56b-ec4d-4547-a0ff-bfb7a1700d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:35.633883 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da179f90-2d3a-4383-9db2-ba84c06b2c93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:35.634549 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da179f90-2d3a-4383-9db2-ba84c06b2c93 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:35.634758 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da179f90-2d3a-4383-9db2-ba84c06b2c93 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:35.635359 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da179f90-2d3a-4383-9db2-ba84c06b2c93 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:35.651979 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da179f90-2d3a-4383-9db2-ba84c06b2c93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:35.659316 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-da179f90-2d3a-4383-9db2-ba84c06b2c93 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:07:35.659316 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:35.659316 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:35.659316 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:35.659316 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:35.659316 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:35.659316 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:35.659316 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:35.659316 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:35.659316 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:35.659316 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:35.659316 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:35.659316 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:35.659316 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:35.659316 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:35.659316 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:35.661500 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:35.661500 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:35.661500 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:35.661500 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:35.661500 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:35.661500 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:35.661500 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:35.661500 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:35.661500 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:35.661500 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:35.661500 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:35.661500 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:35.661500 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:35.661500 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:35.661500 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:35.661500 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:35.662741 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:35.662741 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:35.662741 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:35.662741 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:35.662741 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:35.662741 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:35.662741 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:35.662741 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:35.662741 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:35.662741 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:35.662741 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 05 02:07:35.662741 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:35.662741 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 220/435] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:07:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:07:35.663541 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:35.675479 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da179f90-2d3a-4383-9db2-ba84c06b2c93 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:35.675711 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 216/436] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:07:35.698780 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841d56b-ec4d-4547-a0ff-bfb7a1700d0d None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:35.767103 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:35.806085 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da179f90-2d3a-4383-9db2-ba84c06b2c93 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:35.827331 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d841d56b-ec4d-4547-a0ff-bfb7a1700d0d None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:35.861699 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79160e4-3af0-4d71-9caa-c8605a044287 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:35.862343 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79160e4-3af0-4d71-9caa-c8605a044287 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:35.862620 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79160e4-3af0-4d71-9caa-c8605a044287 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:35.862890 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79160e4-3af0-4d71-9caa-c8605a044287 None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:35.863613 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79160e4-3af0-4d71-9caa-c8605a044287 None admin] RBAC: Adding query filter params (name=member) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:35.863910 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79160e4-3af0-4d71-9caa-c8605a044287 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:35.865827 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79160e4-3af0-4d71-9caa-c8605a044287 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:35.876905 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 221/437] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Aug 5 02:07:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:35.883167 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79160e4-3af0-4d71-9caa-c8605a044287 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:35.887120 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3803b-149c-48fd-807c-2bea84a4f237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:35.887727 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3803b-149c-48fd-807c-2bea84a4f237 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:35.888005 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3803b-149c-48fd-807c-2bea84a4f237 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:35.888275 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29c3803b-149c-48fd-807c-2bea84a4f237 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:35.900534 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29c3803b-149c-48fd-807c-2bea84a4f237 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:35.905595 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-29c3803b-149c-48fd-807c-2bea84a4f237 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:07:35.905595 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:35.905595 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:35.905595 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:35.905595 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:35.905595 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:35.905595 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:35.905595 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:35.905595 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:35.905595 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:35.905595 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:35.905595 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:35.905595 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:35.905595 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:35.905595 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:35.905595 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:35.906473 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:35.906473 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:35.906473 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:35.906473 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:35.906473 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:35.906473 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:35.906473 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:35.906473 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:35.906473 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:35.906473 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:35.906473 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:35.906473 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:35.906473 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:35.906473 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:35.906473 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:35.906473 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:35.907264 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:35.907264 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:35.907264 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:35.907264 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:35.907264 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:35.907264 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:35.907264 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:35.907264 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:35.907264 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:35.907264 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:35.907264 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:07:35.907264 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:35.907264 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 217/438] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Aug 5 02:07:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:07:35.916608 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3803b-149c-48fd-807c-2bea84a4f237 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:36.012870 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:36.020237 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79160e4-3af0-4d71-9caa-c8605a044287 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:36.063764 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29c3803b-149c-48fd-807c-2bea84a4f237 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:36.064655 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc32635-013a-4cc2-925e-0e37225da76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:36.065435 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc32635-013a-4cc2-925e-0e37225da76a None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:36.065889 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc32635-013a-4cc2-925e-0e37225da76a None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:36.066338 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc32635-013a-4cc2-925e-0e37225da76a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:36.071326 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:36.107930 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24437dc8-d8e9-4b46-8b1d-99cc5b21bd25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:36.108615 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24437dc8-d8e9-4b46-8b1d-99cc5b21bd25 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:36.108899 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24437dc8-d8e9-4b46-8b1d-99cc5b21bd25 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:36.109171 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24437dc8-d8e9-4b46-8b1d-99cc5b21bd25 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:36.110056 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24437dc8-d8e9-4b46-8b1d-99cc5b21bd25 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:36.110367 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24437dc8-d8e9-4b46-8b1d-99cc5b21bd25 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:36.111782 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24437dc8-d8e9-4b46-8b1d-99cc5b21bd25 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:36.123246 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 218/439] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:07:35 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:36.129339 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24437dc8-d8e9-4b46-8b1d-99cc5b21bd25 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:36.151942 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc32635-013a-4cc2-925e-0e37225da76a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:36.153460 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc32635-013a-4cc2-925e-0e37225da76a None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:36.237906 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24437dc8-d8e9-4b46-8b1d-99cc5b21bd25 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:36.257090 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 222/440] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:07:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:07:36.262394 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd815db0-84cd-4071-b7ff-09e4210eaedb None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:36.262684 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd815db0-84cd-4071-b7ff-09e4210eaedb None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:36.262958 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd815db0-84cd-4071-b7ff-09e4210eaedb None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:36.264259 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 223/441] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:07:36.264970 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd815db0-84cd-4071-b7ff-09e4210eaedb None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:36.265412 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:36.279060 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c2388-8c35-4908-84a3-2c9fa6a77dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:36.279694 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c2388-8c35-4908-84a3-2c9fa6a77dfa None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:36.279969 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c2388-8c35-4908-84a3-2c9fa6a77dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:36.280241 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97c2388-8c35-4908-84a3-2c9fa6a77dfa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:36.301231 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:36.348542 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97c2388-8c35-4908-84a3-2c9fa6a77dfa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:36.349977 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97c2388-8c35-4908-84a3-2c9fa6a77dfa None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:36.365243 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd815db0-84cd-4071-b7ff-09e4210eaedb None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:36.398538 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8ef3361-e455-4baf-9630-1976cb4e6ca7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:36.399333 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef3361-e455-4baf-9630-1976cb4e6ca7 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:36.399606 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef3361-e455-4baf-9630-1976cb4e6ca7 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:36.399877 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8ef3361-e455-4baf-9630-1976cb4e6ca7 None admin] PATH_INFO: `/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:36.401000 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef3361-e455-4baf-9630-1976cb4e6ca7 None admin] RBAC: Authorizing `identity:get_project(project_id=4c39c7e842b54d0f8d9c70bc00f480ce)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:36.402467 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8ef3361-e455-4baf-9630-1976cb4e6ca7 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:36.404052 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 224/442] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:07:36 2022] GET /identity/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce => generated 302 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:36.405242 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e25b78-7e0e-47f0-a5e6-d69b4c6ef2b1 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:36.405524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e25b78-7e0e-47f0-a5e6-d69b4c6ef2b1 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:36.405797 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e25b78-7e0e-47f0-a5e6-d69b4c6ef2b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:36.423720 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-c0e25b78-7e0e-47f0-a5e6-d69b4c6ef2b1 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:36.424933 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-c0e25b78-7e0e-47f0-a5e6-d69b4c6ef2b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:36.448024 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 219/443] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:07:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:07:36.448890 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c2388-8c35-4908-84a3-2c9fa6a77dfa None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:36.471212 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:36.495782 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 225/444] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:07:36.496838 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e25b78-7e0e-47f0-a5e6-d69b4c6ef2b1 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:36.531882 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:36.553323 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97c2388-8c35-4908-84a3-2c9fa6a77dfa None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:36.588094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8f518-17c9-49f3-b6c5-17e5359b03e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:36.588756 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8f518-17c9-49f3-b6c5-17e5359b03e4 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:36.589033 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8f518-17c9-49f3-b6c5-17e5359b03e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:36.589308 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef8f518-17c9-49f3-b6c5-17e5359b03e4 None admin] PATH_INFO: `/v3/groups/16b64e2ef0ca4e57bb35fad474876314` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:36.590444 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef8f518-17c9-49f3-b6c5-17e5359b03e4 None admin] RBAC: Authorizing `identity:get_group(group_id=16b64e2ef0ca4e57bb35fad474876314)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:36.591861 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef8f518-17c9-49f3-b6c5-17e5359b03e4 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:36.593467 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 220/445] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Aug 5 02:07:36 2022] GET /identity/v3/groups/16b64e2ef0ca4e57bb35fad474876314 => generated 226 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:36.594217 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8f518-17c9-49f3-b6c5-17e5359b03e4 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:36.601546 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e25b78-7e0e-47f0-a5e6-d69b4c6ef2b1 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:36.635548 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f5e03-2637-4ff0-836a-875c66424cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:36.636189 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f5e03-2637-4ff0-836a-875c66424cda None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:36.636463 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f5e03-2637-4ff0-836a-875c66424cda None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:36.636736 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba8f5e03-2637-4ff0-836a-875c66424cda None admin] PATH_INFO: `/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:36.638166 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f5e03-2637-4ff0-836a-875c66424cda None admin] RBAC: Authorizing `identity:get_project(project_id=4c39c7e842b54d0f8d9c70bc00f480ce)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:36.639305 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba8f5e03-2637-4ff0-836a-875c66424cda None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:36.640983 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 226/446] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:07:36 2022] GET /identity/v3/projects/4c39c7e842b54d0f8d9c70bc00f480ce => generated 302 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:36.641735 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f5e03-2637-4ff0-836a-875c66424cda None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:36.685145 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:36.695345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef8f518-17c9-49f3-b6c5-17e5359b03e4 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:36.731286 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9318fe-13c5-468c-9238-2c731ca21c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:36.731929 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9318fe-13c5-468c-9238-2c731ca21c89 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:36.732207 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9318fe-13c5-468c-9238-2c731ca21c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:36.732514 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d9318fe-13c5-468c-9238-2c731ca21c89 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:36.742076 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba8f5e03-2637-4ff0-836a-875c66424cda None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:36.744218 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:36.744423 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d9318fe-13c5-468c-9238-2c731ca21c89 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:36.749577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-9d9318fe-13c5-468c-9238-2c731ca21c89 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:07:36.749577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:36.749577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:36.749577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:36.749577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:36.749577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:36.749577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:36.749577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:36.749577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:36.749577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:36.749577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:36.749577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:36.749577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:36.749577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:36.749577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:36.749577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:36.750634 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:36.750634 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:36.750634 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:36.750634 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:36.750634 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:36.750634 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:36.750634 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:36.750634 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:36.750634 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:36.750634 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:36.750634 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:36.750634 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:36.750634 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:36.750634 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:36.750634 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:36.750634 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:36.751426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:36.751426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:36.751426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:36.751426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:36.751426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:36.751426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:36.751426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:36.751426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:36.751426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:36.751426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:36.751426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:07:36.751426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:36.751426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 221/447] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Aug 5 02:07:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:36.752075 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9318fe-13c5-468c-9238-2c731ca21c89 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:36.782830 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e144e6a-b4c9-4326-bd51-6cecb45a2ed2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:36.783468 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e144e6a-b4c9-4326-bd51-6cecb45a2ed2 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:36.783748 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e144e6a-b4c9-4326-bd51-6cecb45a2ed2 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:36.784024 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e144e6a-b4c9-4326-bd51-6cecb45a2ed2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:36.788361 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e144e6a-b4c9-4326-bd51-6cecb45a2ed2 None admin] RBAC: Adding query filter params (group.id=16b64e2ef0ca4e57bb35fad474876314, role.id=33cd9c7fcf9b4bbe9d604952279e8d76, scope.project.id=4c39c7e842b54d0f8d9c70bc00f480ce) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:36.788361 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e144e6a-b4c9-4326-bd51-6cecb45a2ed2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:36.788361 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e144e6a-b4c9-4326-bd51-6cecb45a2ed2 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:36.799533 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 227/448] 10.222.0.15 () {56 vars in 1376 bytes} [Fri Aug 5 02:07:36 2022] GET /identity/v3/role_assignments?group.id=16b64e2ef0ca4e57bb35fad474876314&scope.project.id=4c39c7e842b54d0f8d9c70bc00f480ce&role.id=33cd9c7fcf9b4bbe9d604952279e8d76 => generated 611 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:36.800417 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e144e6a-b4c9-4326-bd51-6cecb45a2ed2 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:36.877356 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d9318fe-13c5-468c-9238-2c731ca21c89 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:36.917769 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10dff8e-c3ca-4b72-bb27-1023998dfb50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:36.918578 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10dff8e-c3ca-4b72-bb27-1023998dfb50 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:36.918876 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10dff8e-c3ca-4b72-bb27-1023998dfb50 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:36.919151 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10dff8e-c3ca-4b72-bb27-1023998dfb50 None admin] PATH_INFO: `/v3/groups/16b64e2ef0ca4e57bb35fad474876314` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:36.920982 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10dff8e-c3ca-4b72-bb27-1023998dfb50 None admin] RBAC: Authorizing `identity:get_group(group_id=16b64e2ef0ca4e57bb35fad474876314)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:36.922170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e144e6a-b4c9-4326-bd51-6cecb45a2ed2 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:36.922550 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10dff8e-c3ca-4b72-bb27-1023998dfb50 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:36.929195 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 222/449] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Aug 5 02:07:36 2022] GET /identity/v3/groups/16b64e2ef0ca4e57bb35fad474876314 => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:36.931467 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10dff8e-c3ca-4b72-bb27-1023998dfb50 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:36.952409 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:36.963517 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043be05-024b-4aeb-b10b-383b2a99001f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:36.964242 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043be05-024b-4aeb-b10b-383b2a99001f None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:36.964561 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043be05-024b-4aeb-b10b-383b2a99001f None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:36.964841 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043be05-024b-4aeb-b10b-383b2a99001f None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:36.965817 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043be05-024b-4aeb-b10b-383b2a99001f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:36.965946 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043be05-024b-4aeb-b10b-383b2a99001f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:36.967222 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043be05-024b-4aeb-b10b-383b2a99001f None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:36.978877 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 228/450] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:07:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:36.984318 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043be05-024b-4aeb-b10b-383b2a99001f None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:37.016677 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:37.048895 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10dff8e-c3ca-4b72-bb27-1023998dfb50 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:37.090729 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c230756-3a1f-4afe-811f-e3b6bb5cc6fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:37.091363 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c230756-3a1f-4afe-811f-e3b6bb5cc6fd None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:37.092198 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c230756-3a1f-4afe-811f-e3b6bb5cc6fd None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:37.092198 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c230756-3a1f-4afe-811f-e3b6bb5cc6fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:37.092741 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c230756-3a1f-4afe-811f-e3b6bb5cc6fd None admin] RBAC: Adding query filter params (group.id=16b64e2ef0ca4e57bb35fad474876314, role.id=5c52e382f2bc436d95d82f2a2fae8ace, scope.project.id=4c39c7e842b54d0f8d9c70bc00f480ce) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:37.093049 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c230756-3a1f-4afe-811f-e3b6bb5cc6fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:37.094508 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c230756-3a1f-4afe-811f-e3b6bb5cc6fd None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:37.102659 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 223/451] 10.222.0.15 () {56 vars in 1376 bytes} [Fri Aug 5 02:07:36 2022] GET /identity/v3/role_assignments?group.id=16b64e2ef0ca4e57bb35fad474876314&scope.project.id=4c39c7e842b54d0f8d9c70bc00f480ce&role.id=5c52e382f2bc436d95d82f2a2fae8ace => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:37.110470 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043be05-024b-4aeb-b10b-383b2a99001f None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:37.153470 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac1024-0d35-48d4-81e3-eca25ca0a1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:37.154111 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac1024-0d35-48d4-81e3-eca25ca0a1e3 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:37.154393 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac1024-0d35-48d4-81e3-eca25ca0a1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:37.154668 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ac1024-0d35-48d4-81e3-eca25ca0a1e3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:37.242334 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ac1024-0d35-48d4-81e3-eca25ca0a1e3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:37.245081 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ac1024-0d35-48d4-81e3-eca25ca0a1e3 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:37.276638 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:37.358779 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 229/452] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:07:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 05 02:07:37.364904 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c230756-3a1f-4afe-811f-e3b6bb5cc6fd None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:37.457756 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:37.482798 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c230756-3a1f-4afe-811f-e3b6bb5cc6fd None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:37.537005 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312a366-8f9c-4d7d-b186-a86cc73053d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:37.538600 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312a366-8f9c-4d7d-b186-a86cc73053d5 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:37.538882 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312a366-8f9c-4d7d-b186-a86cc73053d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:37.540669 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312a366-8f9c-4d7d-b186-a86cc73053d5 None admin] PATH_INFO: `/v3/projects/a0be9d6a2aae470aa8143374d4c4992b` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:37.541851 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c312a366-8f9c-4d7d-b186-a86cc73053d5 None admin] RBAC: Authorizing `identity:get_project(project_id=a0be9d6a2aae470aa8143374d4c4992b)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:37.543265 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c312a366-8f9c-4d7d-b186-a86cc73053d5 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:37.545034 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 224/453] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:07:37 2022] GET /identity/v3/projects/a0be9d6a2aae470aa8143374d4c4992b => generated 344 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:37.550808 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac1024-0d35-48d4-81e3-eca25ca0a1e3 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:37.656409 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ac1024-0d35-48d4-81e3-eca25ca0a1e3 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:37.683694 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:37.691748 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29d8cf7-0d29-49fa-bb0b-fdef4cf27a2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:37.692415 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d8cf7-0d29-49fa-bb0b-fdef4cf27a2a None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:37.692700 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d8cf7-0d29-49fa-bb0b-fdef4cf27a2a None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:37.692977 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29d8cf7-0d29-49fa-bb0b-fdef4cf27a2a None admin] PATH_INFO: `/v3/groups/9998f61e2dd742d1a38d56654f52f0c8` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:37.694105 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29d8cf7-0d29-49fa-bb0b-fdef4cf27a2a None admin] RBAC: Authorizing `identity:get_group(group_id=9998f61e2dd742d1a38d56654f52f0c8)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:37.696096 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29d8cf7-0d29-49fa-bb0b-fdef4cf27a2a None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:37.697893 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 230/454] 10.222.0.15 () {56 vars in 1180 bytes} [Fri Aug 5 02:07:37 2022] GET /identity/v3/groups/9998f61e2dd742d1a38d56654f52f0c8 => generated 229 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:37.704737 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312a366-8f9c-4d7d-b186-a86cc73053d5 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:37.805258 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312a366-8f9c-4d7d-b186-a86cc73053d5 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:37.842532 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f79884-8235-4a5d-b2ef-f1d603184588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:37.843158 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f79884-8235-4a5d-b2ef-f1d603184588 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:37.843435 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f79884-8235-4a5d-b2ef-f1d603184588 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:37.843777 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f79884-8235-4a5d-b2ef-f1d603184588 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:37.845236 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f79884-8235-4a5d-b2ef-f1d603184588 None admin] RBAC: Adding query filter params (group.id=9998f61e2dd742d1a38d56654f52f0c8, role.id=e1b75d5eea2a43b2b1b14cf0515350fa, scope.project.id=a0be9d6a2aae470aa8143374d4c4992b) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:37.845674 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f79884-8235-4a5d-b2ef-f1d603184588 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:37.847348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f79884-8235-4a5d-b2ef-f1d603184588 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:37.854377 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 225/455] 10.222.0.15 () {56 vars in 1376 bytes} [Fri Aug 5 02:07:37 2022] GET /identity/v3/role_assignments?group.id=9998f61e2dd742d1a38d56654f52f0c8&scope.project.id=a0be9d6a2aae470aa8143374d4c4992b&role.id=e1b75d5eea2a43b2b1b14cf0515350fa => generated 611 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:40.296855 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52101a-c70c-4e25-a648-26f27d16fe91 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:40.297373 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52101a-c70c-4e25-a648-26f27d16fe91 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:40.297373 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52101a-c70c-4e25-a648-26f27d16fe91 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:40.299010 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 231/456] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:40.303811 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642de94e-5eaf-4e23-8c2c-78a94fbf31cc None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:40.304222 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642de94e-5eaf-4e23-8c2c-78a94fbf31cc None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:40.304406 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642de94e-5eaf-4e23-8c2c-78a94fbf31cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:40.323580 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-642de94e-5eaf-4e23-8c2c-78a94fbf31cc None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:40.328855 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-642de94e-5eaf-4e23-8c2c-78a94fbf31cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:40.339590 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:40.403088 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8a00c-f0ef-4157-97d5-7ccee303a35f None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:40.403433 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8a00c-f0ef-4157-97d5-7ccee303a35f None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:40.403652 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b8a00c-f0ef-4157-97d5-7ccee303a35f None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:40.405275 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 232/457] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:40.411453 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ecc17-6619-4490-8c19-c5d083bd5dc9 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:40.411743 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ecc17-6619-4490-8c19-c5d083bd5dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:40.412021 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d04ecc17-6619-4490-8c19-c5d083bd5dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:40.412227 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 226/458] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:07:40.437776 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642de94e-5eaf-4e23-8c2c-78a94fbf31cc None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:40.451995 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-d04ecc17-6619-4490-8c19-c5d083bd5dc9 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:40.454400 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-d04ecc17-6619-4490-8c19-c5d083bd5dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:40.594598 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 233/459] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:07:40.603905 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642de94e-5eaf-4e23-8c2c-78a94fbf31cc None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:40.613587 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8beba-852b-445f-8e0c-e4e34bfb4204 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:40.613873 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8beba-852b-445f-8e0c-e4e34bfb4204 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:40.614143 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc8beba-852b-445f-8e0c-e4e34bfb4204 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:40.615732 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 234/460] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:07:40.620820 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd397a-bd1e-4f81-be87-e1ba711c4285 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:40.621105 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd397a-bd1e-4f81-be87-e1ba711c4285 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:40.621381 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bd397a-bd1e-4f81-be87-e1ba711c4285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:40.639560 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-02bd397a-bd1e-4f81-be87-e1ba711c4285 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:40.640771 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-02bd397a-bd1e-4f81-be87-e1ba711c4285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:40.649784 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0435132-6a8c-4430-8ad7-7e5344ef90c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:40.650437 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0435132-6a8c-4430-8ad7-7e5344ef90c7 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:40.650715 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0435132-6a8c-4430-8ad7-7e5344ef90c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:40.650988 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0435132-6a8c-4430-8ad7-7e5344ef90c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:40.661271 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0435132-6a8c-4430-8ad7-7e5344ef90c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:40.662714 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0435132-6a8c-4430-8ad7-7e5344ef90c7 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:40.666222 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:40.679826 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-e0435132-6a8c-4430-8ad7-7e5344ef90c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:40.679826 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:40.679826 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:40.679826 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:40.679826 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:40.679826 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:40.679826 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:40.679826 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:40.679826 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:40.679826 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:40.679826 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:40.679826 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:40.679826 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:07:40.679826 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:07:40.679826 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:07:40.680939 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:07:40.680939 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:40.680939 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:40.680939 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:40.680939 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:40.680939 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:40.680939 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:40.680939 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:40.680939 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:40.680939 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:40.680939 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:40.680939 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:40.680939 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:40.680939 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:40.680939 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:40.680939 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:40.680939 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:40.682043 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:07:40.682043 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:07:40.682043 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:40.682043 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:40.682043 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 227/461] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:07:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:07:40.682446 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0435132-6a8c-4430-8ad7-7e5344ef90c7 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:40.724394 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 235/462] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:07:40.725395 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd397a-bd1e-4f81-be87-e1ba711c4285 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:40.788756 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:40.816129 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0435132-6a8c-4430-8ad7-7e5344ef90c7 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:40.838207 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bd397a-bd1e-4f81-be87-e1ba711c4285 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:40.860262 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1854f-bf21-4fdd-b11d-3c736348c93f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:40.861159 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1854f-bf21-4fdd-b11d-3c736348c93f None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:40.861606 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1854f-bf21-4fdd-b11d-3c736348c93f None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:40.862150 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f1854f-bf21-4fdd-b11d-3c736348c93f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:40.876397 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f1854f-bf21-4fdd-b11d-3c736348c93f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:40.877882 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f1854f-bf21-4fdd-b11d-3c736348c93f None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:40.887824 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3882c9-f69d-447c-bbbb-4930d1ccdbf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:40.889046 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3882c9-f69d-447c-bbbb-4930d1ccdbf4 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:40.889333 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3882c9-f69d-447c-bbbb-4930d1ccdbf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:40.889612 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3882c9-f69d-447c-bbbb-4930d1ccdbf4 None admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:40.890324 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3882c9-f69d-447c-bbbb-4930d1ccdbf4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:40.890630 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3882c9-f69d-447c-bbbb-4930d1ccdbf4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:40.892005 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3882c9-f69d-447c-bbbb-4930d1ccdbf4 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:40.897370 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-c8f1854f-bf21-4fdd-b11d-3c736348c93f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:40.897370 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:40.897370 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:40.897370 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:40.897370 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:40.897370 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:40.897370 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:40.897370 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:40.897370 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:40.897370 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:40.897370 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:40.897370 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:40.897370 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:07:40.897370 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:07:40.897370 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:07:40.898210 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:07:40.898210 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:40.898210 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:40.898210 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:40.898210 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:40.898210 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:40.898210 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:40.898210 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:40.898210 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:40.898210 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:40.898210 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:40.898210 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:40.898210 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:40.898210 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:40.898210 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:40.898210 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:40.898210 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:40.899818 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:07:40.899818 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:07:40.899818 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:40.899818 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:40.901905 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 228/463] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:07:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:40.903283 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1854f-bf21-4fdd-b11d-3c736348c93f None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:40.910212 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 236/464] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:07:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:40.911427 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3882c9-f69d-447c-bbbb-4930d1ccdbf4 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:40.965888 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:41.024853 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f1854f-bf21-4fdd-b11d-3c736348c93f None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:41.035120 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3882c9-f69d-447c-bbbb-4930d1ccdbf4 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:41.056183 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:41.063599 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf702f7-422d-462c-9af5-58005c1cf674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:41.065399 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf702f7-422d-462c-9af5-58005c1cf674 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:41.065891 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf702f7-422d-462c-9af5-58005c1cf674 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:41.066369 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf702f7-422d-462c-9af5-58005c1cf674 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:41.077799 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a3c2e-c7b7-4abf-b01b-60b9f3c3de5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:41.078681 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a3c2e-c7b7-4abf-b01b-60b9f3c3de5a None admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:41.078968 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a3c2e-c7b7-4abf-b01b-60b9f3c3de5a None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:41.079244 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5a3c2e-c7b7-4abf-b01b-60b9f3c3de5a None admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:41.079895 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf702f7-422d-462c-9af5-58005c1cf674 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:41.080018 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a3c2e-c7b7-4abf-b01b-60b9f3c3de5a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:41.081365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5a3c2e-c7b7-4abf-b01b-60b9f3c3de5a None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:41.081949 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf702f7-422d-462c-9af5-58005c1cf674 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:41.101104 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-9bf702f7-422d-462c-9af5-58005c1cf674 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:41.101104 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:41.101104 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:41.101104 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:41.101104 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:41.101104 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:41.101104 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:41.101104 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:41.101104 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:41.101104 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:41.101104 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:41.101104 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:41.101104 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:07:41.101104 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:07:41.101104 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:07:41.102234 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:07:41.102234 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:41.102234 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:41.102234 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:41.102234 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:41.102234 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:41.102234 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:41.102234 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:41.102234 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:41.102234 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:41.102234 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:41.102234 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:41.102234 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:41.102234 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:41.102234 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:41.102234 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:41.102234 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:41.103070 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:07:41.103070 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:07:41.103070 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:41.103070 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:41.105094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 229/465] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:07:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:41.106090 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf702f7-422d-462c-9af5-58005c1cf674 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:41.112456 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 237/466] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Aug 5 02:07:40 2022] POST /identity/v3/users => generated 246 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:07:41.112456 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a3c2e-c7b7-4abf-b01b-60b9f3c3de5a None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:41.228205 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5a3c2e-c7b7-4abf-b01b-60b9f3c3de5a None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:41.270199 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ee93b47-c896-4660-a9a0-6d78ee5016d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:41.270829 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee93b47-c896-4660-a9a0-6d78ee5016d1 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:41.271836 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee93b47-c896-4660-a9a0-6d78ee5016d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:41.272117 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee93b47-c896-4660-a9a0-6d78ee5016d1 None admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:41.272869 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee93b47-c896-4660-a9a0-6d78ee5016d1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:41.273227 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee93b47-c896-4660-a9a0-6d78ee5016d1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:41.275660 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ee93b47-c896-4660-a9a0-6d78ee5016d1 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:41.276219 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:41.280464 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf702f7-422d-462c-9af5-58005c1cf674 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:41.294272 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 238/467] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:07:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:41.295759 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3e26d-a380-4226-853e-2d5c95177352 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:41.296046 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3e26d-a380-4226-853e-2d5c95177352 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:41.296341 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d3e26d-a380-4226-853e-2d5c95177352 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:41.302338 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 239/468] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:41.303739 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0387dec-c1e7-46b9-8e39-566a76d563f6 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:41.304019 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0387dec-c1e7-46b9-8e39-566a76d563f6 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:41.304290 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0387dec-c1e7-46b9-8e39-566a76d563f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:41.329051 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-b0387dec-c1e7-46b9-8e39-566a76d563f6 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:41.330523 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-b0387dec-c1e7-46b9-8e39-566a76d563f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:41.334213 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44673a-b2f6-48c5-8f8b-73a20d5a61de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:41.334846 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44673a-b2f6-48c5-8f8b-73a20d5a61de None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:41.335129 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44673a-b2f6-48c5-8f8b-73a20d5a61de None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:41.335405 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c44673a-b2f6-48c5-8f8b-73a20d5a61de None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:41.338726 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c44673a-b2f6-48c5-8f8b-73a20d5a61de None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:41.338726 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c44673a-b2f6-48c5-8f8b-73a20d5a61de None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:41.338726 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c44673a-b2f6-48c5-8f8b-73a20d5a61de None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:41.356031 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 230/469] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:07:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:41.357261 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44673a-b2f6-48c5-8f8b-73a20d5a61de None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:41.359631 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:41.419136 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 240/470] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:07:41.420395 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0387dec-c1e7-46b9-8e39-566a76d563f6 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:41.480193 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c44673a-b2f6-48c5-8f8b-73a20d5a61de None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:41.518105 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb613cb1-5e68-49fd-8150-4045136e7f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:41.519103 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb613cb1-5e68-49fd-8150-4045136e7f16 None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:41.519522 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb613cb1-5e68-49fd-8150-4045136e7f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:41.519954 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb613cb1-5e68-49fd-8150-4045136e7f16 None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:41.521038 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb613cb1-5e68-49fd-8150-4045136e7f16 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:41.523969 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb613cb1-5e68-49fd-8150-4045136e7f16 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:41.560490 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 231/471] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Aug 5 02:07:41 2022] POST /identity/v3/users => generated 248 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:07:41.561736 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb613cb1-5e68-49fd-8150-4045136e7f16 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:41.563617 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0387dec-c1e7-46b9-8e39-566a76d563f6 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:41.601073 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:41.616075 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d779e2-908a-4356-b096-0b205e763eb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:41.616726 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d779e2-908a-4356-b096-0b205e763eb2 None admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:41.617117 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d779e2-908a-4356-b096-0b205e763eb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:41.618352 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d779e2-908a-4356-b096-0b205e763eb2 None admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:41.618558 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d779e2-908a-4356-b096-0b205e763eb2 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:41.624155 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d779e2-908a-4356-b096-0b205e763eb2 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:41.653442 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 241/472] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Aug 5 02:07:41 2022] POST /identity/v3/users => generated 248 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:07:41.763143 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb613cb1-5e68-49fd-8150-4045136e7f16 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:41.803811 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7a49b6-731e-427c-a2ef-3e0b97f32f71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:41.805848 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a49b6-731e-427c-a2ef-3e0b97f32f71 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:41.806365 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a49b6-731e-427c-a2ef-3e0b97f32f71 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:41.806838 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7a49b6-731e-427c-a2ef-3e0b97f32f71 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:41.819510 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a49b6-731e-427c-a2ef-3e0b97f32f71 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:41.822233 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7a49b6-731e-427c-a2ef-3e0b97f32f71 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:41.841170 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-ee7a49b6-731e-427c-a2ef-3e0b97f32f71 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:41.841170 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:41.841170 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:41.841170 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:41.841170 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:41.841170 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:41.841170 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:41.841170 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:41.841170 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:41.841170 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:41.841170 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:41.841170 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:41.841170 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:07:41.841170 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:07:41.841170 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:07:41.842069 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:07:41.842069 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:41.842069 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:41.842069 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:41.842069 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:41.842069 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:41.842069 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:41.842069 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:41.842069 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:41.842069 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:41.842069 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:41.842069 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:41.842069 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:41.842069 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:41.842069 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:41.842069 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:41.842069 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:41.842933 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:07:41.842933 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:07:41.842933 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:41.842933 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:41.842933 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 232/473] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:07:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:41.849861 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d779e2-908a-4356-b096-0b205e763eb2 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:41.875006 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:41.921897 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda1fe6-ed56-4695-82d1-ec838a3e82b9 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:41.922212 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda1fe6-ed56-4695-82d1-ec838a3e82b9 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:41.922462 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dda1fe6-ed56-4695-82d1-ec838a3e82b9 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:41.923957 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 233/474] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:07:41.930148 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36017d-848b-4b79-9749-c22538ef8c27 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:41.931046 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36017d-848b-4b79-9749-c22538ef8c27 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:41.931335 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e36017d-848b-4b79-9749-c22538ef8c27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:41.954046 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-3e36017d-848b-4b79-9749-c22538ef8c27 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:41.955299 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-3e36017d-848b-4b79-9749-c22538ef8c27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:41.988891 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d779e2-908a-4356-b096-0b205e763eb2 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:42.032487 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ca432-1130-4511-b07d-076aa25451ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:42.033583 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ca432-1130-4511-b07d-076aa25451ec None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:42.034244 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ca432-1130-4511-b07d-076aa25451ec None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:42.034743 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19ca432-1130-4511-b07d-076aa25451ec None admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:42.036236 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ca432-1130-4511-b07d-076aa25451ec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:42.036820 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ca432-1130-4511-b07d-076aa25451ec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:42.039747 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19ca432-1130-4511-b07d-076aa25451ec None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:42.042865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:42.054801 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 234/475] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:07:42.057358 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 242/476] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:07:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:07:42.067085 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36017d-848b-4b79-9749-c22538ef8c27 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:42.085444 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ca432-1130-4511-b07d-076aa25451ec None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:42.172436 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:42.196730 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e36017d-848b-4b79-9749-c22538ef8c27 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:42.197879 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19ca432-1130-4511-b07d-076aa25451ec None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:42.235768 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6ce22-d5b7-4687-b517-dc14f1ef4310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:42.236789 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6ce22-d5b7-4687-b517-dc14f1ef4310 None admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:42.237269 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6ce22-d5b7-4687-b517-dc14f1ef4310 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:42.237738 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d6ce22-d5b7-4687-b517-dc14f1ef4310 None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:42.238645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d6ce22-d5b7-4687-b517-dc14f1ef4310 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:42.240264 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d6ce22-d5b7-4687-b517-dc14f1ef4310 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:42.244887 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144eb93b-0a75-4043-b937-3adfe40aac55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:42.245720 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144eb93b-0a75-4043-b937-3adfe40aac55 None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:42.246003 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144eb93b-0a75-4043-b937-3adfe40aac55 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:42.246273 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144eb93b-0a75-4043-b937-3adfe40aac55 None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:42.246970 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144eb93b-0a75-4043-b937-3adfe40aac55 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:42.249076 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144eb93b-0a75-4043-b937-3adfe40aac55 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:42.251288 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.sql.core [None req-e2d6ce22-d5b7-4687-b517-dc14f1ef4310 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 05 02:07:42.251288 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 05 02:07:42.251288 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [parameters: {'id': '18d35f12208743479f67e1d06907eafc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 05 02:07:42.251288 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80442) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 05 02:07:42.269980 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-e2d6ce22-d5b7-4687-b517-dc14f1ef4310 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 05 02:07:42.269980 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:42.269980 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 05 02:07:42.269980 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 05 02:07:42.269980 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 05 02:07:42.269980 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 05 02:07:42.269980 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 05 02:07:42.269980 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application result = self._query(query) Aug 05 02:07:42.269980 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 05 02:07:42.269980 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application conn.query(q) Aug 05 02:07:42.269980 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 05 02:07:42.269980 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 05 02:07:42.269980 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 05 02:07:42.269980 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application result.read() Aug 05 02:07:42.269980 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 05 02:07:42.270862 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 05 02:07:42.270862 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 05 02:07:42.270862 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 05 02:07:42.270862 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 05 02:07:42.270862 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 05 02:07:42.270862 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 05 02:07:42.270862 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 05 02:07:42.270862 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 05 02:07:42.270862 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:42.270862 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 05 02:07:42.270862 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:42.270862 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:42.270862 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 05 02:07:42.270862 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 05 02:07:42.270862 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 05 02:07:42.270862 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return ref.to_dict() Aug 05 02:07:42.270862 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 05 02:07:42.270862 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application next(self.gen) Aug 05 02:07:42.271740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 05 02:07:42.271740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application yield resource Aug 05 02:07:42.271740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 05 02:07:42.271740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application next(self.gen) Aug 05 02:07:42.271740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 05 02:07:42.271740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application self.session.rollback() Aug 05 02:07:42.271740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 05 02:07:42.271740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application self.force_reraise() Aug 05 02:07:42.271740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 05 02:07:42.271740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise self.value Aug 05 02:07:42.271740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 05 02:07:42.271740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 05 02:07:42.271740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 05 02:07:42.271740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application session.commit() Aug 05 02:07:42.271740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 05 02:07:42.271740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 05 02:07:42.271740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 05 02:07:42.272737 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application self._prepare_impl() Aug 05 02:07:42.272737 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 05 02:07:42.272737 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application self.session.flush() Aug 05 02:07:42.272737 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 05 02:07:42.272737 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application self._flush(objects) Aug 05 02:07:42.272737 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 05 02:07:42.272737 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 05 02:07:42.272737 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 05 02:07:42.272737 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application compat.raise_( Aug 05 02:07:42.272737 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 05 02:07:42.272737 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception Aug 05 02:07:42.272737 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 05 02:07:42.272737 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application flush_context.execute() Aug 05 02:07:42.272737 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 05 02:07:42.272737 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rec.execute(self) Aug 05 02:07:42.272737 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 05 02:07:42.272737 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 05 02:07:42.274174 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 05 02:07:42.274174 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 05 02:07:42.274174 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 05 02:07:42.274174 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 05 02:07:42.274174 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 05 02:07:42.274174 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 05 02:07:42.274174 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 05 02:07:42.274174 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 05 02:07:42.274174 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 05 02:07:42.274174 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 05 02:07:42.274174 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 05 02:07:42.274174 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 05 02:07:42.274174 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 05 02:07:42.274174 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 05 02:07:42.274174 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 05 02:07:42.274174 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception Aug 05 02:07:42.275014 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 05 02:07:42.275014 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 05 02:07:42.275014 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 05 02:07:42.275014 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 05 02:07:42.275014 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 05 02:07:42.275014 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application result = self._query(query) Aug 05 02:07:42.275014 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 05 02:07:42.275014 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application conn.query(q) Aug 05 02:07:42.275014 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 05 02:07:42.275014 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 05 02:07:42.275014 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 05 02:07:42.275014 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application result.read() Aug 05 02:07:42.275014 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 05 02:07:42.275014 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 05 02:07:42.275014 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 05 02:07:42.275014 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 05 02:07:42.275802 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 05 02:07:42.275802 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 05 02:07:42.275802 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 05 02:07:42.275802 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 05 02:07:42.275802 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 05 02:07:42.275802 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 05 02:07:42.275802 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [parameters: {'id': '18d35f12208743479f67e1d06907eafc', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 05 02:07:42.275802 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 05 02:07:42.275802 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:42.275802 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:07:42.275802 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:42.275802 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:42.275802 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:42.275802 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:42.275802 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:42.275802 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:42.276632 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:42.276632 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:42.276632 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:42.276632 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:42.276632 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:42.276632 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:42.276632 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 05 02:07:42.276632 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 05 02:07:42.276632 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:42.276632 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:42.276632 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 05 02:07:42.276632 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 05 02:07:42.276632 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 05 02:07:42.276632 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 05 02:07:42.276632 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 05 02:07:42.276632 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:42.280759 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 243/477] 10.222.0.15 () {60 vars in 1131 bytes} [Fri Aug 5 02:07:42 2022] POST /identity/v3/roles => generated 144 bytes in 196 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:07:42.288461 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6ce22-d5b7-4687-b517-dc14f1ef4310 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:42.292441 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 235/478] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Aug 5 02:07:42 2022] POST /identity/v3/users => generated 249 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:07:42.464965 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d6ce22-d5b7-4687-b517-dc14f1ef4310 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:42.526307 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1336c58c-d652-45ac-82aa-9258cec7b882 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:42.526975 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336c58c-d652-45ac-82aa-9258cec7b882 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:42.527260 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336c58c-d652-45ac-82aa-9258cec7b882 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:42.527536 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1336c58c-d652-45ac-82aa-9258cec7b882 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:42.547605 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1336c58c-d652-45ac-82aa-9258cec7b882 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:42.552765 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-1336c58c-d652-45ac-82aa-9258cec7b882 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:07:42.552765 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:42.552765 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:42.552765 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:42.552765 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:42.552765 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:42.552765 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:42.552765 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:42.552765 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:42.552765 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:42.552765 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:42.552765 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:42.552765 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:42.552765 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:42.552765 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:42.552765 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:42.553710 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:42.553710 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:42.553710 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:42.553710 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:42.553710 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:42.553710 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:42.553710 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:42.553710 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:42.553710 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:42.553710 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:42.553710 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:42.553710 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:42.553710 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:42.553710 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:42.553710 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:42.553710 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:42.554599 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:42.554599 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:42.554599 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:42.554599 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:42.554599 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:42.554599 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:42.554599 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:42.554599 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:42.554599 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:42.554599 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:42.554599 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 05 02:07:42.554599 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:42.554599 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 244/479] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Aug 5 02:07:42 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:42.560920 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144eb93b-0a75-4043-b937-3adfe40aac55 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:42.659788 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:42.717055 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144eb93b-0a75-4043-b937-3adfe40aac55 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:42.769597 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b724ccc-b837-4667-bc2c-a34261027f29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:42.770240 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b724ccc-b837-4667-bc2c-a34261027f29 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:42.770525 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b724ccc-b837-4667-bc2c-a34261027f29 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:42.770796 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b724ccc-b837-4667-bc2c-a34261027f29 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:42.771525 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b724ccc-b837-4667-bc2c-a34261027f29 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:42.771828 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b724ccc-b837-4667-bc2c-a34261027f29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:42.773766 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b724ccc-b837-4667-bc2c-a34261027f29 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:42.787937 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 236/480] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:07:42 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:43.667682 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf24ea-398b-46eb-9c24-93080644e134 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:43.668231 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf24ea-398b-46eb-9c24-93080644e134 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:43.668231 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf24ea-398b-46eb-9c24-93080644e134 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:43.669742 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 245/481] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:43.685838 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb1b93-2a41-4715-9d6a-9a4d2b18ee9c None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:43.686304 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb1b93-2a41-4715-9d6a-9a4d2b18ee9c None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:43.686401 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7cb1b93-2a41-4715-9d6a-9a4d2b18ee9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:43.709551 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-f7cb1b93-2a41-4715-9d6a-9a4d2b18ee9c None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:43.710833 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-f7cb1b93-2a41-4715-9d6a-9a4d2b18ee9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:43.791913 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 237/482] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:07:43.827724 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf24ea-398b-46eb-9c24-93080644e134 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:43.830801 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:43.977570 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf24ea-398b-46eb-9c24-93080644e134 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:44.030626 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb2fb2f8-fc5f-4311-9bc4-72867bbef084 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:44.031284 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2fb2f8-fc5f-4311-9bc4-72867bbef084 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:44.031561 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2fb2f8-fc5f-4311-9bc4-72867bbef084 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:44.031830 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb2fb2f8-fc5f-4311-9bc4-72867bbef084 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:44.047124 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb2fb2f8-fc5f-4311-9bc4-72867bbef084 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:44.052052 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-fb2fb2f8-fc5f-4311-9bc4-72867bbef084 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:07:44.052052 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:44.052052 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:44.052052 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:44.052052 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:44.052052 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:44.052052 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:44.052052 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:44.052052 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:44.052052 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:44.052052 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:44.052052 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:44.052052 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:44.052052 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:44.052052 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:44.052052 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:44.053016 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:44.053016 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:44.053016 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:44.053016 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:44.053016 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:44.053016 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:44.053016 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:44.053016 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:44.053016 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:44.053016 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:44.053016 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:44.053016 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:44.053016 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:44.053016 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:44.053016 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:44.053016 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:44.053799 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:44.053799 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:44.053799 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:44.053799 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:44.053799 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:44.053799 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:44.053799 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:44.053799 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:44.053799 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:44.053799 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:44.053799 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:07:44.053799 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:44.053799 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 246/483] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Aug 5 02:07:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:44.060291 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb1b93-2a41-4715-9d6a-9a4d2b18ee9c None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:44.152908 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b21535-0e91-4b5f-8eb5-d1d15c8e44c1 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:44.153229 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b21535-0e91-4b5f-8eb5-d1d15c8e44c1 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:44.153457 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b21535-0e91-4b5f-8eb5-d1d15c8e44c1 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:44.155074 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 247/484] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:44.164524 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:44.178308 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b5cf1-e208-49e0-86cb-1f6288989405 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:44.178625 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b5cf1-e208-49e0-86cb-1f6288989405 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:44.178858 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-086b5cf1-e208-49e0-86cb-1f6288989405 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:44.208839 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-086b5cf1-e208-49e0-86cb-1f6288989405 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:44.209975 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-086b5cf1-e208-49e0-86cb-1f6288989405 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:44.229802 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7cb1b93-2a41-4715-9d6a-9a4d2b18ee9c None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:44.269444 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d4527c-18fe-43e9-8553-c2a273701f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:44.270319 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4527c-18fe-43e9-8553-c2a273701f7b None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:44.270740 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4527c-18fe-43e9-8553-c2a273701f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:44.271172 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d4527c-18fe-43e9-8553-c2a273701f7b None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:44.272065 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d4527c-18fe-43e9-8553-c2a273701f7b None admin] RBAC: Adding query filter params (name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:44.272588 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d4527c-18fe-43e9-8553-c2a273701f7b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:44.274817 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57d4527c-18fe-43e9-8553-c2a273701f7b None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:44.283855 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 238/485] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Aug 5 02:07:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:44.285423 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b33cc9-b73a-4f40-bd53-6f671fa61308 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:44.285845 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b33cc9-b73a-4f40-bd53-6f671fa61308 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:44.286304 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b33cc9-b73a-4f40-bd53-6f671fa61308 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:44.287797 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 239/486] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:44.292719 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:44.294034 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b33cc9-b73a-4f40-bd53-6f671fa61308 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:44.308446 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 248/487] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:07:44.309962 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e25d3e-f44d-493a-ab69-cd6a654dec9c None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:44.310322 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e25d3e-f44d-493a-ab69-cd6a654dec9c None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:44.310672 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e25d3e-f44d-493a-ab69-cd6a654dec9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:44.332521 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-66e25d3e-f44d-493a-ab69-cd6a654dec9c None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:44.334744 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-66e25d3e-f44d-493a-ab69-cd6a654dec9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:44.412374 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 249/488] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:07:44.412374 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e25d3e-f44d-493a-ab69-cd6a654dec9c None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:44.431007 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b33cc9-b73a-4f40-bd53-6f671fa61308 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:44.440784 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:44.467029 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6cb8b2-c2e7-41f5-9dce-ba233a837637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:44.467680 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6cb8b2-c2e7-41f5-9dce-ba233a837637 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:44.467963 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6cb8b2-c2e7-41f5-9dce-ba233a837637 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:44.468237 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6cb8b2-c2e7-41f5-9dce-ba233a837637 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:44.480403 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6cb8b2-c2e7-41f5-9dce-ba233a837637 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:44.481548 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6cb8b2-c2e7-41f5-9dce-ba233a837637 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:44.496485 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-bd6cb8b2-c2e7-41f5-9dce-ba233a837637 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:44.496485 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:44.496485 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:44.496485 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:44.496485 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:44.496485 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:44.496485 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:44.496485 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:44.496485 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:44.496485 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:44.496485 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:44.496485 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:44.496485 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:07:44.496485 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:07:44.496485 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:07:44.501036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:07:44.501036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:44.501036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:44.501036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:44.501036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:44.501036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:44.501036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:44.501036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:44.501036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:44.501036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:44.501036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:44.501036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:44.501036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:44.501036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:44.501036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:44.501036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:44.501036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:44.501870 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:07:44.501870 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:07:44.501870 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:44.501870 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:44.501870 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 240/489] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:07:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:07:44.501870 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6cb8b2-c2e7-41f5-9dce-ba233a837637 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:44.546605 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e25d3e-f44d-493a-ab69-cd6a654dec9c None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:44.572721 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:44.587372 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca5eed-080c-4a43-ab5d-216abb0441f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:44.588624 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca5eed-080c-4a43-ab5d-216abb0441f0 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:44.589115 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca5eed-080c-4a43-ab5d-216abb0441f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:44.589594 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ca5eed-080c-4a43-ab5d-216abb0441f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:44.603870 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3ca5eed-080c-4a43-ab5d-216abb0441f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:44.610051 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-d3ca5eed-080c-4a43-ab5d-216abb0441f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:07:44.610051 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:44.610051 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:44.610051 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:44.610051 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:44.610051 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:44.610051 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:44.610051 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:44.610051 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:44.610051 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:44.610051 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:44.610051 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:44.610051 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:44.610051 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:44.610051 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:44.610051 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:44.610975 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:44.610975 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:44.610975 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:44.610975 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:44.610975 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:44.610975 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:44.610975 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:44.610975 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:44.610975 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:44.610975 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:44.610975 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:44.610975 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:44.610975 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:44.610975 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:44.610975 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:44.610975 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:44.611810 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:44.611810 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:44.611810 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:44.611810 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:44.611810 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:44.611810 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:44.611810 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:44.611810 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:44.611810 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:44.611810 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:44.611810 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:07:44.611810 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:44.619828 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6cb8b2-c2e7-41f5-9dce-ba233a837637 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:44.620426 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 250/490] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Aug 5 02:07:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:44.621773 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca5eed-080c-4a43-ab5d-216abb0441f0 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:44.660463 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea1764-d6c6-4719-a428-8f172ec27bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:44.661108 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea1764-d6c6-4719-a428-8f172ec27bbd None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:44.662181 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea1764-d6c6-4719-a428-8f172ec27bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:44.662465 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea1764-d6c6-4719-a428-8f172ec27bbd None admin] PATH_INFO: `/v3/roles/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:44.675683 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea1764-d6c6-4719-a428-8f172ec27bbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:44.682967 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-1fea1764-d6c6-4719-a428-8f172ec27bbd None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:07:44.682967 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:44.682967 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:44.682967 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:44.682967 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:44.682967 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:44.682967 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:44.682967 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:44.682967 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:44.682967 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:44.682967 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:44.682967 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:44.682967 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:44.682967 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:44.682967 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:44.682967 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:44.683884 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:44.683884 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:44.683884 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:44.683884 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:44.683884 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:44.683884 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:44.683884 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:44.683884 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:44.683884 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:44.683884 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:44.683884 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:44.683884 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:44.683884 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:44.683884 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:44.683884 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:44.683884 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:44.684742 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:44.684742 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:44.684742 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:44.684742 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:44.684742 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:44.684742 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:44.684742 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:44.684742 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:44.684742 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:44.684742 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:44.684742 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:07:44.684742 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:44.684742 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 241/491] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Aug 5 02:07:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:44.685439 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea1764-d6c6-4719-a428-8f172ec27bbd None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:44.714740 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:44.751171 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ca5eed-080c-4a43-ab5d-216abb0441f0 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:44.797868 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308d122-1978-476d-8a74-b44e09e1fc33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:44.798756 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308d122-1978-476d-8a74-b44e09e1fc33 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:44.799044 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308d122-1978-476d-8a74-b44e09e1fc33 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:44.799324 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8308d122-1978-476d-8a74-b44e09e1fc33 None admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:44.800027 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308d122-1978-476d-8a74-b44e09e1fc33 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:44.800373 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308d122-1978-476d-8a74-b44e09e1fc33 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:44.802579 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8308d122-1978-476d-8a74-b44e09e1fc33 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:44.808532 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea1764-d6c6-4719-a428-8f172ec27bbd None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:44.817458 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 251/492] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:07:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:44.818191 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308d122-1978-476d-8a74-b44e09e1fc33 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:44.849574 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68e3c0-50fa-45e3-8870-70aabc0262f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:44.850660 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68e3c0-50fa-45e3-8870-70aabc0262f1 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:44.851133 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68e3c0-50fa-45e3-8870-70aabc0262f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:44.851653 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f68e3c0-50fa-45e3-8870-70aabc0262f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:44.852744 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f68e3c0-50fa-45e3-8870-70aabc0262f1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:44.853241 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f68e3c0-50fa-45e3-8870-70aabc0262f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:44.855021 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f68e3c0-50fa-45e3-8870-70aabc0262f1 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:44.869393 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 242/493] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Aug 5 02:07:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:44.870569 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68e3c0-50fa-45e3-8870-70aabc0262f1 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:44.872675 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:44.953902 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8308d122-1978-476d-8a74-b44e09e1fc33 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:44.973683 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:44.990976 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a0e85-8039-4952-9e59-d8d1354cde78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:44.992478 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a0e85-8039-4952-9e59-d8d1354cde78 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:44.992956 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a0e85-8039-4952-9e59-d8d1354cde78 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:44.993440 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37a0e85-8039-4952-9e59-d8d1354cde78 None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:44.994342 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a0e85-8039-4952-9e59-d8d1354cde78 None admin] RBAC: Adding query filter params (name=service) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:44.994721 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f68e3c0-50fa-45e3-8870-70aabc0262f1 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:44.995167 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a0e85-8039-4952-9e59-d8d1354cde78 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:44.996759 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37a0e85-8039-4952-9e59-d8d1354cde78 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:45.005860 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 252/494] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Aug 5 02:07:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:45.006981 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a0e85-8039-4952-9e59-d8d1354cde78 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:45.034940 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb101d39-2c0f-4503-9f57-78ba03f3b8c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:45.035585 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb101d39-2c0f-4503-9f57-78ba03f3b8c2 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:45.035862 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb101d39-2c0f-4503-9f57-78ba03f3b8c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:45.036135 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb101d39-2c0f-4503-9f57-78ba03f3b8c2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:45.044575 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb101d39-2c0f-4503-9f57-78ba03f3b8c2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:45.046029 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb101d39-2c0f-4503-9f57-78ba03f3b8c2 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:45.058961 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-eb101d39-2c0f-4503-9f57-78ba03f3b8c2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 02:07:45.058961 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:45.058961 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:45.058961 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:45.058961 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:45.058961 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:45.058961 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:45.058961 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:45.058961 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:45.058961 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:45.058961 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:45.058961 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:45.058961 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:07:45.058961 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:07:45.058961 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:07:45.058961 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:07:45.059877 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:45.059877 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:45.059877 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:07:45.059877 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:07:45.059877 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:07:45.059877 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:07:45.059877 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:45.059877 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:45.059877 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:45.059877 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:45.059877 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:45.059877 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:45.059877 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:45.059877 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:45.059877 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:45.059877 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:45.059877 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:45.059877 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:45.060797 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:45.060797 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:45.060797 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:07:45.060797 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:07:45.060797 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:07:45.060797 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:07:45.060797 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:07:45.060797 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:07:45.060797 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 02:07:45.060797 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:45.060797 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 243/495] 10.222.0.15 () {56 vars in 1093 bytes} [Fri Aug 5 02:07:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:45.061340 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365e305-5720-46f5-8c33-702856ab9eef None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:45.066990 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365e305-5720-46f5-8c33-702856ab9eef None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:45.066990 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2365e305-5720-46f5-8c33-702856ab9eef None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:45.067181 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 244/496] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:45.067827 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365e305-5720-46f5-8c33-702856ab9eef None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:45.118969 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37a0e85-8039-4952-9e59-d8d1354cde78 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:45.122212 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:45.157129 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700c58c-43fa-4d5e-9fcd-a2ca70fba78a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:45.157766 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700c58c-43fa-4d5e-9fcd-a2ca70fba78a None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:45.158049 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700c58c-43fa-4d5e-9fcd-a2ca70fba78a None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:45.158323 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b700c58c-43fa-4d5e-9fcd-a2ca70fba78a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:45.168847 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700c58c-43fa-4d5e-9fcd-a2ca70fba78a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:45.170335 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b700c58c-43fa-4d5e-9fcd-a2ca70fba78a None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:45.176523 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2365e305-5720-46f5-8c33-702856ab9eef None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:45.186203 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-b700c58c-43fa-4d5e-9fcd-a2ca70fba78a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:45.186203 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:45.186203 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:45.186203 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:45.186203 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:45.186203 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:45.186203 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:45.186203 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:45.186203 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:45.186203 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:45.186203 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:45.186203 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:45.186203 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:07:45.186203 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:07:45.186203 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:07:45.187094 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:07:45.187094 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:45.187094 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:45.187094 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:45.187094 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:45.187094 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:45.187094 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:45.187094 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:45.187094 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:45.187094 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:45.187094 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:45.187094 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:45.187094 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:45.187094 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:45.187094 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:45.187094 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:45.187094 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:45.187929 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:07:45.187929 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:07:45.187929 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:45.187929 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:45.187929 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 253/497] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:07:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:45.188196 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700c58c-43fa-4d5e-9fcd-a2ca70fba78a None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:45.218633 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538e9d32-a6c2-416a-b142-f8bbe2021329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:45.219273 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e9d32-a6c2-416a-b142-f8bbe2021329 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:45.219548 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e9d32-a6c2-416a-b142-f8bbe2021329 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:45.219817 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538e9d32-a6c2-416a-b142-f8bbe2021329 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:45.231352 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e9d32-a6c2-416a-b142-f8bbe2021329 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:45.232872 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538e9d32-a6c2-416a-b142-f8bbe2021329 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:45.234677 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:45.248834 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-538e9d32-a6c2-416a-b142-f8bbe2021329 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:45.248834 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:45.248834 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:45.248834 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:45.248834 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:45.248834 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:45.248834 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:45.248834 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:45.248834 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:45.248834 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:45.248834 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:45.248834 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:45.248834 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:07:45.248834 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:07:45.248834 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:07:45.249731 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:07:45.249731 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:45.249731 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:45.249731 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:45.249731 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:45.249731 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:45.249731 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:45.249731 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:45.249731 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:45.249731 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:45.249731 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:45.249731 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:45.249731 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:45.249731 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:45.249731 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:45.249731 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:45.249731 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:45.250583 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:07:45.250583 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:07:45.250583 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:45.250583 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:45.250583 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 245/498] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:07:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:45.251607 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7d9f6-d33b-4582-b2d1-ba334bf09280 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:45.251958 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7d9f6-d33b-4582-b2d1-ba334bf09280 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:45.252303 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c7d9f6-d33b-4582-b2d1-ba334bf09280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:45.271135 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-f0c7d9f6-d33b-4582-b2d1-ba334bf09280 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:45.272269 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-f0c7d9f6-d33b-4582-b2d1-ba334bf09280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:45.304589 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b700c58c-43fa-4d5e-9fcd-a2ca70fba78a None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:45.340896 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4fd7d-f088-4481-a130-74660ce93b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:45.341518 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4fd7d-f088-4481-a130-74660ce93b50 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:45.341849 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4fd7d-f088-4481-a130-74660ce93b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:45.342076 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d4fd7d-f088-4481-a130-74660ce93b50 None admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:45.342878 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4fd7d-f088-4481-a130-74660ce93b50 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:45.343191 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4fd7d-f088-4481-a130-74660ce93b50 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:45.344280 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 246/499] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:07:45.344746 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d4fd7d-f088-4481-a130-74660ce93b50 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:45.353285 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7d9f6-d33b-4582-b2d1-ba334bf09280 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:45.382050 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 254/500] 10.222.0.15 () {56 vars in 1133 bytes} [Fri Aug 5 02:07:45 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:45.383505 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4fd7d-f088-4481-a130-74660ce93b50 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:45.404981 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:45.463283 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c7d9f6-d33b-4582-b2d1-ba334bf09280 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:45.488689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:45.500651 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42623315-cfdc-439a-a252-7e1076e74d73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:45.501476 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42623315-cfdc-439a-a252-7e1076e74d73 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:45.501750 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42623315-cfdc-439a-a252-7e1076e74d73 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:45.502017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42623315-cfdc-439a-a252-7e1076e74d73 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:45.502713 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42623315-cfdc-439a-a252-7e1076e74d73 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:45.503027 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42623315-cfdc-439a-a252-7e1076e74d73 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:45.504376 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42623315-cfdc-439a-a252-7e1076e74d73 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:45.505954 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d4fd7d-f088-4481-a130-74660ce93b50 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:45.516758 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 247/501] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:45.517573 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42623315-cfdc-439a-a252-7e1076e74d73 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:45.541937 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe49dc-3550-4d32-ac6b-2fcd9f79c72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:45.542544 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe49dc-3550-4d32-ac6b-2fcd9f79c72f None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:45.542834 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe49dc-3550-4d32-ac6b-2fcd9f79c72f None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:45.543108 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fe49dc-3550-4d32-ac6b-2fcd9f79c72f None admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:45.543798 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fe49dc-3550-4d32-ac6b-2fcd9f79c72f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:45.544104 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fe49dc-3550-4d32-ac6b-2fcd9f79c72f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:45.545521 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fe49dc-3550-4d32-ac6b-2fcd9f79c72f None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:45.557417 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 255/502] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:07:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:45.558208 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe49dc-3550-4d32-ac6b-2fcd9f79c72f None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:45.615887 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42623315-cfdc-439a-a252-7e1076e74d73 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:45.631260 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:45.649907 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ce4ee4-ff89-4561-a5eb-13787080d384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:45.650545 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce4ee4-ff89-4561-a5eb-13787080d384 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:45.650829 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce4ee4-ff89-4561-a5eb-13787080d384 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:45.651103 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ce4ee4-ff89-4561-a5eb-13787080d384 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:45.658452 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fe49dc-3550-4d32-ac6b-2fcd9f79c72f None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:45.661109 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ce4ee4-ff89-4561-a5eb-13787080d384 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:45.666504 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-54ce4ee4-ff89-4561-a5eb-13787080d384 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:07:45.666504 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:45.666504 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:45.666504 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:45.666504 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:45.666504 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:45.666504 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:45.666504 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:45.666504 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:45.666504 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:45.666504 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:45.666504 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:45.666504 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:45.666504 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:45.666504 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:45.666504 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:45.667586 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:45.667586 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:45.667586 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:45.667586 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:45.667586 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:45.667586 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:45.667586 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:45.667586 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:45.667586 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:45.667586 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:45.667586 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:45.667586 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:45.667586 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:45.667586 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:45.667586 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:45.667586 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:45.668426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:45.668426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:45.668426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:45.668426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:45.668426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:45.668426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:45.668426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:45.668426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:45.668426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:45.668426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:45.668426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:07:45.668426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:45.668426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 248/503] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Aug 5 02:07:45 2022] GET /identity/v3/roles/service => generated 85 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:45.669129 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f101be-20ad-4823-b653-2091ab967445 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:45.669406 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f101be-20ad-4823-b653-2091ab967445 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:45.669672 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f101be-20ad-4823-b653-2091ab967445 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:45.670930 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 249/504] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:45 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:45.671608 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f101be-20ad-4823-b653-2091ab967445 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:45.698641 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a413b-9039-4285-a3bd-c3b12094db90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:45.699253 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a413b-9039-4285-a3bd-c3b12094db90 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:45.699533 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a413b-9039-4285-a3bd-c3b12094db90 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:45.699820 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e05a413b-9039-4285-a3bd-c3b12094db90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:45.717579 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:45.768203 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a413b-9039-4285-a3bd-c3b12094db90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:45.769690 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e05a413b-9039-4285-a3bd-c3b12094db90 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:45.774966 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f101be-20ad-4823-b653-2091ab967445 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:45.808150 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a8456-9d35-4bce-a7a5-791b10e4cd65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:45.808748 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a8456-9d35-4bce-a7a5-791b10e4cd65 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:45.809029 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a8456-9d35-4bce-a7a5-791b10e4cd65 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:45.809304 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444a8456-9d35-4bce-a7a5-791b10e4cd65 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:45.817928 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a8456-9d35-4bce-a7a5-791b10e4cd65 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:45.819363 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444a8456-9d35-4bce-a7a5-791b10e4cd65 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:45.830955 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-444a8456-9d35-4bce-a7a5-791b10e4cd65 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 02:07:45.830955 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:45.830955 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:45.830955 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:45.830955 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:45.830955 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:45.830955 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:45.830955 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:45.830955 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:45.830955 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:45.830955 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:45.830955 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:45.830955 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:07:45.830955 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:07:45.830955 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:07:45.830955 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:07:45.831865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:45.831865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:45.831865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:07:45.831865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:07:45.831865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:07:45.831865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:07:45.831865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:45.831865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:45.831865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:45.831865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:45.831865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:45.831865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:45.831865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:45.831865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:45.831865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:45.831865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:45.831865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:45.831865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:45.837252 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:45.837252 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:45.837252 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:07:45.837252 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:07:45.837252 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:07:45.837252 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:07:45.837252 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:07:45.837252 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:07:45.837252 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 02:07:45.837252 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:45.837252 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 250/505] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:07:45 2022] GET /identity/v3/users/cinder => generated 84 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:45.837252 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a8456-9d35-4bce-a7a5-791b10e4cd65 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:45.848128 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:45.874877 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 256/506] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:07:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:07:45.876106 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a413b-9039-4285-a3bd-c3b12094db90 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:45.936053 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444a8456-9d35-4bce-a7a5-791b10e4cd65 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:45.938343 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:45.970188 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-901e22b1-d6e3-483a-b503-93c30a6aa212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:45.970898 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e22b1-d6e3-483a-b503-93c30a6aa212 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:45.971240 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e22b1-d6e3-483a-b503-93c30a6aa212 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:45.971575 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-901e22b1-d6e3-483a-b503-93c30a6aa212 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:45.974540 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e05a413b-9039-4285-a3bd-c3b12094db90 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:45.979591 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e22b1-d6e3-483a-b503-93c30a6aa212 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:45.981040 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-901e22b1-d6e3-483a-b503-93c30a6aa212 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:45.992657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-901e22b1-d6e3-483a-b503-93c30a6aa212 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 05 02:07:45.992657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:45.992657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:45.992657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:45.992657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:45.992657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:45.992657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:45.992657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:45.992657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:45.992657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:45.992657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:45.992657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:45.992657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:07:45.992657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:07:45.992657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:07:45.992657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:07:45.993562 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:45.993562 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:45.993562 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:07:45.993562 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:07:45.993562 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:07:45.993562 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:07:45.993562 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:45.993562 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:45.993562 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:45.993562 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:45.993562 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:45.993562 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:45.993562 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:45.993562 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:45.993562 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:45.993562 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:45.993562 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:45.993562 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:45.994442 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:45.994442 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:45.994442 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:07:45.994442 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:07:45.994442 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:07:45.994442 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:07:45.994442 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:07:45.994442 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:07:45.994442 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 05 02:07:45.994442 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:45.998366 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 251/507] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:07:45 2022] GET /identity/v3/users/glance => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:45.999619 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca36b2-8dcc-4995-b809-f9c0323175d6 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:45.999895 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca36b2-8dcc-4995-b809-f9c0323175d6 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:46.000164 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ca36b2-8dcc-4995-b809-f9c0323175d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:46.009815 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e03b53-d666-49e5-835d-c72436ed8c18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:46.010436 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e03b53-d666-49e5-835d-c72436ed8c18 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:46.010718 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e03b53-d666-49e5-835d-c72436ed8c18 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:46.010991 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e03b53-d666-49e5-835d-c72436ed8c18 None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:46.011709 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e03b53-d666-49e5-835d-c72436ed8c18 None admin] RBAC: Adding query filter params (name=service) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:46.012015 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e03b53-d666-49e5-835d-c72436ed8c18 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:46.013418 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e03b53-d666-49e5-835d-c72436ed8c18 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:46.018007 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-01ca36b2-8dcc-4995-b809-f9c0323175d6 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:46.019202 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-01ca36b2-8dcc-4995-b809-f9c0323175d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:46.021506 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 257/508] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Aug 5 02:07:45 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:46.022290 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e03b53-d666-49e5-835d-c72436ed8c18 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:46.056293 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:46.086388 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 252/509] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:07:46.087148 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca36b2-8dcc-4995-b809-f9c0323175d6 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:46.125087 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e03b53-d666-49e5-835d-c72436ed8c18 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:46.160899 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2cb3d-f27e-49a2-83f5-c98cac2b8c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:46.161511 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2cb3d-f27e-49a2-83f5-c98cac2b8c92 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:46.161795 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2cb3d-f27e-49a2-83f5-c98cac2b8c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:46.162071 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba2cb3d-f27e-49a2-83f5-c98cac2b8c92 None admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:46.162862 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba2cb3d-f27e-49a2-83f5-c98cac2b8c92 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:46.163168 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba2cb3d-f27e-49a2-83f5-c98cac2b8c92 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:46.164710 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ba2cb3d-f27e-49a2-83f5-c98cac2b8c92 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:46.181365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 258/510] 10.222.0.15 () {56 vars in 1137 bytes} [Fri Aug 5 02:07:46 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:46.182162 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2cb3d-f27e-49a2-83f5-c98cac2b8c92 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:46.188312 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:46.196534 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ca36b2-8dcc-4995-b809-f9c0323175d6 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:46.230640 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247cec9-02d7-47de-a108-0c3d1231dab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:46.231348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247cec9-02d7-47de-a108-0c3d1231dab8 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:46.231632 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247cec9-02d7-47de-a108-0c3d1231dab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:46.231898 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2247cec9-02d7-47de-a108-0c3d1231dab8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:46.241795 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2247cec9-02d7-47de-a108-0c3d1231dab8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:46.243355 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2247cec9-02d7-47de-a108-0c3d1231dab8 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:46.262746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-2247cec9-02d7-47de-a108-0c3d1231dab8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:46.262746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:46.262746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:46.262746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:46.262746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:46.262746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:46.262746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:46.262746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:46.262746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:46.262746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:46.262746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:46.262746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:46.262746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:07:46.262746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:07:46.262746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:07:46.263808 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:07:46.263808 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:46.263808 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:46.263808 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:46.263808 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:46.263808 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:46.263808 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:46.263808 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:46.263808 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:46.263808 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:46.263808 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:46.263808 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:46.263808 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:46.263808 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:46.263808 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:46.263808 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:46.263808 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:46.264994 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:07:46.264994 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:07:46.264994 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:46.264994 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:46.264994 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 253/511] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:07:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:46.264994 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247cec9-02d7-47de-a108-0c3d1231dab8 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:46.277858 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:46.285163 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba2cb3d-f27e-49a2-83f5-c98cac2b8c92 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:46.319122 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56d79d-0050-422d-96c4-6e163c2ea9b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:46.319734 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56d79d-0050-422d-96c4-6e163c2ea9b6 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:46.320585 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56d79d-0050-422d-96c4-6e163c2ea9b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:46.320989 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e56d79d-0050-422d-96c4-6e163c2ea9b6 None admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:46.321794 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e56d79d-0050-422d-96c4-6e163c2ea9b6 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:46.322106 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e56d79d-0050-422d-96c4-6e163c2ea9b6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:46.323548 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e56d79d-0050-422d-96c4-6e163c2ea9b6 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:46.340598 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 259/512] 10.222.0.15 () {56 vars in 1137 bytes} [Fri Aug 5 02:07:46 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:46.341560 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56d79d-0050-422d-96c4-6e163c2ea9b6 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:46.364689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2247cec9-02d7-47de-a108-0c3d1231dab8 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:46.399573 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190aab9c-5f65-491c-b08e-62b08d392e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:46.400231 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190aab9c-5f65-491c-b08e-62b08d392e80 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:46.400536 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190aab9c-5f65-491c-b08e-62b08d392e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:46.400808 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190aab9c-5f65-491c-b08e-62b08d392e80 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:46.411560 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190aab9c-5f65-491c-b08e-62b08d392e80 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:46.413092 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190aab9c-5f65-491c-b08e-62b08d392e80 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:46.419218 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:46.427558 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-190aab9c-5f65-491c-b08e-62b08d392e80 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:46.427558 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:46.427558 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:46.427558 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:46.427558 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:46.427558 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:46.427558 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:46.427558 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:46.427558 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:46.427558 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:46.427558 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:46.427558 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:46.427558 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:07:46.427558 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:07:46.427558 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:07:46.428664 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:07:46.428664 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:46.428664 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:46.428664 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:46.428664 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:46.428664 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:46.428664 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:46.428664 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:46.428664 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:46.428664 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:46.428664 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:46.428664 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:46.428664 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:46.428664 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:46.428664 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:46.428664 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:46.428664 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:46.430237 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:07:46.430237 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:07:46.430237 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:46.430237 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:46.433835 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 254/513] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:07:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:46.434610 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190aab9c-5f65-491c-b08e-62b08d392e80 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:46.442238 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e56d79d-0050-422d-96c4-6e163c2ea9b6 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:46.476851 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45551be3-f1c4-4db2-af00-a72ed01a3e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:46.477488 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45551be3-f1c4-4db2-af00-a72ed01a3e26 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:46.477770 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45551be3-f1c4-4db2-af00-a72ed01a3e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:46.478045 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45551be3-f1c4-4db2-af00-a72ed01a3e26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:46.487790 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45551be3-f1c4-4db2-af00-a72ed01a3e26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:46.489278 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45551be3-f1c4-4db2-af00-a72ed01a3e26 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:46.504727 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-45551be3-f1c4-4db2-af00-a72ed01a3e26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:46.504727 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:46.504727 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:46.504727 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:46.504727 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:46.504727 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:46.504727 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:46.504727 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:46.504727 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:46.504727 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:46.504727 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:46.504727 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:46.504727 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:07:46.504727 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:07:46.504727 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:07:46.505775 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:07:46.505775 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:46.505775 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:46.505775 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:46.505775 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:46.505775 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:46.505775 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:46.505775 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:46.505775 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:46.505775 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:46.505775 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:46.505775 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:46.505775 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:46.505775 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:46.505775 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:46.505775 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:46.505775 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:46.506686 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:07:46.506686 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:07:46.506686 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:46.506686 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:46.506686 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 260/514] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:07:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:46.506686 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45551be3-f1c4-4db2-af00-a72ed01a3e26 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:46.510456 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:46.536428 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190aab9c-5f65-491c-b08e-62b08d392e80 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:46.570514 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd86c7b-5630-46d2-8b2f-0a3ebfbd24ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:46.571042 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd86c7b-5630-46d2-8b2f-0a3ebfbd24ab None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:46.571341 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd86c7b-5630-46d2-8b2f-0a3ebfbd24ab None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:46.571599 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd86c7b-5630-46d2-8b2f-0a3ebfbd24ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:46.605505 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45551be3-f1c4-4db2-af00-a72ed01a3e26 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:46.636706 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:46.639929 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd86c7b-5630-46d2-8b2f-0a3ebfbd24ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:46.640046 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb5005-9ab1-47b8-8e48-af3003a356cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:46.640624 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb5005-9ab1-47b8-8e48-af3003a356cf None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:46.640901 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb5005-9ab1-47b8-8e48-af3003a356cf None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:46.641172 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1fb5005-9ab1-47b8-8e48-af3003a356cf None admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:46.641441 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd86c7b-5630-46d2-8b2f-0a3ebfbd24ab None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:46.641855 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb5005-9ab1-47b8-8e48-af3003a356cf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:46.642153 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb5005-9ab1-47b8-8e48-af3003a356cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:46.643601 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1fb5005-9ab1-47b8-8e48-af3003a356cf None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:46.655162 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 261/515] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:46.655947 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb5005-9ab1-47b8-8e48-af3003a356cf None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:46.717159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:46.743445 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 255/516] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:07:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:07:46.744291 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd86c7b-5630-46d2-8b2f-0a3ebfbd24ab None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:46.755724 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1fb5005-9ab1-47b8-8e48-af3003a356cf None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:46.790116 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d914c5-0336-414e-a7f0-8e10c51ee970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:46.790747 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d914c5-0336-414e-a7f0-8e10c51ee970 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:46.790999 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d914c5-0336-414e-a7f0-8e10c51ee970 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:46.791275 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9d914c5-0336-414e-a7f0-8e10c51ee970 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:46.841762 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:46.845768 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd86c7b-5630-46d2-8b2f-0a3ebfbd24ab None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:46.859959 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d914c5-0336-414e-a7f0-8e10c51ee970 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:46.861410 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9d914c5-0336-414e-a7f0-8e10c51ee970 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:46.880502 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe8f3e-ac98-40fb-b172-47f628da2b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:46.881118 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe8f3e-ac98-40fb-b172-47f628da2b26 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:46.881399 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe8f3e-ac98-40fb-b172-47f628da2b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:46.881675 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbe8f3e-ac98-40fb-b172-47f628da2b26 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:46.882959 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe8f3e-ac98-40fb-b172-47f628da2b26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:46.883387 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe8f3e-ac98-40fb-b172-47f628da2b26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:46.884750 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbe8f3e-ac98-40fb-b172-47f628da2b26 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:46.895620 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 256/517] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:46.896422 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe8f3e-ac98-40fb-b172-47f628da2b26 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:46.922137 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:46.960820 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 262/518] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:07:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 305 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:07:46.961722 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d914c5-0336-414e-a7f0-8e10c51ee970 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:46.997106 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbe8f3e-ac98-40fb-b172-47f628da2b26 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:47.033478 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b5bf8-c165-4cb8-a293-582d5c8e2333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:47.034097 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b5bf8-c165-4cb8-a293-582d5c8e2333 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:47.034375 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b5bf8-c165-4cb8-a293-582d5c8e2333 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:47.034892 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-131b5bf8-c165-4cb8-a293-582d5c8e2333 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:47.036148 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b5bf8-c165-4cb8-a293-582d5c8e2333 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:47.036482 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b5bf8-c165-4cb8-a293-582d5c8e2333 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:47.038126 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-131b5bf8-c165-4cb8-a293-582d5c8e2333 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:47.054195 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 257/519] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:07:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:47.056056 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b5bf8-c165-4cb8-a293-582d5c8e2333 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:47.072855 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9d914c5-0336-414e-a7f0-8e10c51ee970 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:47.078589 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:47.111077 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e577ade-c4c6-40de-abdb-395cb4e57a4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:47.111667 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e577ade-c4c6-40de-abdb-395cb4e57a4f None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:47.111929 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e577ade-c4c6-40de-abdb-395cb4e57a4f None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:47.112197 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e577ade-c4c6-40de-abdb-395cb4e57a4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:47.119512 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e577ade-c4c6-40de-abdb-395cb4e57a4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:47.121032 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e577ade-c4c6-40de-abdb-395cb4e57a4f None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:47.132852 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-5e577ade-c4c6-40de-abdb-395cb4e57a4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:07:47.132852 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:47.132852 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:47.132852 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:47.132852 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:47.132852 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:47.132852 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:47.132852 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:47.132852 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:47.132852 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:47.132852 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:47.132852 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:47.132852 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:07:47.132852 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:07:47.132852 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:07:47.133757 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:07:47.133757 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:47.133757 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:47.133757 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:47.133757 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:47.133757 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:47.133757 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:47.133757 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:47.133757 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:47.133757 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:47.133757 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:47.133757 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:47.133757 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:47.133757 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:47.133757 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:47.133757 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:47.133757 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:47.134611 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:07:47.134611 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:07:47.134611 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:07:47.134611 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:07:47.134611 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:07:47.134611 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:07:47.134611 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:07:47.134611 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:47.134611 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 263/520] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:07:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:47.135068 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e577ade-c4c6-40de-abdb-395cb4e57a4f None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:47.160352 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:47.173951 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-131b5bf8-c165-4cb8-a293-582d5c8e2333 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:47.213624 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e3072-2a1a-4fbe-8a6f-34fbc4987a9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:47.214478 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e3072-2a1a-4fbe-8a6f-34fbc4987a9b None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:47.215138 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e3072-2a1a-4fbe-8a6f-34fbc4987a9b None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:47.215652 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420e3072-2a1a-4fbe-8a6f-34fbc4987a9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:47.229374 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e3072-2a1a-4fbe-8a6f-34fbc4987a9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:47.230839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420e3072-2a1a-4fbe-8a6f-34fbc4987a9b None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:47.239836 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e577ade-c4c6-40de-abdb-395cb4e57a4f None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:47.246515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-420e3072-2a1a-4fbe-8a6f-34fbc4987a9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:47.246515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:47.246515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:47.246515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:47.246515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:47.246515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:47.246515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:47.246515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:47.246515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:47.246515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:47.246515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:47.246515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:47.246515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:07:47.246515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:07:47.246515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:07:47.247378 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:07:47.247378 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:47.247378 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:47.247378 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:47.247378 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:47.247378 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:47.247378 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:47.247378 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:47.247378 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:47.247378 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:47.247378 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:47.247378 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:47.247378 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:47.247378 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:47.247378 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:47.247378 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:47.247378 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:47.248224 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:07:47.248224 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:07:47.248224 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:47.248224 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:47.252296 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 258/521] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:07:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:47.253003 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e3072-2a1a-4fbe-8a6f-34fbc4987a9b None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:47.281004 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aea6dc-e2d2-4451-b471-9ccf76ee3687 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:47.281636 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aea6dc-e2d2-4451-b471-9ccf76ee3687 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:47.281916 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aea6dc-e2d2-4451-b471-9ccf76ee3687 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:47.282188 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3aea6dc-e2d2-4451-b471-9ccf76ee3687 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:47.289718 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aea6dc-e2d2-4451-b471-9ccf76ee3687 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:47.291155 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3aea6dc-e2d2-4451-b471-9ccf76ee3687 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:47.303986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-d3aea6dc-e2d2-4451-b471-9ccf76ee3687 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 05 02:07:47.303986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:47.303986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:47.303986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:47.303986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:47.303986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:47.303986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:47.303986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:47.303986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:47.303986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:47.303986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:47.303986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:47.303986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:07:47.303986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:07:47.303986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:07:47.303986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:07:47.305442 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:47.305442 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:47.305442 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:07:47.305442 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:07:47.305442 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:07:47.305442 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:07:47.305442 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:47.305442 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:47.305442 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:47.305442 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:47.305442 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:47.305442 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:47.305442 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:47.305442 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:47.305442 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:47.305442 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:47.305442 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:47.305442 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:47.306515 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:47.306515 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:47.306515 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:07:47.306515 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:07:47.306515 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:07:47.306515 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:07:47.306515 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:07:47.306515 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:07:47.306515 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 05 02:07:47.306515 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:47.306515 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 264/522] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Aug 5 02:07:47 2022] GET /identity/v3/users/neutron => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:47.306515 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aea6dc-e2d2-4451-b471-9ccf76ee3687 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:47.326652 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:47.358971 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420e3072-2a1a-4fbe-8a6f-34fbc4987a9b None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:47.389727 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:47.391655 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1fb388-2950-40a2-a0b2-7da3c0107aa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:47.392298 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fb388-2950-40a2-a0b2-7da3c0107aa6 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:47.392701 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fb388-2950-40a2-a0b2-7da3c0107aa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:47.392989 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1fb388-2950-40a2-a0b2-7da3c0107aa6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:47.404306 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1fb388-2950-40a2-a0b2-7da3c0107aa6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:47.405755 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f1fb388-2950-40a2-a0b2-7da3c0107aa6 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:47.406788 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3aea6dc-e2d2-4451-b471-9ccf76ee3687 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:47.420883 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-2f1fb388-2950-40a2-a0b2-7da3c0107aa6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:47.420883 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:47.420883 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:47.420883 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:47.420883 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:47.420883 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:47.420883 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:47.420883 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:47.420883 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:47.420883 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:47.420883 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:47.420883 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:47.420883 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:07:47.420883 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:07:47.420883 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:07:47.421970 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:07:47.421970 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:47.421970 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:47.421970 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:47.421970 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:47.421970 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:47.421970 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:47.421970 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:47.421970 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:47.421970 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:47.421970 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:47.421970 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:47.421970 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:47.421970 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:47.421970 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:47.421970 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:47.421970 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:47.423167 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:07:47.423167 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:07:47.423167 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:47.423167 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:47.423167 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 259/523] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:07:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:47.425127 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1fb388-2950-40a2-a0b2-7da3c0107aa6 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:47.441795 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af351f-be89-4360-8287-7ec39b9eec59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:47.442444 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af351f-be89-4360-8287-7ec39b9eec59 None admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:47.442729 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af351f-be89-4360-8287-7ec39b9eec59 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:47.443002 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af351f-be89-4360-8287-7ec39b9eec59 None admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:47.443674 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af351f-be89-4360-8287-7ec39b9eec59 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:47.445647 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af351f-be89-4360-8287-7ec39b9eec59 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:47.467624 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 265/524] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Aug 5 02:07:47 2022] POST /identity/v3/users => generated 247 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:07:47.468459 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af351f-be89-4360-8287-7ec39b9eec59 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:47.547186 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1fb388-2950-40a2-a0b2-7da3c0107aa6 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:47.573469 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:47.588129 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d44600-5627-4062-825c-046120647225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:47.588788 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d44600-5627-4062-825c-046120647225 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:47.589072 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d44600-5627-4062-825c-046120647225 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:47.589345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d44600-5627-4062-825c-046120647225 None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:47.590109 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d44600-5627-4062-825c-046120647225 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:47.590416 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d44600-5627-4062-825c-046120647225 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:47.591873 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d44600-5627-4062-825c-046120647225 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:47.595275 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af351f-be89-4360-8287-7ec39b9eec59 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:47.616373 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 260/525] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Aug 5 02:07:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:47.616373 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d44600-5627-4062-825c-046120647225 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:47.641400 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc9290-396e-4432-9078-ee1355198445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:47.641953 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc9290-396e-4432-9078-ee1355198445 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:47.642236 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc9290-396e-4432-9078-ee1355198445 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:47.643314 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01dc9290-396e-4432-9078-ee1355198445 None admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:47.643860 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dc9290-396e-4432-9078-ee1355198445 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:47.644389 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dc9290-396e-4432-9078-ee1355198445 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:47.646039 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01dc9290-396e-4432-9078-ee1355198445 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:47.657966 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:47.667298 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 266/526] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:07:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:47.668021 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc9290-396e-4432-9078-ee1355198445 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:47.744508 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d44600-5627-4062-825c-046120647225 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:47.777674 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01dc9290-396e-4432-9078-ee1355198445 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:47.790488 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c5032-e509-445f-9c50-e759436acd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:47.791111 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c5032-e509-445f-9c50-e759436acd9f None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:47.791386 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c5032-e509-445f-9c50-e759436acd9f None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:47.791658 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245c5032-e509-445f-9c50-e759436acd9f None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:47.792474 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c5032-e509-445f-9c50-e759436acd9f None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:47.792779 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c5032-e509-445f-9c50-e759436acd9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:47.794201 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245c5032-e509-445f-9c50-e759436acd9f None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:47.815559 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7b9f2-1cae-418a-941b-9a13d12be532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:47.816220 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7b9f2-1cae-418a-941b-9a13d12be532 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:47.816528 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7b9f2-1cae-418a-941b-9a13d12be532 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:47.816807 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f7b9f2-1cae-418a-941b-9a13d12be532 None admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:47.817548 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f7b9f2-1cae-418a-941b-9a13d12be532 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:47.817857 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f7b9f2-1cae-418a-941b-9a13d12be532 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:47.819231 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f7b9f2-1cae-418a-941b-9a13d12be532 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:47.839953 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 267/527] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:07:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:47.840133 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 261/528] 10.222.0.15 () {56 vars in 1139 bytes} [Fri Aug 5 02:07:47 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:47.840133 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c5032-e509-445f-9c50-e759436acd9f None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:47.840280 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7b9f2-1cae-418a-941b-9a13d12be532 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:47.888579 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:47.909276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:47.951808 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245c5032-e509-445f-9c50-e759436acd9f None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:47.953438 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f7b9f2-1cae-418a-941b-9a13d12be532 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:47.989498 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bbba8-6591-4fdc-a4c5-9e8d92df6186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:47.990170 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bbba8-6591-4fdc-a4c5-9e8d92df6186 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:47.990449 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bbba8-6591-4fdc-a4c5-9e8d92df6186 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:47.990724 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9bbba8-6591-4fdc-a4c5-9e8d92df6186 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:47.990943 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32329cd7-4562-4360-a6f8-a767a92b2b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:47.992495 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32329cd7-4562-4360-a6f8-a767a92b2b02 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:47.993066 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32329cd7-4562-4360-a6f8-a767a92b2b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:47.993429 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32329cd7-4562-4360-a6f8-a767a92b2b02 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:47.994312 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32329cd7-4562-4360-a6f8-a767a92b2b02 None admin] RBAC: Adding query filter params (role.id=876fd0d181d74df4bbc73b2db1c42fbe, scope.project.id=95d88dece7184bf1842c4f8d275d52cd, user.id=4b5c0958604b436daa44b1f67c9dec26) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:47.994716 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32329cd7-4562-4360-a6f8-a767a92b2b02 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:47.996227 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32329cd7-4562-4360-a6f8-a767a92b2b02 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:47.998148 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9bbba8-6591-4fdc-a4c5-9e8d92df6186 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:47.999628 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9bbba8-6591-4fdc-a4c5-9e8d92df6186 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:48.015621 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 268/529] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:07:47 2022] GET /identity/v3/role_assignments?user.id=4b5c0958604b436daa44b1f67c9dec26&scope.project.id=95d88dece7184bf1842c4f8d275d52cd&role.id=876fd0d181d74df4bbc73b2db1c42fbe => generated 259 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:48.015621 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32329cd7-4562-4360-a6f8-a767a92b2b02 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:48.015896 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-9c9bbba8-6591-4fdc-a4c5-9e8d92df6186 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:07:48.015896 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:48.015896 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:48.015896 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:48.015896 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:48.015896 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:48.015896 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:48.015896 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:48.015896 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:48.015896 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:48.015896 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:48.015896 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:48.015896 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:07:48.015896 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:07:48.015896 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:07:48.016861 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:07:48.016861 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:48.016861 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:48.016861 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:48.016861 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:48.016861 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:48.016861 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:48.016861 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:48.016861 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:48.016861 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:48.016861 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:48.016861 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:48.016861 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:48.016861 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:48.016861 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:48.016861 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:48.016861 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:48.017876 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:07:48.017876 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:07:48.017876 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:07:48.017876 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:07:48.017876 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:07:48.017876 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:07:48.017876 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:07:48.017876 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:48.017876 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 262/530] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:07:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:48.017876 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bbba8-6591-4fdc-a4c5-9e8d92df6186 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:48.136116 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32329cd7-4562-4360-a6f8-a767a92b2b02 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:48.145031 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:48.150829 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9bbba8-6591-4fdc-a4c5-9e8d92df6186 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:48.165046 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:48.178691 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa214f8-ec22-4aa9-9213-b4a8e421fb84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:48.179728 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa214f8-ec22-4aa9-9213-b4a8e421fb84 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:48.180009 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa214f8-ec22-4aa9-9213-b4a8e421fb84 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:48.180281 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baa214f8-ec22-4aa9-9213-b4a8e421fb84 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:48.211346 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085003f-ad4a-4ce3-a18f-b338c5ad8d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:48.212965 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085003f-ad4a-4ce3-a18f-b338c5ad8d8b None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:48.213431 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085003f-ad4a-4ce3-a18f-b338c5ad8d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:48.214209 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1085003f-ad4a-4ce3-a18f-b338c5ad8d8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:48.225164 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1085003f-ad4a-4ce3-a18f-b338c5ad8d8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:48.227620 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1085003f-ad4a-4ce3-a18f-b338c5ad8d8b None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:48.244316 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-1085003f-ad4a-4ce3-a18f-b338c5ad8d8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:07:48.244316 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:48.244316 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:48.244316 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:48.244316 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:48.244316 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:48.244316 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:48.244316 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:48.244316 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:48.244316 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:48.244316 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:48.244316 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:48.244316 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:07:48.244316 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:07:48.244316 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:07:48.245223 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:07:48.245223 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:48.245223 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:48.245223 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:48.245223 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:48.245223 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:48.245223 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:48.245223 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:48.245223 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:48.245223 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:48.245223 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:48.245223 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:48.245223 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:48.245223 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:48.245223 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:48.245223 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:48.245223 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:48.246086 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:07:48.246086 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:07:48.246086 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:07:48.246086 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:07:48.246086 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:07:48.246086 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:07:48.246086 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:07:48.246086 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:48.248577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 263/531] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:07:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:48.249923 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085003f-ad4a-4ce3-a18f-b338c5ad8d8b None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:48.263040 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa214f8-ec22-4aa9-9213-b4a8e421fb84 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:48.264745 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baa214f8-ec22-4aa9-9213-b4a8e421fb84 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:48.370897 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 269/532] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:07:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:07:48.371948 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa214f8-ec22-4aa9-9213-b4a8e421fb84 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:48.390728 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1085003f-ad4a-4ce3-a18f-b338c5ad8d8b None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:48.407846 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:48.428012 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117fd2b-3114-4f34-abe4-0724be05d635 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:48.428665 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117fd2b-3114-4f34-abe4-0724be05d635 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:48.428943 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117fd2b-3114-4f34-abe4-0724be05d635 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:48.429275 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6117fd2b-3114-4f34-abe4-0724be05d635 None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:48.430033 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6117fd2b-3114-4f34-abe4-0724be05d635 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:48.430331 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6117fd2b-3114-4f34-abe4-0724be05d635 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:48.431758 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6117fd2b-3114-4f34-abe4-0724be05d635 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:48.448443 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 264/533] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Aug 5 02:07:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:48.449482 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117fd2b-3114-4f34-abe4-0724be05d635 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:48.474096 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:48.517052 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baa214f8-ec22-4aa9-9213-b4a8e421fb84 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:48.557571 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fdcf8c-3d63-40ad-b256-ad4e590b818d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:48.558285 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdcf8c-3d63-40ad-b256-ad4e590b818d None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:48.558628 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdcf8c-3d63-40ad-b256-ad4e590b818d None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:48.558972 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fdcf8c-3d63-40ad-b256-ad4e590b818d None admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:48.559836 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fdcf8c-3d63-40ad-b256-ad4e590b818d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:48.560207 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fdcf8c-3d63-40ad-b256-ad4e590b818d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:48.561811 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fdcf8c-3d63-40ad-b256-ad4e590b818d None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:48.569406 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6117fd2b-3114-4f34-abe4-0724be05d635 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:48.580508 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 270/534] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Aug 5 02:07:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:48.581587 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fdcf8c-3d63-40ad-b256-ad4e590b818d None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:48.616052 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a284c15-dbeb-4281-a49f-2b0528f291aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:48.617098 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a284c15-dbeb-4281-a49f-2b0528f291aa None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:48.617548 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a284c15-dbeb-4281-a49f-2b0528f291aa None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:48.617997 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a284c15-dbeb-4281-a49f-2b0528f291aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:48.629289 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a284c15-dbeb-4281-a49f-2b0528f291aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:48.631082 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a284c15-dbeb-4281-a49f-2b0528f291aa None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:48.648413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-1a284c15-dbeb-4281-a49f-2b0528f291aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:48.648413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:48.648413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:48.648413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:48.648413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:48.648413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:48.648413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:48.648413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:48.648413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:48.648413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:48.648413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:48.648413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:48.648413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:07:48.648413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:07:48.648413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:07:48.649419 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:07:48.649419 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:48.649419 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:48.649419 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:48.649419 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:48.649419 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:48.649419 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:48.649419 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:48.649419 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:48.649419 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:48.649419 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:48.649419 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:48.649419 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:48.649419 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:48.649419 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:48.649419 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:48.649419 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:48.650256 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:07:48.650256 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:07:48.650256 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:48.650256 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:48.652545 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 265/535] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:07:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:48.653637 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a284c15-dbeb-4281-a49f-2b0528f291aa None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:48.680449 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:48.698405 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fdcf8c-3d63-40ad-b256-ad4e590b818d None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:48.735612 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9379cf9-3de0-4005-928f-40b5f6a34232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:48.736230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9379cf9-3de0-4005-928f-40b5f6a34232 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:48.736556 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9379cf9-3de0-4005-928f-40b5f6a34232 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:48.736834 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9379cf9-3de0-4005-928f-40b5f6a34232 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:48.737624 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9379cf9-3de0-4005-928f-40b5f6a34232 None admin] RBAC: Adding query filter params (role.id=876fd0d181d74df4bbc73b2db1c42fbe, scope.project.id=95d88dece7184bf1842c4f8d275d52cd, user.id=6a75ac3523564e1bb23469455fdba560) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:48.737935 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9379cf9-3de0-4005-928f-40b5f6a34232 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:48.738920 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:48.739674 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9379cf9-3de0-4005-928f-40b5f6a34232 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:48.746668 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 271/536] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:07:48 2022] GET /identity/v3/role_assignments?user.id=6a75ac3523564e1bb23469455fdba560&scope.project.id=95d88dece7184bf1842c4f8d275d52cd&role.id=876fd0d181d74df4bbc73b2db1c42fbe => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:48.747593 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9379cf9-3de0-4005-928f-40b5f6a34232 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:48.778055 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a284c15-dbeb-4281-a49f-2b0528f291aa None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:48.818597 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441569a2-6f7e-444c-a45e-08c424047abe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:48.819796 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441569a2-6f7e-444c-a45e-08c424047abe None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:48.820281 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441569a2-6f7e-444c-a45e-08c424047abe None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:48.820806 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441569a2-6f7e-444c-a45e-08c424047abe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:48.821898 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441569a2-6f7e-444c-a45e-08c424047abe None admin] RBAC: Adding query filter params (role.id=876fd0d181d74df4bbc73b2db1c42fbe, scope.project.id=95d88dece7184bf1842c4f8d275d52cd, user.id=5c09080c507f4c35b81d482cfbaa6a88) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:48.822413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441569a2-6f7e-444c-a45e-08c424047abe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:48.824127 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441569a2-6f7e-444c-a45e-08c424047abe None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:48.830785 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 266/537] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:07:48 2022] GET /identity/v3/role_assignments?user.id=5c09080c507f4c35b81d482cfbaa6a88&scope.project.id=95d88dece7184bf1842c4f8d275d52cd&role.id=876fd0d181d74df4bbc73b2db1c42fbe => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:48.891465 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9379cf9-3de0-4005-928f-40b5f6a34232 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:48.948913 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ca04d-1a8a-4e5c-a1e0-1c39ec738ac3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:48.949466 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ca04d-1a8a-4e5c-a1e0-1c39ec738ac3 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:48.949746 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ca04d-1a8a-4e5c-a1e0-1c39ec738ac3 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:48.950017 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3ca04d-1a8a-4e5c-a1e0-1c39ec738ac3 None admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:48.950732 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ca04d-1a8a-4e5c-a1e0-1c39ec738ac3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:48.951034 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ca04d-1a8a-4e5c-a1e0-1c39ec738ac3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:48.952441 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3ca04d-1a8a-4e5c-a1e0-1c39ec738ac3 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:48.966436 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 272/538] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:07:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:48.973475 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441569a2-6f7e-444c-a45e-08c424047abe None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:49.105006 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441569a2-6f7e-444c-a45e-08c424047abe None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:49.141735 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ad94b-fd75-4c57-b975-752efe8c4945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:49.142599 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ad94b-fd75-4c57-b975-752efe8c4945 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:49.142991 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ad94b-fd75-4c57-b975-752efe8c4945 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:49.143272 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075ad94b-fd75-4c57-b975-752efe8c4945 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:49.146276 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:49.152429 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075ad94b-fd75-4c57-b975-752efe8c4945 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:49.153932 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075ad94b-fd75-4c57-b975-752efe8c4945 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:49.167898 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-075ad94b-fd75-4c57-b975-752efe8c4945 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:07:49.167898 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:49.167898 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:49.167898 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:49.167898 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:49.167898 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:49.167898 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:49.167898 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:49.167898 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:49.167898 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:49.167898 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:49.167898 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:49.167898 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:07:49.167898 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:07:49.167898 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:07:49.168982 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:07:49.168982 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:49.168982 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:49.168982 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:49.168982 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:49.168982 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:49.168982 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:49.168982 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:49.168982 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:49.168982 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:49.168982 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:49.168982 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:49.168982 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:49.168982 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:49.168982 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:49.168982 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:49.168982 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:49.170016 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:07:49.170016 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:07:49.170016 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:07:49.170016 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:07:49.170016 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:07:49.170016 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:07:49.170016 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:07:49.170016 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:49.172228 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 267/539] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:07:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:49.177805 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ca04d-1a8a-4e5c-a1e0-1c39ec738ac3 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:49.191945 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:49.327262 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3ca04d-1a8a-4e5c-a1e0-1c39ec738ac3 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:49.362918 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5918b87-a0bc-47e9-ad32-57eca3ec7e63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:49.363548 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5918b87-a0bc-47e9-ad32-57eca3ec7e63 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:49.363832 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5918b87-a0bc-47e9-ad32-57eca3ec7e63 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:49.364109 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5918b87-a0bc-47e9-ad32-57eca3ec7e63 None admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:49.364901 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5918b87-a0bc-47e9-ad32-57eca3ec7e63 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:49.365211 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5918b87-a0bc-47e9-ad32-57eca3ec7e63 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:49.367246 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5918b87-a0bc-47e9-ad32-57eca3ec7e63 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:49.380232 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 273/540] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Aug 5 02:07:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:49.386243 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ad94b-fd75-4c57-b975-752efe8c4945 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:49.492667 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075ad94b-fd75-4c57-b975-752efe8c4945 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:49.527999 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92ee1e-d954-4eeb-aa5b-0b6e9df52393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:49.528656 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92ee1e-d954-4eeb-aa5b-0b6e9df52393 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:49.528939 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92ee1e-d954-4eeb-aa5b-0b6e9df52393 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:49.529211 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92ee1e-d954-4eeb-aa5b-0b6e9df52393 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:49.530003 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d92ee1e-d954-4eeb-aa5b-0b6e9df52393 None admin] RBAC: Adding query filter params (role.id=876fd0d181d74df4bbc73b2db1c42fbe, scope.project.id=95d88dece7184bf1842c4f8d275d52cd, user.id=f81daf3da9b34e7380c61005019a53bd) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:49.530312 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d92ee1e-d954-4eeb-aa5b-0b6e9df52393 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:49.531739 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d92ee1e-d954-4eeb-aa5b-0b6e9df52393 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:49.537780 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 268/541] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:07:49 2022] GET /identity/v3/role_assignments?user.id=f81daf3da9b34e7380c61005019a53bd&scope.project.id=95d88dece7184bf1842c4f8d275d52cd&role.id=876fd0d181d74df4bbc73b2db1c42fbe => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:49.682731 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b517936-4ee6-440b-a8a5-b6bd5c1615ed None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:49.683077 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b517936-4ee6-440b-a8a5-b6bd5c1615ed None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:49.683303 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b517936-4ee6-440b-a8a5-b6bd5c1615ed None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:49.685028 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 274/542] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:49.690775 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602422fe-7587-4e30-be39-e9b2abfd415c None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:49.691062 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602422fe-7587-4e30-be39-e9b2abfd415c None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:49.691337 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602422fe-7587-4e30-be39-e9b2abfd415c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:49.711033 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-602422fe-7587-4e30-be39-e9b2abfd415c None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:49.712422 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-602422fe-7587-4e30-be39-e9b2abfd415c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:49.771828 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:49.784468 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 269/543] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:07:49.807301 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b517936-4ee6-440b-a8a5-b6bd5c1615ed None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:49.918089 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:49.962886 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b517936-4ee6-440b-a8a5-b6bd5c1615ed None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:50.010302 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6fb2e0-de14-4b8f-aa2c-85d3822cea6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:50.011006 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6fb2e0-de14-4b8f-aa2c-85d3822cea6f None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:50.011287 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6fb2e0-de14-4b8f-aa2c-85d3822cea6f None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:50.011562 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd6fb2e0-de14-4b8f-aa2c-85d3822cea6f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:50.026568 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd6fb2e0-de14-4b8f-aa2c-85d3822cea6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:50.032211 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-dd6fb2e0-de14-4b8f-aa2c-85d3822cea6f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:07:50.032211 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:50.032211 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:50.032211 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:50.032211 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:50.032211 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:50.032211 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:50.032211 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:50.032211 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:50.032211 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:50.032211 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:50.032211 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:50.032211 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:50.032211 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:50.032211 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:50.032211 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:50.033130 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:50.033130 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:50.033130 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:50.033130 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:50.033130 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:50.033130 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:50.033130 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:50.033130 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:50.033130 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:50.033130 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:50.033130 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:50.033130 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:50.033130 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:50.033130 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:50.033130 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:50.033130 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:50.034313 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:50.034313 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:50.034313 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:50.034313 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:50.034313 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:50.034313 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:50.034313 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:50.034313 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:50.034313 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:50.034313 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:50.034313 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:07:50.034313 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:50.034313 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 275/544] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Aug 5 02:07:49 2022] GET /identity/v3/roles/service => generated 85 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:50.040104 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602422fe-7587-4e30-be39-e9b2abfd415c None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:50.166213 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602422fe-7587-4e30-be39-e9b2abfd415c None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:50.205242 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62f8d3-da54-440f-addd-164b313a3d34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:50.205859 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62f8d3-da54-440f-addd-164b313a3d34 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:50.206137 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62f8d3-da54-440f-addd-164b313a3d34 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:50.206412 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e62f8d3-da54-440f-addd-164b313a3d34 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:50.207126 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62f8d3-da54-440f-addd-164b313a3d34 None admin] RBAC: Adding query filter params (name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:50.207424 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62f8d3-da54-440f-addd-164b313a3d34 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:50.208883 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e62f8d3-da54-440f-addd-164b313a3d34 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:50.218137 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 270/545] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Aug 5 02:07:50 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:50.223880 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6fb2e0-de14-4b8f-aa2c-85d3822cea6f None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:50.360949 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd6fb2e0-de14-4b8f-aa2c-85d3822cea6f None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:50.397124 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:50.406209 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4d5544-b520-4c64-a783-c7579839fb8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:50.407184 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d5544-b520-4c64-a783-c7579839fb8f None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:50.407862 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d5544-b520-4c64-a783-c7579839fb8f None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:50.408144 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4d5544-b520-4c64-a783-c7579839fb8f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:50.421879 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4d5544-b520-4c64-a783-c7579839fb8f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:50.423354 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4d5544-b520-4c64-a783-c7579839fb8f None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:50.442281 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-bd4d5544-b520-4c64-a783-c7579839fb8f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:50.442281 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:50.442281 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:50.442281 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:50.442281 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:50.442281 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:50.442281 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:50.442281 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:50.442281 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:50.442281 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:50.442281 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:50.442281 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:50.442281 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:07:50.442281 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:07:50.442281 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:07:50.443159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:07:50.443159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:50.443159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:50.443159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:50.443159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:50.443159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:50.443159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:50.443159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:50.443159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:50.443159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:50.443159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:50.443159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:50.443159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:50.443159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:50.443159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:50.443159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:50.443159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:50.444183 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:07:50.444183 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:07:50.444183 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:50.444183 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:50.444183 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 276/546] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:07:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:50.449736 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62f8d3-da54-440f-addd-164b313a3d34 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:50.523321 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:50.553043 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940f1e2-9477-4be1-828d-090e733d6c37 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:50.553353 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940f1e2-9477-4be1-828d-090e733d6c37 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:50.553582 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3940f1e2-9477-4be1-828d-090e733d6c37 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:50.555347 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 277/547] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:50.560099 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1cfb4-28a6-4986-9bc4-edf8e05e933c None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:50.560423 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1cfb4-28a6-4986-9bc4-edf8e05e933c None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:50.560702 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c1cfb4-28a6-4986-9bc4-edf8e05e933c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:50.578899 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e62f8d3-da54-440f-addd-164b313a3d34 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:50.601374 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-86c1cfb4-28a6-4986-9bc4-edf8e05e933c None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:50.603567 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-86c1cfb4-28a6-4986-9bc4-edf8e05e933c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:50.641889 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb044c-82a2-469c-aef6-b6caee49dfd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:50.642840 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb044c-82a2-469c-aef6-b6caee49dfd9 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:50.644188 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb044c-82a2-469c-aef6-b6caee49dfd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:50.647559 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bb044c-82a2-469c-aef6-b6caee49dfd9 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:50.649160 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb044c-82a2-469c-aef6-b6caee49dfd9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:50.649662 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb044c-82a2-469c-aef6-b6caee49dfd9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:50.651235 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bb044c-82a2-469c-aef6-b6caee49dfd9 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:50.675031 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 271/548] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:07:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:50.680912 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb044c-82a2-469c-aef6-b6caee49dfd9 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:50.743651 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 278/549] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:07:50.766093 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1cfb4-28a6-4986-9bc4-edf8e05e933c None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:50.806588 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bb044c-82a2-469c-aef6-b6caee49dfd9 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:50.824795 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:50.846001 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e2705-9db2-4224-ae94-a1fd5e87ccf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:50.847223 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e2705-9db2-4224-ae94-a1fd5e87ccf8 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:50.847706 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e2705-9db2-4224-ae94-a1fd5e87ccf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:50.848156 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4e2705-9db2-4224-ae94-a1fd5e87ccf8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:50.865392 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e2705-9db2-4224-ae94-a1fd5e87ccf8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:50.867359 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4e2705-9db2-4224-ae94-a1fd5e87ccf8 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:50.886390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-9f4e2705-9db2-4224-ae94-a1fd5e87ccf8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 05 02:07:50.886390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:50.886390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:50.886390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:50.886390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:50.886390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:50.886390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:50.886390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:50.886390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:50.886390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:50.886390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:50.886390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:50.886390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:07:50.886390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:07:50.886390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:07:50.886390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:07:50.887849 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:50.887849 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:50.887849 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:07:50.887849 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:07:50.887849 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:07:50.887849 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:07:50.887849 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:50.887849 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:50.887849 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:50.887849 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:50.887849 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:50.887849 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:50.887849 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:50.887849 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:50.887849 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:50.887849 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:50.887849 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:50.887849 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:50.888945 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:50.888945 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:50.888945 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:07:50.888945 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:07:50.888945 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:07:50.888945 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:07:50.888945 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:07:50.888945 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:07:50.888945 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 05 02:07:50.888945 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:50.896138 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 272/550] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Aug 5 02:07:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:50.902381 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e2705-9db2-4224-ae94-a1fd5e87ccf8 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:50.949007 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c1cfb4-28a6-4986-9bc4-edf8e05e933c None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:50.973055 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:51.026782 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54caeb5b-ff26-4f3b-be0a-c0083d83cd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:51.027443 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54caeb5b-ff26-4f3b-be0a-c0083d83cd2f None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:51.027728 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54caeb5b-ff26-4f3b-be0a-c0083d83cd2f None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:51.028003 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54caeb5b-ff26-4f3b-be0a-c0083d83cd2f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:51.058232 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54caeb5b-ff26-4f3b-be0a-c0083d83cd2f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:51.063934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-54caeb5b-ff26-4f3b-be0a-c0083d83cd2f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:07:51.063934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:51.063934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:51.063934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:51.063934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:51.063934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:51.063934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:51.063934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:51.063934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:51.063934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:51.063934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:51.063934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:51.063934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:51.063934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:51.063934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:51.063934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:51.065062 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:51.065062 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:51.065062 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:51.065062 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:51.065062 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:51.065062 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:51.065062 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:51.065062 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:51.065062 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:51.065062 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:51.065062 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:51.065062 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:51.065062 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:51.065062 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:51.065062 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:51.065062 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:51.066073 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:51.066073 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:51.066073 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:51.066073 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:51.066073 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:51.066073 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:51.066073 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:51.066073 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:51.066073 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:51.066073 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:51.066073 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:07:51.066073 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:51.066073 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 279/551] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Aug 5 02:07:50 2022] GET /identity/v3/roles/service => generated 85 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:07:51.073266 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54caeb5b-ff26-4f3b-be0a-c0083d83cd2f None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:51.089388 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4e2705-9db2-4224-ae94-a1fd5e87ccf8 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:51.125414 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a63b6e-75ee-4256-adca-44f82462a9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:51.126413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a63b6e-75ee-4256-adca-44f82462a9fc None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:51.126882 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a63b6e-75ee-4256-adca-44f82462a9fc None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:51.127295 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a63b6e-75ee-4256-adca-44f82462a9fc None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:51.128351 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a63b6e-75ee-4256-adca-44f82462a9fc None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:51.128801 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a63b6e-75ee-4256-adca-44f82462a9fc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:51.130346 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27a63b6e-75ee-4256-adca-44f82462a9fc None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:51.149820 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 273/552] 10.222.0.15 () {56 vars in 1135 bytes} [Fri Aug 5 02:07:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:07:51.155450 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a63b6e-75ee-4256-adca-44f82462a9fc None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:51.204684 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:51.260191 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27a63b6e-75ee-4256-adca-44f82462a9fc None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:51.295931 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62482f-b8bc-4852-b7e6-f7934dd077c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:51.296812 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62482f-b8bc-4852-b7e6-f7934dd077c8 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:51.297235 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62482f-b8bc-4852-b7e6-f7934dd077c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:51.297678 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62482f-b8bc-4852-b7e6-f7934dd077c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:51.326431 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54caeb5b-ff26-4f3b-be0a-c0083d83cd2f None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:51.369538 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e62482f-b8bc-4852-b7e6-f7934dd077c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:51.371231 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e62482f-b8bc-4852-b7e6-f7934dd077c8 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:51.403948 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3f52e-e272-474b-89a9-b32d47c4fa43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:51.404610 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3f52e-e272-474b-89a9-b32d47c4fa43 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:51.404895 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3f52e-e272-474b-89a9-b32d47c4fa43 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:51.405172 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4b3f52e-e272-474b-89a9-b32d47c4fa43 None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:51.405903 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3f52e-e272-474b-89a9-b32d47c4fa43 None admin] RBAC: Adding query filter params (name=service) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:51.406208 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3f52e-e272-474b-89a9-b32d47c4fa43 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:51.407979 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4b3f52e-e272-474b-89a9-b32d47c4fa43 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:51.427978 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:51.432629 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 280/553] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Aug 5 02:07:51 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:51.433743 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3f52e-e272-474b-89a9-b32d47c4fa43 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:51.479611 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 274/554] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:07:51 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:07:51.485594 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62482f-b8bc-4852-b7e6-f7934dd077c8 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:51.489600 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:51.567729 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4b3f52e-e272-474b-89a9-b32d47c4fa43 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:51.597016 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62482f-b8bc-4852-b7e6-f7934dd077c8 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:51.603358 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337a0c98-1454-439d-ae22-5661e08e3c68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:51.604121 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a0c98-1454-439d-ae22-5661e08e3c68 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:51.604434 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a0c98-1454-439d-ae22-5661e08e3c68 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:51.604715 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337a0c98-1454-439d-ae22-5661e08e3c68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:51.615295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a0c98-1454-439d-ae22-5661e08e3c68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:51.617297 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337a0c98-1454-439d-ae22-5661e08e3c68 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:51.629791 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:51.631527 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-337a0c98-1454-439d-ae22-5661e08e3c68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:51.631527 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:51.631527 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:51.631527 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:51.631527 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:51.631527 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:51.631527 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:51.631527 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:51.631527 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:51.631527 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:51.631527 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:51.631527 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:51.631527 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:07:51.631527 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:07:51.631527 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:07:51.633364 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:07:51.633364 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:51.633364 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:51.633364 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:51.633364 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:51.633364 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:51.633364 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:51.633364 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:51.633364 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:51.633364 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:51.633364 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:51.633364 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:51.633364 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:51.633364 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:51.633364 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:51.633364 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:51.633364 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:51.634236 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:07:51.634236 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:07:51.634236 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:51.634236 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:51.638179 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 281/555] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:07:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:51.639244 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96539422-1245-4574-8f80-38016fa5d67a None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:51.639357 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773c3dad-dde5-41b6-91bd-1a3df3040af4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:51.639552 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96539422-1245-4574-8f80-38016fa5d67a None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:51.639808 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96539422-1245-4574-8f80-38016fa5d67a None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:51.639901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c3dad-dde5-41b6-91bd-1a3df3040af4 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:51.640153 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c3dad-dde5-41b6-91bd-1a3df3040af4 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:51.640466 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773c3dad-dde5-41b6-91bd-1a3df3040af4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:51.641305 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 282/556] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:51.642294 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214db437-07f1-4818-a86f-1b945338ac7f None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:51.642648 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214db437-07f1-4818-a86f-1b945338ac7f None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:51.642859 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214db437-07f1-4818-a86f-1b945338ac7f None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:51.644307 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 283/557] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:51.645105 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214db437-07f1-4818-a86f-1b945338ac7f None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:51.659816 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c3dad-dde5-41b6-91bd-1a3df3040af4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:51.661369 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-773c3dad-dde5-41b6-91bd-1a3df3040af4 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:51.682718 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-773c3dad-dde5-41b6-91bd-1a3df3040af4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:51.682718 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:51.682718 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:51.682718 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:51.682718 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:51.682718 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:51.682718 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:51.682718 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:51.682718 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:51.682718 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:51.682718 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:51.682718 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:51.682718 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:07:51.682718 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:07:51.682718 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:07:51.684124 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:07:51.684124 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:51.684124 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:51.684124 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:51.684124 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:51.684124 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:51.684124 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:51.684124 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:51.684124 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:51.684124 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:51.684124 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:51.684124 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:51.684124 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:51.684124 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:51.684124 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:51.684124 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:51.684124 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:51.690039 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:07:51.690039 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:07:51.690039 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:51.690039 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:51.690039 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 275/558] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:07:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:07:51.690039 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e7581-0cfd-4766-ba0f-bb80d1aae0c7 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:51.690039 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e7581-0cfd-4766-ba0f-bb80d1aae0c7 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:51.690039 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5e7581-0cfd-4766-ba0f-bb80d1aae0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:51.707596 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-ef5e7581-0cfd-4766-ba0f-bb80d1aae0c7 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:51.708936 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-ef5e7581-0cfd-4766-ba0f-bb80d1aae0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:51.736686 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:51.754282 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214db437-07f1-4818-a86f-1b945338ac7f None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:51.788057 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 276/559] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:07:51.789713 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e7d83-0557-4fde-8cfc-06de0bce4f6e None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:51.790005 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e7d83-0557-4fde-8cfc-06de0bce4f6e None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:51.790283 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-329e7d83-0557-4fde-8cfc-06de0bce4f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:51.793107 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede34a9-0fcd-44f1-9057-dca199e056a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:51.793796 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede34a9-0fcd-44f1-9057-dca199e056a0 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:51.794150 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede34a9-0fcd-44f1-9057-dca199e056a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:51.794495 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ede34a9-0fcd-44f1-9057-dca199e056a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:51.795262 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede34a9-0fcd-44f1-9057-dca199e056a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:51.795654 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede34a9-0fcd-44f1-9057-dca199e056a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:51.797120 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ede34a9-0fcd-44f1-9057-dca199e056a0 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:51.810709 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 284/560] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:07:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:51.811747 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede34a9-0fcd-44f1-9057-dca199e056a0 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:51.821050 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-329e7d83-0557-4fde-8cfc-06de0bce4f6e None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:51.823273 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-329e7d83-0557-4fde-8cfc-06de0bce4f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:51.901137 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 277/561] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:07:51.901898 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e7d83-0557-4fde-8cfc-06de0bce4f6e None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:51.927502 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ede34a9-0fcd-44f1-9057-dca199e056a0 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:51.954270 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:51.964097 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6c909-a04f-4291-971c-2f73603809f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:51.964733 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6c909-a04f-4291-971c-2f73603809f9 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:51.965016 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6c909-a04f-4291-971c-2f73603809f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:51.965297 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61d6c909-a04f-4291-971c-2f73603809f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:51.965989 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d6c909-a04f-4291-971c-2f73603809f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:51.966293 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d6c909-a04f-4291-971c-2f73603809f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:51.967676 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61d6c909-a04f-4291-971c-2f73603809f9 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:51.980191 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 285/562] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:07:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:51.985233 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6c909-a04f-4291-971c-2f73603809f9 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:51.988737 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:52.017290 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-329e7d83-0557-4fde-8cfc-06de0bce4f6e None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:52.054921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e17c5-19a9-4b80-9250-76138812d83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:52.055564 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e17c5-19a9-4b80-9250-76138812d83f None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:52.055846 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e17c5-19a9-4b80-9250-76138812d83f None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:52.056119 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1e17c5-19a9-4b80-9250-76138812d83f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:52.066299 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1e17c5-19a9-4b80-9250-76138812d83f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:52.071283 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-1f1e17c5-19a9-4b80-9250-76138812d83f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:07:52.071283 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:52.071283 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:52.071283 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:52.071283 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:52.071283 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:52.071283 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:52.071283 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:52.071283 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:52.071283 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:52.071283 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:52.071283 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:52.071283 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:52.071283 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:52.071283 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:52.071283 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:52.072414 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:52.072414 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:52.072414 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:52.072414 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:52.072414 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:52.072414 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:52.072414 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:52.072414 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:52.072414 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:52.072414 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:52.072414 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:52.072414 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:52.072414 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:52.072414 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:52.072414 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:52.072414 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:52.073326 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:52.073326 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:52.073326 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:52.073326 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:52.073326 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:52.073326 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:52.073326 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:52.073326 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:52.073326 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:52.073326 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:52.073326 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:07:52.073326 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:52.073326 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 278/563] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Aug 5 02:07:51 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:52.074056 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e17c5-19a9-4b80-9250-76138812d83f None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:52.093610 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61d6c909-a04f-4291-971c-2f73603809f9 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:52.128077 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da0c65-0790-4ca4-b53c-efdc1bafc691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:52.128743 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da0c65-0790-4ca4-b53c-efdc1bafc691 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:52.129027 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da0c65-0790-4ca4-b53c-efdc1bafc691 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:52.129308 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05da0c65-0790-4ca4-b53c-efdc1bafc691 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:52.137278 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da0c65-0790-4ca4-b53c-efdc1bafc691 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:52.138716 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05da0c65-0790-4ca4-b53c-efdc1bafc691 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:52.150218 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-05da0c65-0790-4ca4-b53c-efdc1bafc691 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 02:07:52.150218 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:52.150218 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:52.150218 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:52.150218 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:52.150218 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:52.150218 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:52.150218 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:52.150218 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:52.150218 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:52.150218 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:52.150218 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:52.150218 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:07:52.150218 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:07:52.150218 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:07:52.150218 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:07:52.151230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:52.151230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:52.151230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:07:52.151230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:07:52.151230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:07:52.151230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:07:52.151230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:52.151230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:52.151230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:52.151230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:52.151230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:52.151230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:52.151230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:52.151230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:52.151230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:52.151230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:52.151230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:52.151230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:52.152226 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:52.152226 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:52.152226 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:07:52.152226 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:07:52.152226 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:07:52.152226 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:07:52.152226 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:07:52.152226 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:07:52.152226 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 02:07:52.152226 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:52.152226 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 286/564] 10.222.0.15 () {56 vars in 1093 bytes} [Fri Aug 5 02:07:51 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:52.152226 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da0c65-0790-4ca4-b53c-efdc1bafc691 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:52.178159 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1e17c5-19a9-4b80-9250-76138812d83f None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:52.180556 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:52.214061 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd575da-1623-4729-8326-59e4a88df9bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:52.214699 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd575da-1623-4729-8326-59e4a88df9bc None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:52.214987 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd575da-1623-4729-8326-59e4a88df9bc None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:52.215151 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:52.215263 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd575da-1623-4729-8326-59e4a88df9bc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:52.226486 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd575da-1623-4729-8326-59e4a88df9bc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:52.231450 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-8cd575da-1623-4729-8326-59e4a88df9bc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:07:52.231450 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:52.231450 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:52.231450 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:52.231450 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:52.231450 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:52.231450 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:52.231450 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:52.231450 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:52.231450 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:52.231450 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:52.231450 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:52.231450 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:52.231450 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:52.231450 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:52.231450 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:52.232639 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:52.232639 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:52.232639 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:52.232639 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:52.232639 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:52.232639 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:52.232639 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:52.232639 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:52.232639 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:52.232639 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:52.232639 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:52.232639 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:52.232639 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:52.232639 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:52.232639 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:52.232639 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:52.233477 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:52.233477 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:52.233477 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:52.233477 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:52.233477 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:52.233477 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:52.233477 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:52.233477 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:52.233477 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:52.233477 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:52.233477 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:07:52.233477 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:52.233477 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 279/565] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Aug 5 02:07:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:52.234160 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96f3f9-017b-45b2-9f19-537659b8f9ff None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:52.234442 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96f3f9-017b-45b2-9f19-537659b8f9ff None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:52.234948 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb96f3f9-017b-45b2-9f19-537659b8f9ff None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:52.236089 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 280/566] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:52 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:52.236687 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96f3f9-017b-45b2-9f19-537659b8f9ff None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:52.259678 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05da0c65-0790-4ca4-b53c-efdc1bafc691 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:52.292556 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9baa07-5df1-46bd-b22b-556555cf81f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:52.293179 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9baa07-5df1-46bd-b22b-556555cf81f5 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:52.293455 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9baa07-5df1-46bd-b22b-556555cf81f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:52.293724 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9baa07-5df1-46bd-b22b-556555cf81f5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:52.300206 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9baa07-5df1-46bd-b22b-556555cf81f5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:52.301672 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff9baa07-5df1-46bd-b22b-556555cf81f5 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:52.313764 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-ff9baa07-5df1-46bd-b22b-556555cf81f5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:07:52.313764 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:52.313764 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:52.313764 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:52.313764 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:52.313764 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:52.313764 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:52.313764 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:52.313764 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:52.313764 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:52.313764 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:52.313764 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:52.313764 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:07:52.313764 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:07:52.313764 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:07:52.316251 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:07:52.316251 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:52.316251 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:52.316251 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:52.316251 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:52.316251 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:52.316251 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:52.316251 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:52.316251 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:52.316251 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:52.316251 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:52.316251 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:52.316251 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:52.316251 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:52.316251 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:52.316251 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:52.316251 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:52.319204 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:07:52.319204 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:07:52.319204 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:07:52.319204 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:07:52.319204 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:07:52.319204 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:07:52.319204 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:07:52.319204 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:52.319204 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 287/567] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:07:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:52.319204 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9baa07-5df1-46bd-b22b-556555cf81f5 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:52.342721 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb96f3f9-017b-45b2-9f19-537659b8f9ff None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:52.376472 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd55a3f-3ece-4fb5-91d1-2b87f339145c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:52.377087 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd55a3f-3ece-4fb5-91d1-2b87f339145c None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:52.377371 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd55a3f-3ece-4fb5-91d1-2b87f339145c None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:52.377650 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd55a3f-3ece-4fb5-91d1-2b87f339145c None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:52.378364 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd55a3f-3ece-4fb5-91d1-2b87f339145c None admin] RBAC: Adding query filter params (name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:52.378670 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd55a3f-3ece-4fb5-91d1-2b87f339145c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:52.380031 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd55a3f-3ece-4fb5-91d1-2b87f339145c None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:52.388109 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 281/568] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Aug 5 02:07:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:52.388926 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd55a3f-3ece-4fb5-91d1-2b87f339145c None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:52.416248 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:52.418500 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9baa07-5df1-46bd-b22b-556555cf81f5 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:52.441158 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:52.452108 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39aa41fc-cbc7-4370-a160-92094d28a636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:52.452749 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa41fc-cbc7-4370-a160-92094d28a636 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:52.453031 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa41fc-cbc7-4370-a160-92094d28a636 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:52.453302 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39aa41fc-cbc7-4370-a160-92094d28a636 None admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:52.454089 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa41fc-cbc7-4370-a160-92094d28a636 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:52.454438 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa41fc-cbc7-4370-a160-92094d28a636 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:52.455866 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39aa41fc-cbc7-4370-a160-92094d28a636 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:52.473607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 288/569] 10.222.0.15 () {56 vars in 1133 bytes} [Fri Aug 5 02:07:52 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:52.474842 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f62f5-59c1-42fc-8807-428b9316bc02 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:52.475126 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f62f5-59c1-42fc-8807-428b9316bc02 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:52.475401 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975f62f5-59c1-42fc-8807-428b9316bc02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:52.493269 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd55a3f-3ece-4fb5-91d1-2b87f339145c None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:52.493447 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-975f62f5-59c1-42fc-8807-428b9316bc02 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:52.494930 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-975f62f5-59c1-42fc-8807-428b9316bc02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:52.528467 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba8ea3-8697-4a53-9ff0-2515615c40fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:52.529082 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba8ea3-8697-4a53-9ff0-2515615c40fc None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:52.529358 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba8ea3-8697-4a53-9ff0-2515615c40fc None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:52.529627 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ba8ea3-8697-4a53-9ff0-2515615c40fc None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:52.530339 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba8ea3-8697-4a53-9ff0-2515615c40fc None admin] RBAC: Adding query filter params (name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:52.530637 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba8ea3-8697-4a53-9ff0-2515615c40fc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:52.531977 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ba8ea3-8697-4a53-9ff0-2515615c40fc None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:52.540950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 282/570] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Aug 5 02:07:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:52.545574 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba8ea3-8697-4a53-9ff0-2515615c40fc None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:52.565365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 289/571] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:07:52.566288 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f62f5-59c1-42fc-8807-428b9316bc02 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:52.629784 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:52.644826 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ba8ea3-8697-4a53-9ff0-2515615c40fc None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:52.666155 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975f62f5-59c1-42fc-8807-428b9316bc02 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:52.677811 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a443c74-fd12-4340-9b32-3eaf286af2c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:52.678421 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a443c74-fd12-4340-9b32-3eaf286af2c0 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:52.678723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a443c74-fd12-4340-9b32-3eaf286af2c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:52.679484 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:52.679623 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a443c74-fd12-4340-9b32-3eaf286af2c0 None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:52.680483 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a443c74-fd12-4340-9b32-3eaf286af2c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:52.681013 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a443c74-fd12-4340-9b32-3eaf286af2c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:52.682552 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a443c74-fd12-4340-9b32-3eaf286af2c0 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:52.694182 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 283/572] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Aug 5 02:07:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:52.695082 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a443c74-fd12-4340-9b32-3eaf286af2c0 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:52.701304 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deffb174-9dc6-42bd-8554-c02e7b0b9f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:52.701936 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deffb174-9dc6-42bd-8554-c02e7b0b9f99 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:52.702212 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deffb174-9dc6-42bd-8554-c02e7b0b9f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:52.702497 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deffb174-9dc6-42bd-8554-c02e7b0b9f99 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:52.712826 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deffb174-9dc6-42bd-8554-c02e7b0b9f99 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:52.714261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deffb174-9dc6-42bd-8554-c02e7b0b9f99 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:52.729198 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-deffb174-9dc6-42bd-8554-c02e7b0b9f99 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:52.729198 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:52.729198 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:52.729198 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:52.729198 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:52.729198 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:52.729198 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:52.729198 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:52.729198 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:52.729198 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:52.729198 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:52.729198 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:52.729198 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:07:52.729198 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:07:52.729198 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:07:52.730123 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:07:52.730123 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:52.730123 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:52.730123 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:52.730123 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:52.730123 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:52.730123 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:52.730123 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:52.730123 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:52.730123 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:52.730123 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:52.730123 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:52.730123 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:52.730123 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:52.730123 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:52.730123 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:52.730123 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:52.731097 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:07:52.731097 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:07:52.731097 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:52.731097 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:52.731097 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 290/573] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:07:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:52.731097 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deffb174-9dc6-42bd-8554-c02e7b0b9f99 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:52.793233 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a443c74-fd12-4340-9b32-3eaf286af2c0 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:52.826657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd9dee-f2df-4924-bdc7-c2ba37d3160a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:52.827304 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd9dee-f2df-4924-bdc7-c2ba37d3160a None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:52.827574 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd9dee-f2df-4924-bdc7-c2ba37d3160a None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:52.827849 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48fd9dee-f2df-4924-bdc7-c2ba37d3160a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:52.833229 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deffb174-9dc6-42bd-8554-c02e7b0b9f99 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:52.840722 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd9dee-f2df-4924-bdc7-c2ba37d3160a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:52.843224 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48fd9dee-f2df-4924-bdc7-c2ba37d3160a None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:52.854107 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:52.862888 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-48fd9dee-f2df-4924-bdc7-c2ba37d3160a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:52.862888 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:52.862888 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:52.862888 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:52.862888 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:52.862888 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:52.862888 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:52.862888 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:52.862888 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:52.862888 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:52.862888 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:52.862888 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:52.862888 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:07:52.862888 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:07:52.862888 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:07:52.863955 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:07:52.863955 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:52.863955 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:52.863955 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:52.863955 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:52.863955 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:52.863955 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:52.863955 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:52.863955 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:52.863955 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:52.863955 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:52.863955 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:52.863955 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:52.863955 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:52.863955 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:52.863955 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:52.863955 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:52.865528 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:07:52.865528 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:07:52.865528 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:52.865528 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:52.865528 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 284/574] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:07:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:52.865528 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd9dee-f2df-4924-bdc7-c2ba37d3160a None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:52.872896 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b28d8e-1875-411a-abe9-b06db5125ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:52.873563 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b28d8e-1875-411a-abe9-b06db5125ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:52.873847 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b28d8e-1875-411a-abe9-b06db5125ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:52.874133 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b28d8e-1875-411a-abe9-b06db5125ba4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:52.885808 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b28d8e-1875-411a-abe9-b06db5125ba4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:52.887246 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b28d8e-1875-411a-abe9-b06db5125ba4 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:52.901796 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-b9b28d8e-1875-411a-abe9-b06db5125ba4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:52.901796 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:52.901796 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:52.901796 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:52.901796 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:52.901796 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:52.901796 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:52.901796 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:52.901796 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:52.901796 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:52.901796 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:52.901796 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:52.901796 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:07:52.901796 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:07:52.901796 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:07:52.902671 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:07:52.902671 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:52.902671 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:52.902671 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:52.902671 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:52.902671 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:52.902671 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:52.902671 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:52.902671 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:52.902671 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:52.902671 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:52.902671 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:52.902671 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:52.902671 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:52.902671 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:52.902671 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:52.902671 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:52.903682 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:07:52.903682 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:07:52.903682 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:52.903682 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:52.903682 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 291/575] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:07:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:52.903682 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b28d8e-1875-411a-abe9-b06db5125ba4 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:52.921710 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:52.970032 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48fd9dee-f2df-4924-bdc7-c2ba37d3160a None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:53.003179 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04817392-674a-4be8-afdc-3826f1ba1c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:53.003813 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04817392-674a-4be8-afdc-3826f1ba1c41 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:53.003910 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b28d8e-1875-411a-abe9-b06db5125ba4 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:53.004389 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04817392-674a-4be8-afdc-3826f1ba1c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:53.004389 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04817392-674a-4be8-afdc-3826f1ba1c41 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:53.014985 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04817392-674a-4be8-afdc-3826f1ba1c41 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:53.020432 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-04817392-674a-4be8-afdc-3826f1ba1c41 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:07:53.020432 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:53.020432 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:53.020432 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:53.020432 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:53.020432 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:53.020432 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:53.020432 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:53.020432 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:53.020432 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:53.020432 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:53.020432 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:53.020432 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:53.020432 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:53.020432 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:53.020432 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:53.021345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:53.021345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:53.021345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:53.021345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:53.021345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:53.021345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:53.021345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:53.021345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:53.021345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:53.021345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:53.021345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:53.021345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:53.021345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:53.021345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:53.021345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:53.021345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:53.022402 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:53.022402 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:53.022402 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:53.022402 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:53.022402 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:53.022402 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:53.022402 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:53.022402 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:53.022402 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:53.022402 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:53.022402 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:07:53.022402 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:53.022402 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 285/576] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Aug 5 02:07:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:53.022402 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04817392-674a-4be8-afdc-3826f1ba1c41 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:53.040808 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0d74b-62ec-4a87-9b3f-a3594452a3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:53.041418 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0d74b-62ec-4a87-9b3f-a3594452a3d8 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:53.041694 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0d74b-62ec-4a87-9b3f-a3594452a3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:53.041966 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf0d74b-62ec-4a87-9b3f-a3594452a3d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:53.042774 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf0d74b-62ec-4a87-9b3f-a3594452a3d8 None admin] RBAC: Adding query filter params (role.id=876fd0d181d74df4bbc73b2db1c42fbe, scope.project.id=95d88dece7184bf1842c4f8d275d52cd, user.id=f03233b0ee3540cdb5105f6603cfdff5) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:53.043079 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf0d74b-62ec-4a87-9b3f-a3594452a3d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:53.044548 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf0d74b-62ec-4a87-9b3f-a3594452a3d8 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:53.049774 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 292/577] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:07:52 2022] GET /identity/v3/role_assignments?user.id=f03233b0ee3540cdb5105f6603cfdff5&scope.project.id=95d88dece7184bf1842c4f8d275d52cd&role.id=876fd0d181d74df4bbc73b2db1c42fbe => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:53.050532 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0d74b-62ec-4a87-9b3f-a3594452a3d8 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:53.103469 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:53.146761 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:53.151883 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04817392-674a-4be8-afdc-3826f1ba1c41 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:53.169822 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf0d74b-62ec-4a87-9b3f-a3594452a3d8 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:53.188848 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ae873-751c-4d7c-8861-80ca20fd4bf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:53.189487 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ae873-751c-4d7c-8861-80ca20fd4bf8 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:53.189769 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ae873-751c-4d7c-8861-80ca20fd4bf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:53.190041 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-109ae873-751c-4d7c-8861-80ca20fd4bf8 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:53.190766 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ae873-751c-4d7c-8861-80ca20fd4bf8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:53.191069 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ae873-751c-4d7c-8861-80ca20fd4bf8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:53.192490 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-109ae873-751c-4d7c-8861-80ca20fd4bf8 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:53.210388 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 286/578] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:53.211316 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ae873-751c-4d7c-8861-80ca20fd4bf8 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:53.219219 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72d0c9-de9a-4450-98e1-7a6335524dd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:53.219838 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72d0c9-de9a-4450-98e1-7a6335524dd8 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:53.220161 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72d0c9-de9a-4450-98e1-7a6335524dd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:53.220868 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe72d0c9-de9a-4450-98e1-7a6335524dd8 None admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:53.221814 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe72d0c9-de9a-4450-98e1-7a6335524dd8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:53.222121 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe72d0c9-de9a-4450-98e1-7a6335524dd8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:53.224144 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe72d0c9-de9a-4450-98e1-7a6335524dd8 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:53.237228 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 293/579] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:53.238053 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72d0c9-de9a-4450-98e1-7a6335524dd8 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:53.321432 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-109ae873-751c-4d7c-8861-80ca20fd4bf8 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:53.341162 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:53.349346 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe72d0c9-de9a-4450-98e1-7a6335524dd8 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:53.360560 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709fecf-9cf6-4a40-858b-71112c5e9540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:53.361184 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709fecf-9cf6-4a40-858b-71112c5e9540 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:53.361460 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709fecf-9cf6-4a40-858b-71112c5e9540 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:53.361730 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d709fecf-9cf6-4a40-858b-71112c5e9540 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:53.362421 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709fecf-9cf6-4a40-858b-71112c5e9540 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:53.362728 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709fecf-9cf6-4a40-858b-71112c5e9540 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:53.364098 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d709fecf-9cf6-4a40-858b-71112c5e9540 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:53.377714 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 287/580] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:53.378542 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709fecf-9cf6-4a40-858b-71112c5e9540 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:53.392431 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5b5b4-f6f6-4c24-b562-53030abd747e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:53.393070 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5b5b4-f6f6-4c24-b562-53030abd747e None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:53.393338 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5b5b4-f6f6-4c24-b562-53030abd747e None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:53.393614 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa5b5b4-f6f6-4c24-b562-53030abd747e None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:53.394343 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa5b5b4-f6f6-4c24-b562-53030abd747e None admin] RBAC: Adding query filter params (name=service) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:53.394656 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa5b5b4-f6f6-4c24-b562-53030abd747e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:53.396032 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa5b5b4-f6f6-4c24-b562-53030abd747e None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:53.410051 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 294/581] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Aug 5 02:07:53 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:53.410051 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5b5b4-f6f6-4c24-b562-53030abd747e None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:53.412988 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:53.489040 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d709fecf-9cf6-4a40-858b-71112c5e9540 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:53.516096 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa5b5b4-f6f6-4c24-b562-53030abd747e None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:53.525659 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37630b-7db9-4e95-8709-92dfc083faa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:53.526297 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37630b-7db9-4e95-8709-92dfc083faa8 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:53.526576 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37630b-7db9-4e95-8709-92dfc083faa8 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:53.526847 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e37630b-7db9-4e95-8709-92dfc083faa8 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:53.534342 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e37630b-7db9-4e95-8709-92dfc083faa8 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:53.535785 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e37630b-7db9-4e95-8709-92dfc083faa8 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:53.552839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-5e37630b-7db9-4e95-8709-92dfc083faa8 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 05 02:07:53.552839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:53.552839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:53.552839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:53.552839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:53.552839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:53.552839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:53.552839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:53.552839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:53.552839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:53.552839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:53.552839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:53.552839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:07:53.552839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:07:53.552839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:07:53.552839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:07:53.554723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:53.554723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:53.554723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:07:53.554723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:07:53.554723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:07:53.554723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:07:53.554723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:53.554723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:53.554723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:53.554723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:53.554723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:53.554723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:53.554723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:53.554723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:53.554723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:53.554723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:53.554723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:53.554723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:53.555721 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:53.555721 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:53.555721 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:07:53.555721 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:07:53.555721 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:07:53.555721 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:07:53.555721 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:07:53.555721 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:07:53.555721 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 05 02:07:53.555721 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:53.555721 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 288/582] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:07:53 2022] GET /identity/v3/users/glance => generated 84 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:53.556875 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37630b-7db9-4e95-8709-92dfc083faa8 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:53.560674 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050648b-b98e-4346-a75a-4fb93aaefb32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:53.561395 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050648b-b98e-4346-a75a-4fb93aaefb32 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:53.561681 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050648b-b98e-4346-a75a-4fb93aaefb32 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:53.561958 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c050648b-b98e-4346-a75a-4fb93aaefb32 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:53.569328 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c050648b-b98e-4346-a75a-4fb93aaefb32 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:53.570891 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c050648b-b98e-4346-a75a-4fb93aaefb32 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:53.582645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-c050648b-b98e-4346-a75a-4fb93aaefb32 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:07:53.582645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:53.582645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:53.582645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:53.582645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:53.582645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:53.582645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:53.582645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:53.582645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:53.582645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:53.582645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:53.582645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:53.582645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:07:53.582645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:07:53.582645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:07:53.583520 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:07:53.583520 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:53.583520 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:53.583520 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:53.583520 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:53.583520 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:53.583520 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:53.583520 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:53.583520 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:53.583520 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:53.583520 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:53.583520 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:53.583520 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:53.583520 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:53.583520 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:53.583520 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:53.583520 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:53.584427 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:07:53.584427 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:07:53.584427 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:07:53.584427 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:07:53.584427 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:07:53.584427 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:07:53.584427 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:07:53.584427 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:53.584427 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 295/583] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:07:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:53.585367 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050648b-b98e-4346-a75a-4fb93aaefb32 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:53.604900 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:53.649883 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:53.670058 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e37630b-7db9-4e95-8709-92dfc083faa8 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:53.694030 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c050648b-b98e-4346-a75a-4fb93aaefb32 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:53.708905 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5928d-3ab5-4328-87b8-c66dbd1bd5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:53.709825 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5928d-3ab5-4328-87b8-c66dbd1bd5d1 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:53.710903 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5928d-3ab5-4328-87b8-c66dbd1bd5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:53.711383 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee5928d-3ab5-4328-87b8-c66dbd1bd5d1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:53.719217 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee5928d-3ab5-4328-87b8-c66dbd1bd5d1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:53.720970 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee5928d-3ab5-4328-87b8-c66dbd1bd5d1 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:53.729533 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba798e-9786-43cb-85f5-5af6c7ffbc9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:53.730175 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba798e-9786-43cb-85f5-5af6c7ffbc9a None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:53.730454 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba798e-9786-43cb-85f5-5af6c7ffbc9a None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:53.730733 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcba798e-9786-43cb-85f5-5af6c7ffbc9a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:53.735857 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-8ee5928d-3ab5-4328-87b8-c66dbd1bd5d1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 02:07:53.735857 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:53.735857 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:53.735857 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:53.735857 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:53.735857 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:53.735857 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:53.735857 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:53.735857 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:53.735857 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:53.735857 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:53.735857 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:53.735857 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:07:53.735857 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:07:53.735857 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:07:53.735857 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:07:53.736993 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:53.736993 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:53.736993 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:07:53.736993 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:07:53.736993 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:07:53.736993 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:07:53.736993 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:53.736993 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:53.736993 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:53.736993 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:53.736993 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:53.736993 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:53.736993 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:53.736993 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:53.736993 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:53.736993 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:53.736993 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:53.736993 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:53.738109 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:53.738109 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:53.738109 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:07:53.738109 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:07:53.738109 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:07:53.738109 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:07:53.738109 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:07:53.738109 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:07:53.738109 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 02:07:53.738109 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:53.739940 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 289/584] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:07:53 2022] GET /identity/v3/users/cinder => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:53.740895 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5928d-3ab5-4328-87b8-c66dbd1bd5d1 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:53.746674 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba798e-9786-43cb-85f5-5af6c7ffbc9a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:53.748149 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcba798e-9786-43cb-85f5-5af6c7ffbc9a None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:53.763788 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-fcba798e-9786-43cb-85f5-5af6c7ffbc9a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:53.763788 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:53.763788 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:53.763788 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:53.763788 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:53.763788 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:53.763788 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:53.763788 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:53.763788 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:53.763788 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:53.763788 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:53.763788 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:53.763788 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:07:53.763788 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:07:53.763788 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:07:53.764781 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:07:53.764781 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:53.764781 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:53.764781 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:53.764781 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:53.764781 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:53.764781 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:53.764781 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:53.764781 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:53.764781 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:53.764781 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:53.764781 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:53.764781 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:53.764781 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:53.764781 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:53.764781 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:53.764781 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:53.765679 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:07:53.765679 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:07:53.765679 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:53.765679 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:53.765679 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 296/585] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:07:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:53.765954 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba798e-9786-43cb-85f5-5af6c7ffbc9a None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:53.862479 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:53.867406 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee5928d-3ab5-4328-87b8-c66dbd1bd5d1 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:53.876610 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcba798e-9786-43cb-85f5-5af6c7ffbc9a None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:53.890405 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:53.906563 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e90c7f-9872-4203-8475-bebf24a8d27e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:53.907180 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e90c7f-9872-4203-8475-bebf24a8d27e None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:53.907506 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e90c7f-9872-4203-8475-bebf24a8d27e None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:53.907727 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e90c7f-9872-4203-8475-bebf24a8d27e None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:53.908600 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e90c7f-9872-4203-8475-bebf24a8d27e None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:53.908914 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e90c7f-9872-4203-8475-bebf24a8d27e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:53.910323 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e90c7f-9872-4203-8475-bebf24a8d27e None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:53.910689 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7edd1-c6e9-4f79-b3d7-70efb4479c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:53.911292 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7edd1-c6e9-4f79-b3d7-70efb4479c15 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:53.911569 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7edd1-c6e9-4f79-b3d7-70efb4479c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:53.911846 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7edd1-c6e9-4f79-b3d7-70efb4479c15 None admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:53.912610 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b7edd1-c6e9-4f79-b3d7-70efb4479c15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:53.912913 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b7edd1-c6e9-4f79-b3d7-70efb4479c15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:53.914393 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b7edd1-c6e9-4f79-b3d7-70efb4479c15 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:53.926079 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 297/586] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Aug 5 02:07:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:53.926859 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7edd1-c6e9-4f79-b3d7-70efb4479c15 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:53.933653 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 290/587] 10.222.0.15 () {56 vars in 1137 bytes} [Fri Aug 5 02:07:53 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:53.934654 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e90c7f-9872-4203-8475-bebf24a8d27e None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:54.039885 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e90c7f-9872-4203-8475-bebf24a8d27e None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:54.041067 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7edd1-c6e9-4f79-b3d7-70efb4479c15 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:54.078834 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4511037-2b97-44e8-b83e-e296e298b079 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:54.079447 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4511037-2b97-44e8-b83e-e296e298b079 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:54.079724 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4511037-2b97-44e8-b83e-e296e298b079 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:54.079825 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748000d5-415b-4889-a4cf-f9320ac41c02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:54.079999 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4511037-2b97-44e8-b83e-e296e298b079 None admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:54.080430 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748000d5-415b-4889-a4cf-f9320ac41c02 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:54.080710 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748000d5-415b-4889-a4cf-f9320ac41c02 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:54.080822 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4511037-2b97-44e8-b83e-e296e298b079 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:54.080974 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748000d5-415b-4889-a4cf-f9320ac41c02 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:54.081124 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4511037-2b97-44e8-b83e-e296e298b079 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:54.081657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748000d5-415b-4889-a4cf-f9320ac41c02 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:54.081957 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748000d5-415b-4889-a4cf-f9320ac41c02 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:54.082535 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4511037-2b97-44e8-b83e-e296e298b079 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:54.083277 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748000d5-415b-4889-a4cf-f9320ac41c02 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:54.100220 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 291/588] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:07:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:54.100220 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748000d5-415b-4889-a4cf-f9320ac41c02 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:54.108372 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 298/589] 10.222.0.15 () {56 vars in 1137 bytes} [Fri Aug 5 02:07:53 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:54.108372 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4511037-2b97-44e8-b83e-e296e298b079 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:54.128028 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:54.140536 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:54.217080 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748000d5-415b-4889-a4cf-f9320ac41c02 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:54.222158 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4511037-2b97-44e8-b83e-e296e298b079 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:54.252047 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72283b9f-b889-4a78-afd7-564f15b0c06a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:54.252992 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72283b9f-b889-4a78-afd7-564f15b0c06a None admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:54.253415 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72283b9f-b889-4a78-afd7-564f15b0c06a None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:54.253834 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72283b9f-b889-4a78-afd7-564f15b0c06a None admin] PATH_INFO: `/v3/projects/95d88dece7184bf1842c4f8d275d52cd/users/4b5c0958604b436daa44b1f67c9dec26/roles/876fd0d181d74df4bbc73b2db1c42fbe` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:54.261431 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a071517-6082-4484-b46e-1e6512523276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:54.262060 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a071517-6082-4484-b46e-1e6512523276 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:54.262338 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a071517-6082-4484-b46e-1e6512523276 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:54.262610 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a071517-6082-4484-b46e-1e6512523276 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:54.270345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72283b9f-b889-4a78-afd7-564f15b0c06a None admin] RBAC: Authorizing `identity:create_grant(project_id=95d88dece7184bf1842c4f8d275d52cd, user_id=4b5c0958604b436daa44b1f67c9dec26, role_id=876fd0d181d74df4bbc73b2db1c42fbe)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:54.272381 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72283b9f-b889-4a78-afd7-564f15b0c06a None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:54.273581 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a071517-6082-4484-b46e-1e6512523276 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:54.275002 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a071517-6082-4484-b46e-1e6512523276 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:54.286948 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 292/590] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Aug 5 02:07:54 2022] PUT /identity/v3/projects/95d88dece7184bf1842c4f8d275d52cd/users/4b5c0958604b436daa44b1f67c9dec26/roles/876fd0d181d74df4bbc73b2db1c42fbe => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:07:54.288087 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72283b9f-b889-4a78-afd7-564f15b0c06a None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:54.290863 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-1a071517-6082-4484-b46e-1e6512523276 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:54.290863 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:54.290863 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:54.290863 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:54.290863 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:54.290863 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:54.290863 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:54.290863 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:54.290863 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:54.290863 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:54.290863 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:54.290863 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:54.290863 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:07:54.290863 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:07:54.290863 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:07:54.291737 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:07:54.291737 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:54.291737 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:54.291737 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:54.291737 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:54.291737 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:54.291737 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:54.291737 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:54.291737 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:54.291737 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:54.291737 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:54.291737 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:54.291737 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:54.291737 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:54.291737 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:54.291737 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:54.291737 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:54.292703 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:07:54.292703 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:07:54.292703 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:54.292703 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:54.296815 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 299/591] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:07:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:54.297552 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a071517-6082-4484-b46e-1e6512523276 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:54.403630 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:54.415525 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:54.436847 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a071517-6082-4484-b46e-1e6512523276 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:54.455969 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72283b9f-b889-4a78-afd7-564f15b0c06a None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:54.477497 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388b3b4-7b69-42b0-be29-c57b36be104e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:54.478147 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388b3b4-7b69-42b0-be29-c57b36be104e None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:54.478429 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388b3b4-7b69-42b0-be29-c57b36be104e None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:54.478701 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b388b3b4-7b69-42b0-be29-c57b36be104e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:54.490920 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b388b3b4-7b69-42b0-be29-c57b36be104e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:54.492729 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b388b3b4-7b69-42b0-be29-c57b36be104e None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:54.498368 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fbbb1-f4e1-4228-b1da-49af038f95df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:54.499306 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fbbb1-f4e1-4228-b1da-49af038f95df None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:54.499740 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fbbb1-f4e1-4228-b1da-49af038f95df None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:54.500302 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492fbbb1-f4e1-4228-b1da-49af038f95df None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:54.509218 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fbbb1-f4e1-4228-b1da-49af038f95df None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:54.510276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-b388b3b4-7b69-42b0-be29-c57b36be104e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:54.510276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:54.510276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:54.510276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:54.510276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:54.510276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:54.510276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:54.510276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:54.510276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:54.510276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:54.510276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:54.510276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:54.510276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:07:54.510276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:07:54.510276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:07:54.511322 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:07:54.511322 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:54.511322 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:54.511322 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:54.511322 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:54.511322 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:54.511322 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:54.511322 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:54.511322 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:54.511322 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:54.511322 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:54.511322 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:54.511322 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:54.511322 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:54.511322 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:54.511322 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:54.511322 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:54.515749 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:07:54.515749 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:07:54.515749 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:54.515749 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:54.515749 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 300/592] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:07:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:54.515749 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388b3b4-7b69-42b0-be29-c57b36be104e None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:54.516963 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-492fbbb1-f4e1-4228-b1da-49af038f95df None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:54.533084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-492fbbb1-f4e1-4228-b1da-49af038f95df None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 05 02:07:54.533084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:54.533084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:54.533084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:54.533084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:54.533084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:54.533084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:54.533084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:54.533084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:54.533084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:54.533084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:54.533084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:54.533084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:07:54.533084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:07:54.533084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:07:54.533084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:07:54.534262 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:54.534262 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:54.534262 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:07:54.534262 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:07:54.534262 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:07:54.534262 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:07:54.534262 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:54.534262 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:54.534262 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:54.534262 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:54.534262 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:54.534262 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:54.534262 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:54.534262 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:54.534262 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:54.534262 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:54.534262 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:54.534262 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:54.535357 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:54.535357 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:54.535357 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:07:54.535357 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:07:54.535357 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:07:54.535357 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:07:54.535357 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:07:54.535357 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:07:54.535357 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 05 02:07:54.535357 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:54.537512 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 293/593] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Aug 5 02:07:54 2022] GET /identity/v3/users/neutron => generated 85 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:54.539147 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fbbb1-f4e1-4228-b1da-49af038f95df None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:54.621375 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b388b3b4-7b69-42b0-be29-c57b36be104e None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:54.649433 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492fbbb1-f4e1-4228-b1da-49af038f95df None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:54.658181 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cada3c9-6b74-4fb6-9932-7c7832edb97e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:54.658796 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cada3c9-6b74-4fb6-9932-7c7832edb97e None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:54.659073 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cada3c9-6b74-4fb6-9932-7c7832edb97e None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:54.659342 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cada3c9-6b74-4fb6-9932-7c7832edb97e None admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:54.660153 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cada3c9-6b74-4fb6-9932-7c7832edb97e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:54.660485 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cada3c9-6b74-4fb6-9932-7c7832edb97e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:54.661983 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cada3c9-6b74-4fb6-9932-7c7832edb97e None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:54.665267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:54.684252 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 301/594] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:07:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:54.685146 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:54.686164 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cada3c9-6b74-4fb6-9932-7c7832edb97e None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:54.690449 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0249b95-3a3a-4738-9f83-bbe05eeb7d3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:54.691507 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0249b95-3a3a-4738-9f83-bbe05eeb7d3f None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:54.692097 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0249b95-3a3a-4738-9f83-bbe05eeb7d3f None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:54.692864 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0249b95-3a3a-4738-9f83-bbe05eeb7d3f None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:54.693737 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0249b95-3a3a-4738-9f83-bbe05eeb7d3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:54.694258 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0249b95-3a3a-4738-9f83-bbe05eeb7d3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:54.695867 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0249b95-3a3a-4738-9f83-bbe05eeb7d3f None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:54.714223 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 294/595] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:07:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:54.715427 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0249b95-3a3a-4738-9f83-bbe05eeb7d3f None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:54.794974 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cada3c9-6b74-4fb6-9932-7c7832edb97e None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:54.822005 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0249b95-3a3a-4738-9f83-bbe05eeb7d3f None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:54.839650 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6035e-95a9-4275-8b71-90174d56ce00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:54.839813 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6035e-95a9-4275-8b71-90174d56ce00 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:54.841712 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6035e-95a9-4275-8b71-90174d56ce00 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:54.841712 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e6035e-95a9-4275-8b71-90174d56ce00 None admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:54.841712 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6035e-95a9-4275-8b71-90174d56ce00 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:54.841712 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6035e-95a9-4275-8b71-90174d56ce00 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:54.842994 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5e6035e-95a9-4275-8b71-90174d56ce00 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:54.866621 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc90b6-27aa-43a1-a4bb-d51504cdb135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:54.867208 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 302/596] 10.222.0.15 () {56 vars in 1139 bytes} [Fri Aug 5 02:07:54 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:54.867903 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6035e-95a9-4275-8b71-90174d56ce00 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:54.868592 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc90b6-27aa-43a1-a4bb-d51504cdb135 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:54.869088 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc90b6-27aa-43a1-a4bb-d51504cdb135 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:54.869571 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4bc90b6-27aa-43a1-a4bb-d51504cdb135 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:54.882404 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bc90b6-27aa-43a1-a4bb-d51504cdb135 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:54.884882 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4bc90b6-27aa-43a1-a4bb-d51504cdb135 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:54.901814 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-d4bc90b6-27aa-43a1-a4bb-d51504cdb135 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:07:54.901814 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:54.901814 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:54.901814 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:54.901814 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:54.901814 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:54.901814 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:54.901814 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:54.901814 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:54.901814 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:54.901814 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:54.901814 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:54.901814 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:07:54.901814 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:07:54.901814 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:07:54.902746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:07:54.902746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:54.902746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:54.902746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:54.902746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:54.902746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:54.902746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:54.902746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:54.902746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:54.902746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:54.902746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:54.902746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:54.902746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:54.902746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:54.902746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:54.902746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:54.902746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:54.903611 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:07:54.903611 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:07:54.903611 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:07:54.903611 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:07:54.903611 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:07:54.903611 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:07:54.903611 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:07:54.903611 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:54.910801 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 295/597] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:07:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:54.910801 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc90b6-27aa-43a1-a4bb-d51504cdb135 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:54.947913 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:54.973003 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:55.005434 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e6035e-95a9-4275-8b71-90174d56ce00 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:55.035014 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4bc90b6-27aa-43a1-a4bb-d51504cdb135 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:55.044133 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfa381-1708-41af-875f-dabda68d38f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:55.045515 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfa381-1708-41af-875f-dabda68d38f2 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:55.045993 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfa381-1708-41af-875f-dabda68d38f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:55.046581 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddfa381-1708-41af-875f-dabda68d38f2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:55.054455 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddfa381-1708-41af-875f-dabda68d38f2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:55.056244 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddfa381-1708-41af-875f-dabda68d38f2 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:55.068837 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-7ddfa381-1708-41af-875f-dabda68d38f2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:07:55.068837 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:55.068837 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:55.068837 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:55.068837 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:55.068837 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:55.068837 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:55.068837 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:55.068837 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:55.068837 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:55.068837 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:55.068837 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:55.068837 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:07:55.068837 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:07:55.068837 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:07:55.070365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:07:55.070365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:55.070365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:55.070365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:55.070365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:55.070365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:55.070365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:55.070365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:55.070365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:55.070365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:55.070365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:55.070365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:55.070365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:55.070365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:55.070365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:55.070365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:55.070365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:55.071227 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:07:55.071227 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:07:55.071227 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:07:55.071227 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:07:55.071227 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:07:55.071227 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:07:55.071227 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:07:55.071227 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:55.073207 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b105a658-a6f8-4548-8aab-0807e6d0c7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:55.073713 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 303/598] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:07:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:55.076365 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105a658-a6f8-4548-8aab-0807e6d0c7b5 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:55.076365 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105a658-a6f8-4548-8aab-0807e6d0c7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:55.076365 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b105a658-a6f8-4548-8aab-0807e6d0c7b5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:55.076602 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfa381-1708-41af-875f-dabda68d38f2 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:55.086756 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b105a658-a6f8-4548-8aab-0807e6d0c7b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:55.088202 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b105a658-a6f8-4548-8aab-0807e6d0c7b5 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:55.104059 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-b105a658-a6f8-4548-8aab-0807e6d0c7b5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:55.104059 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:55.104059 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:55.104059 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:55.104059 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:55.104059 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:55.104059 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:55.104059 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:55.104059 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:55.104059 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:55.104059 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:55.104059 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:55.104059 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:07:55.104059 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:07:55.104059 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:07:55.105099 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:07:55.105099 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:55.105099 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:55.105099 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:55.105099 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:55.105099 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:55.105099 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:55.105099 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:55.105099 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:55.105099 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:55.105099 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:55.105099 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:55.105099 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:55.105099 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:55.105099 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:55.105099 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:55.105099 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:55.110722 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:07:55.110722 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:07:55.110722 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:55.110722 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:55.110722 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 296/599] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:07:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:55.110722 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886dbab-39ed-4f9b-81a2-2e1f5c33113f None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:55.110722 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886dbab-39ed-4f9b-81a2-2e1f5c33113f None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:55.110722 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5886dbab-39ed-4f9b-81a2-2e1f5c33113f None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:55.110722 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 297/600] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:55 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:55.111238 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886dbab-39ed-4f9b-81a2-2e1f5c33113f None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:55.190336 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddfa381-1708-41af-875f-dabda68d38f2 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:55.205287 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:55.216725 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:55.222380 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5886dbab-39ed-4f9b-81a2-2e1f5c33113f None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:55.228170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b06dc-0b9d-4671-b381-501671e5884b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:55.228985 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b06dc-0b9d-4671-b381-501671e5884b None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:55.229434 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b06dc-0b9d-4671-b381-501671e5884b None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:55.229849 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78b06dc-0b9d-4671-b381-501671e5884b None admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:55.230736 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b06dc-0b9d-4671-b381-501671e5884b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:55.231183 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b06dc-0b9d-4671-b381-501671e5884b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:55.232777 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78b06dc-0b9d-4671-b381-501671e5884b None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:55.250085 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 304/601] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Aug 5 02:07:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:55.250085 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b06dc-0b9d-4671-b381-501671e5884b None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:55.262276 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a56c13-fbf8-4efe-94a1-ad8123452712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:55.262890 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a56c13-fbf8-4efe-94a1-ad8123452712 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:55.263170 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a56c13-fbf8-4efe-94a1-ad8123452712 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:55.263448 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a56c13-fbf8-4efe-94a1-ad8123452712 None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:55.264199 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a56c13-fbf8-4efe-94a1-ad8123452712 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:55.264532 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a56c13-fbf8-4efe-94a1-ad8123452712 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:55.265964 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a56c13-fbf8-4efe-94a1-ad8123452712 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:55.279136 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 298/602] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Aug 5 02:07:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:55.280318 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48117f-fc65-4017-b460-52ae1411e5c6 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:55.280626 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48117f-fc65-4017-b460-52ae1411e5c6 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:55.280896 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f48117f-fc65-4017-b460-52ae1411e5c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:55.298370 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-7f48117f-fc65-4017-b460-52ae1411e5c6 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:55.299563 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-7f48117f-fc65-4017-b460-52ae1411e5c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:55.357440 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78b06dc-0b9d-4671-b381-501671e5884b None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:55.378584 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 299/603] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:07:55.379533 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48117f-fc65-4017-b460-52ae1411e5c6 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:55.398267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef873d27-89f2-45e5-869a-bedda64a88d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:55.399164 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef873d27-89f2-45e5-869a-bedda64a88d0 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:55.399439 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef873d27-89f2-45e5-869a-bedda64a88d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:55.399710 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef873d27-89f2-45e5-869a-bedda64a88d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:55.400432 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef873d27-89f2-45e5-869a-bedda64a88d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:55.400735 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef873d27-89f2-45e5-869a-bedda64a88d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:55.402091 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef873d27-89f2-45e5-869a-bedda64a88d0 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:55.418069 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 305/604] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:07:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:55.418910 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef873d27-89f2-45e5-869a-bedda64a88d0 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:55.455078 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:55.474740 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:55.488616 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f48117f-fc65-4017-b460-52ae1411e5c6 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:55.529079 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1563d-ee20-430b-932b-edc1bf51d3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:55.529336 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef873d27-89f2-45e5-869a-bedda64a88d0 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:55.529753 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1563d-ee20-430b-932b-edc1bf51d3b4 None admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:55.530028 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1563d-ee20-430b-932b-edc1bf51d3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:55.530300 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1563d-ee20-430b-932b-edc1bf51d3b4 None admin] PATH_INFO: `/v3/projects/95d88dece7184bf1842c4f8d275d52cd/users/5c09080c507f4c35b81d482cfbaa6a88/roles/876fd0d181d74df4bbc73b2db1c42fbe` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:55.548417 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1563d-ee20-430b-932b-edc1bf51d3b4 None admin] RBAC: Authorizing `identity:create_grant(project_id=95d88dece7184bf1842c4f8d275d52cd, user_id=5c09080c507f4c35b81d482cfbaa6a88, role_id=876fd0d181d74df4bbc73b2db1c42fbe)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:55.550269 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1563d-ee20-430b-932b-edc1bf51d3b4 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:55.565555 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 300/605] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Aug 5 02:07:55 2022] PUT /identity/v3/projects/95d88dece7184bf1842c4f8d275d52cd/users/5c09080c507f4c35b81d482cfbaa6a88/roles/876fd0d181d74df4bbc73b2db1c42fbe => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:07:55.566316 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d3ab8a-0a05-4554-b1b9-3d4b4607d82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:55.566520 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1563d-ee20-430b-932b-edc1bf51d3b4 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:55.567960 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3ab8a-0a05-4554-b1b9-3d4b4607d82e None admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:55.568470 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3ab8a-0a05-4554-b1b9-3d4b4607d82e None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:55.568907 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d3ab8a-0a05-4554-b1b9-3d4b4607d82e None admin] PATH_INFO: `/v3/projects/95d88dece7184bf1842c4f8d275d52cd/users/6a75ac3523564e1bb23469455fdba560/roles/876fd0d181d74df4bbc73b2db1c42fbe` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:55.594924 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d3ab8a-0a05-4554-b1b9-3d4b4607d82e None admin] RBAC: Authorizing `identity:create_grant(project_id=95d88dece7184bf1842c4f8d275d52cd, user_id=6a75ac3523564e1bb23469455fdba560, role_id=876fd0d181d74df4bbc73b2db1c42fbe)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:55.597435 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d3ab8a-0a05-4554-b1b9-3d4b4607d82e None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:55.620738 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 306/606] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Aug 5 02:07:55 2022] PUT /identity/v3/projects/95d88dece7184bf1842c4f8d275d52cd/users/6a75ac3523564e1bb23469455fdba560/roles/876fd0d181d74df4bbc73b2db1c42fbe => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:07:55.621886 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d3ab8a-0a05-4554-b1b9-3d4b4607d82e None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:55.701813 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1563d-ee20-430b-932b-edc1bf51d3b4 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:55.744839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb4a9b-6b74-4efe-922b-f74f1085af0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:55.745880 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb4a9b-6b74-4efe-922b-f74f1085af0f None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:55.746388 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb4a9b-6b74-4efe-922b-f74f1085af0f None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:55.746863 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfb4a9b-6b74-4efe-922b-f74f1085af0f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:55.762791 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:55.765786 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfb4a9b-6b74-4efe-922b-f74f1085af0f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:55.774550 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-7dfb4a9b-6b74-4efe-922b-f74f1085af0f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:07:55.774550 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:55.774550 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:55.774550 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:55.774550 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:55.774550 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:55.774550 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:55.774550 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:55.774550 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:55.774550 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:55.774550 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:55.774550 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:55.774550 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:55.774550 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:55.774550 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:55.774550 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:55.775567 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:55.775567 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:55.775567 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:55.775567 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:55.775567 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:55.775567 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:55.775567 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:55.775567 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:55.775567 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:55.775567 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:55.775567 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:55.775567 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:55.775567 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:55.775567 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:55.775567 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:55.775567 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:55.776443 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:55.776443 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:55.776443 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:55.776443 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:55.776443 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:55.776443 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:55.776443 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:55.776443 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:55.776443 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:55.776443 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:55.776443 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:07:55.776443 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:55.781402 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 301/607] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Aug 5 02:07:55 2022] GET /identity/v3/roles/service => generated 85 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:55.787540 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb4a9b-6b74-4efe-922b-f74f1085af0f None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:55.789987 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:55.827022 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d3ab8a-0a05-4554-b1b9-3d4b4607d82e None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:55.877855 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838bae1d-00c6-4721-abcc-bfcf17f0f811 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:55.878990 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bae1d-00c6-4721-abcc-bfcf17f0f811 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:55.879558 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bae1d-00c6-4721-abcc-bfcf17f0f811 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:55.880029 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838bae1d-00c6-4721-abcc-bfcf17f0f811 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:55.889351 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838bae1d-00c6-4721-abcc-bfcf17f0f811 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:55.891341 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838bae1d-00c6-4721-abcc-bfcf17f0f811 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:55.905067 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-838bae1d-00c6-4721-abcc-bfcf17f0f811 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:07:55.905067 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:55.905067 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:55.905067 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:55.905067 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:55.905067 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:55.905067 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:55.905067 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:55.905067 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:55.905067 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:55.905067 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:55.905067 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:55.905067 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:07:55.905067 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:07:55.905067 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:07:55.905998 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:07:55.905998 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:55.905998 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:55.905998 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:55.905998 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:55.905998 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:55.905998 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:55.905998 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:55.905998 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:55.905998 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:55.905998 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:55.905998 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:55.905998 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:55.905998 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:55.905998 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:55.905998 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:55.905998 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:55.906994 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:07:55.906994 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:07:55.906994 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:07:55.906994 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:07:55.906994 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:07:55.906994 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:07:55.906994 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:07:55.906994 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:55.909578 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 307/608] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:07:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:55.916862 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838bae1d-00c6-4721-abcc-bfcf17f0f811 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:55.926987 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfb4a9b-6b74-4efe-922b-f74f1085af0f None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:55.963202 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398ce53-184e-4119-8659-532ce40d7af3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:55.963831 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398ce53-184e-4119-8659-532ce40d7af3 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:55.964110 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398ce53-184e-4119-8659-532ce40d7af3 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:55.964405 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b398ce53-184e-4119-8659-532ce40d7af3 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:55.965123 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398ce53-184e-4119-8659-532ce40d7af3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:55.965422 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398ce53-184e-4119-8659-532ce40d7af3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:55.966931 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b398ce53-184e-4119-8659-532ce40d7af3 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:55.980463 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 302/609] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Aug 5 02:07:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:07:55.982111 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398ce53-184e-4119-8659-532ce40d7af3 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:56.040676 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838bae1d-00c6-4721-abcc-bfcf17f0f811 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:56.045670 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:56.082044 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe7c62-4b4a-477d-8120-279d777bdd55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:56.083401 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe7c62-4b4a-477d-8120-279d777bdd55 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:56.083934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe7c62-4b4a-477d-8120-279d777bdd55 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:56.084533 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddbe7c62-4b4a-477d-8120-279d777bdd55 None admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:56.086859 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe7c62-4b4a-477d-8120-279d777bdd55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:56.087406 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe7c62-4b4a-477d-8120-279d777bdd55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:56.089295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddbe7c62-4b4a-477d-8120-279d777bdd55 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:56.094681 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b398ce53-184e-4119-8659-532ce40d7af3 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:56.105276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 308/610] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Aug 5 02:07:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:07:56.111277 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe7c62-4b4a-477d-8120-279d777bdd55 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:56.115444 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:56.130289 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975fe29-e0bc-4bf8-aa9c-cfb8c0bf6e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:56.130931 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975fe29-e0bc-4bf8-aa9c-cfb8c0bf6e32 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:56.131479 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975fe29-e0bc-4bf8-aa9c-cfb8c0bf6e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:56.131671 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c975fe29-e0bc-4bf8-aa9c-cfb8c0bf6e32 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:56.142640 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c975fe29-e0bc-4bf8-aa9c-cfb8c0bf6e32 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:56.144102 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c975fe29-e0bc-4bf8-aa9c-cfb8c0bf6e32 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:56.159445 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-c975fe29-e0bc-4bf8-aa9c-cfb8c0bf6e32 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:56.159445 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:56.159445 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:56.159445 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:56.159445 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:56.159445 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:56.159445 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:56.159445 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:56.159445 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:56.159445 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:56.159445 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:56.159445 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:56.159445 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:07:56.159445 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:07:56.159445 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:07:56.160411 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:07:56.160411 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:56.160411 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:56.160411 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:56.160411 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:56.160411 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:56.160411 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:56.160411 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:56.160411 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:56.160411 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:56.160411 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:56.160411 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:56.160411 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:56.160411 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:56.160411 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:56.160411 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:56.160411 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:56.161317 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:07:56.161317 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:07:56.161317 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:56.161317 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:56.161317 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 303/611] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:07:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:07:56.167260 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975fe29-e0bc-4bf8-aa9c-cfb8c0bf6e32 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:56.236338 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddbe7c62-4b4a-477d-8120-279d777bdd55 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:56.271299 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c975fe29-e0bc-4bf8-aa9c-cfb8c0bf6e32 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:56.277419 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dda42af-e544-4299-a4cd-c9897a448b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:56.278560 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda42af-e544-4299-a4cd-c9897a448b02 None admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:56.279046 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda42af-e544-4299-a4cd-c9897a448b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:56.279523 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dda42af-e544-4299-a4cd-c9897a448b02 None admin] PATH_INFO: `/v3/projects/95d88dece7184bf1842c4f8d275d52cd/users/f81daf3da9b34e7380c61005019a53bd/roles/876fd0d181d74df4bbc73b2db1c42fbe` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:56.286324 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:56.299254 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dda42af-e544-4299-a4cd-c9897a448b02 None admin] RBAC: Authorizing `identity:create_grant(project_id=95d88dece7184bf1842c4f8d275d52cd, user_id=f81daf3da9b34e7380c61005019a53bd, role_id=876fd0d181d74df4bbc73b2db1c42fbe)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:56.301324 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dda42af-e544-4299-a4cd-c9897a448b02 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:56.313854 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee0126-b780-4864-9510-176d76402534 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:56.314479 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee0126-b780-4864-9510-176d76402534 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:56.314760 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee0126-b780-4864-9510-176d76402534 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:56.315109 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ee0126-b780-4864-9510-176d76402534 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:56.315878 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee0126-b780-4864-9510-176d76402534 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:56.316187 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee0126-b780-4864-9510-176d76402534 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:56.317668 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ee0126-b780-4864-9510-176d76402534 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:56.332414 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 304/613] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:07:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:56.332904 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 309/613] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Aug 5 02:07:56 2022] PUT /identity/v3/projects/95d88dece7184bf1842c4f8d275d52cd/users/f81daf3da9b34e7380c61005019a53bd/roles/876fd0d181d74df4bbc73b2db1c42fbe => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:07:56.338112 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee0126-b780-4864-9510-176d76402534 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:56.454507 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ee0126-b780-4864-9510-176d76402534 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:56.474644 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a11c0-2601-4c2b-ad02-6af0ac1065e1 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:56.474959 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a11c0-2601-4c2b-ad02-6af0ac1065e1 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:56.475195 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417a11c0-2601-4c2b-ad02-6af0ac1065e1 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:56.477356 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 310/614] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:56.483050 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5b297-2e9a-4062-89f2-d47c03c02776 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:56.483345 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5b297-2e9a-4062-89f2-d47c03c02776 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:56.483604 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd5b297-2e9a-4062-89f2-d47c03c02776 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:56.498682 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c38bda-adc7-4fbd-8e67-ee67eda49107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:56.499614 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c38bda-adc7-4fbd-8e67-ee67eda49107 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:56.499908 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c38bda-adc7-4fbd-8e67-ee67eda49107 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:56.500180 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c38bda-adc7-4fbd-8e67-ee67eda49107 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:56.514492 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c38bda-adc7-4fbd-8e67-ee67eda49107 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:56.515970 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c38bda-adc7-4fbd-8e67-ee67eda49107 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:56.529686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-14c38bda-adc7-4fbd-8e67-ee67eda49107 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 05 02:07:56.529686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:56.529686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:56.529686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:56.529686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:56.529686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:56.529686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:56.529686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:56.529686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:56.529686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:56.529686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:56.529686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:56.529686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:07:56.529686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:07:56.529686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:07:56.529686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:07:56.530730 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:56.530730 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:56.530730 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:07:56.530730 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:07:56.530730 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:07:56.530730 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:07:56.530730 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:56.530730 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:56.530730 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:56.530730 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:56.530730 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:56.530730 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:56.530730 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:56.530730 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:56.530730 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:56.530730 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:56.530730 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:56.530730 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:56.531686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:56.531686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:56.531686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:07:56.531686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:07:56.531686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:07:56.531686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:07:56.531686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:07:56.531686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:07:56.531686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 05 02:07:56.531686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:56.531686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 305/615] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Aug 5 02:07:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:56.532270 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-9cd5b297-2e9a-4062-89f2-d47c03c02776 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:56.534499 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-9cd5b297-2e9a-4062-89f2-d47c03c02776 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:56.537170 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c38bda-adc7-4fbd-8e67-ee67eda49107 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:56.590159 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:56.620686 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:56.640858 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 311/616] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:07:56.660240 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c38bda-adc7-4fbd-8e67-ee67eda49107 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:56.668686 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5b297-2e9a-4062-89f2-d47c03c02776 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:56.702458 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4643a7-d731-4b4c-9d92-10bb0ea04485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:56.703365 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4643a7-d731-4b4c-9d92-10bb0ea04485 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:56.703794 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4643a7-d731-4b4c-9d92-10bb0ea04485 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:56.705091 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4643a7-d731-4b4c-9d92-10bb0ea04485 None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:56.706068 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4643a7-d731-4b4c-9d92-10bb0ea04485 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:56.707283 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4643a7-d731-4b4c-9d92-10bb0ea04485 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:56.711721 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f4643a7-d731-4b4c-9d92-10bb0ea04485 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:56.732533 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 306/617] 10.222.0.15 () {56 vars in 1135 bytes} [Fri Aug 5 02:07:56 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:56.739084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4643a7-d731-4b4c-9d92-10bb0ea04485 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:56.849972 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd5b297-2e9a-4062-89f2-d47c03c02776 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:56.922430 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42119a4-aee6-455b-afdd-880a21375049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:56.923091 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42119a4-aee6-455b-afdd-880a21375049 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:56.923371 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42119a4-aee6-455b-afdd-880a21375049 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:56.923644 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e42119a4-aee6-455b-afdd-880a21375049 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:56.929170 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4643a7-d731-4b4c-9d92-10bb0ea04485 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:56.939464 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e42119a4-aee6-455b-afdd-880a21375049 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:56.948774 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:56.952964 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-e42119a4-aee6-455b-afdd-880a21375049 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:07:56.952964 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:56.952964 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:56.952964 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:56.952964 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:56.952964 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:56.952964 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:56.952964 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:56.952964 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:56.952964 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:56.952964 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:56.952964 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:56.952964 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:56.952964 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:56.952964 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:56.952964 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:56.953872 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:56.953872 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:56.953872 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:56.953872 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:56.953872 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:56.953872 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:56.953872 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:56.953872 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:56.953872 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:56.953872 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:56.953872 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:56.953872 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:56.953872 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:56.953872 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:56.953872 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:56.953872 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:56.954695 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:56.954695 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:56.954695 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:56.954695 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:56.954695 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:56.954695 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:56.954695 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:56.954695 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:56.954695 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:56.954695 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:56.954695 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:07:56.954695 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:56.954695 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 312/618] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Aug 5 02:07:56 2022] GET /identity/v3/roles/service => generated 85 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:56.961587 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42119a4-aee6-455b-afdd-880a21375049 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:56.970788 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e3eac-d24a-4d07-a1db-6f189fc22078 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:56.971822 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e3eac-d24a-4d07-a1db-6f189fc22078 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:56.973016 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e3eac-d24a-4d07-a1db-6f189fc22078 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:56.973295 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410e3eac-d24a-4d07-a1db-6f189fc22078 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:56.995271 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e3eac-d24a-4d07-a1db-6f189fc22078 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:56.996946 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410e3eac-d24a-4d07-a1db-6f189fc22078 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:57.023208 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-410e3eac-d24a-4d07-a1db-6f189fc22078 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:57.023208 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:57.023208 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:57.023208 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:57.023208 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:57.023208 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:57.023208 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:57.023208 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:57.023208 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:57.023208 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:57.023208 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:57.023208 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:57.023208 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:07:57.023208 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:07:57.023208 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:07:57.024135 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:07:57.024135 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:57.024135 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:57.024135 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:57.024135 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:57.024135 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:57.024135 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:57.024135 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:57.024135 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:57.024135 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:57.024135 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:57.024135 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:57.024135 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:57.024135 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:57.024135 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:57.024135 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:57.024135 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:57.025200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:07:57.025200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:07:57.025200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:57.025200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:57.029016 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 307/619] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:07:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:07:57.041913 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e3eac-d24a-4d07-a1db-6f189fc22078 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:57.064355 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:57.121281 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e42119a4-aee6-455b-afdd-880a21375049 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:57.156667 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ac196-13e0-42d9-bf3b-d35c603daa9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:57.157290 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ac196-13e0-42d9-bf3b-d35c603daa9c None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:57.157575 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ac196-13e0-42d9-bf3b-d35c603daa9c None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:57.157849 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098ac196-13e0-42d9-bf3b-d35c603daa9c None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:57.158577 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ac196-13e0-42d9-bf3b-d35c603daa9c None admin] RBAC: Adding query filter params (name=service) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:57.158881 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ac196-13e0-42d9-bf3b-d35c603daa9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:57.160286 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098ac196-13e0-42d9-bf3b-d35c603daa9c None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:57.175701 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 313/620] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Aug 5 02:07:56 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:07:57.180501 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ac196-13e0-42d9-bf3b-d35c603daa9c None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:57.249772 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410e3eac-d24a-4d07-a1db-6f189fc22078 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:57.317689 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098ac196-13e0-42d9-bf3b-d35c603daa9c None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:57.328670 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:57.334004 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36007b81-5202-4f93-85e4-df0748410a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:57.334670 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36007b81-5202-4f93-85e4-df0748410a00 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:57.335748 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36007b81-5202-4f93-85e4-df0748410a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:57.336051 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36007b81-5202-4f93-85e4-df0748410a00 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:57.336785 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36007b81-5202-4f93-85e4-df0748410a00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:57.337096 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36007b81-5202-4f93-85e4-df0748410a00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:57.342142 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36007b81-5202-4f93-85e4-df0748410a00 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:57.359637 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 308/621] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:07:57.365574 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36007b81-5202-4f93-85e4-df0748410a00 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:57.376710 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:57.392123 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f0b89-7ff6-4e47-8665-0eacdc798a69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:57.392806 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f0b89-7ff6-4e47-8665-0eacdc798a69 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:57.393089 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f0b89-7ff6-4e47-8665-0eacdc798a69 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:57.393370 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311f0b89-7ff6-4e47-8665-0eacdc798a69 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:57.411282 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f0b89-7ff6-4e47-8665-0eacdc798a69 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:57.413321 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311f0b89-7ff6-4e47-8665-0eacdc798a69 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:57.445428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-311f0b89-7ff6-4e47-8665-0eacdc798a69 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:57.445428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:57.445428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:57.445428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:57.445428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:57.445428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:57.445428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:57.445428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:57.445428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:57.445428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:57.445428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:57.445428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:57.445428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:07:57.445428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:07:57.445428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:07:57.446326 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:07:57.446326 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:57.446326 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:57.446326 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:57.446326 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:57.446326 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:57.446326 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:57.446326 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:57.446326 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:57.446326 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:57.446326 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:57.446326 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:57.446326 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:57.446326 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:57.446326 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:57.446326 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:57.446326 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:57.447211 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:07:57.447211 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:07:57.447211 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:57.447211 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:57.448758 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 314/622] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:07:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:57.453378 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f0b89-7ff6-4e47-8665-0eacdc798a69 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:57.548030 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36007b81-5202-4f93-85e4-df0748410a00 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:57.618225 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a905aca-b24d-4b8c-83f6-56681a47fad4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:57.618894 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a905aca-b24d-4b8c-83f6-56681a47fad4 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:57.619168 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a905aca-b24d-4b8c-83f6-56681a47fad4 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:57.619441 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a905aca-b24d-4b8c-83f6-56681a47fad4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:57.633248 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a905aca-b24d-4b8c-83f6-56681a47fad4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:57.634625 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a905aca-b24d-4b8c-83f6-56681a47fad4 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:57.649491 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311f0b89-7ff6-4e47-8665-0eacdc798a69 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:57.660867 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-1a905aca-b24d-4b8c-83f6-56681a47fad4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:07:57.660867 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:57.660867 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:57.660867 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:57.660867 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:57.660867 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:57.660867 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:57.660867 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:57.660867 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:57.660867 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:57.660867 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:57.660867 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:57.660867 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:07:57.660867 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:07:57.660867 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:07:57.661810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:07:57.661810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:57.661810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:57.661810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:57.661810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:57.661810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:57.661810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:57.661810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:57.661810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:57.661810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:57.661810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:57.661810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:57.661810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:57.661810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:57.661810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:57.661810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:57.661810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:57.662691 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:07:57.662691 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:07:57.662691 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:07:57.662691 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:07:57.662691 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:07:57.662691 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:07:57.662691 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:07:57.662691 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:57.665227 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 309/623] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:07:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 300 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:07:57.670438 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a905aca-b24d-4b8c-83f6-56681a47fad4 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:57.691120 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15a9dd-b370-4b55-b55e-e049a13cb746 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:57.691741 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15a9dd-b370-4b55-b55e-e049a13cb746 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:57.692020 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15a9dd-b370-4b55-b55e-e049a13cb746 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:57.692295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f15a9dd-b370-4b55-b55e-e049a13cb746 None admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:57.693014 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f15a9dd-b370-4b55-b55e-e049a13cb746 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:57.693312 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f15a9dd-b370-4b55-b55e-e049a13cb746 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:57.700370 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f15a9dd-b370-4b55-b55e-e049a13cb746 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:57.707990 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 315/624] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:07:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:57.722416 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15a9dd-b370-4b55-b55e-e049a13cb746 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:57.747475 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:57.782004 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:57.839210 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f15a9dd-b370-4b55-b55e-e049a13cb746 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:57.878675 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c8398-47a4-4dd9-af6b-e494818fc5a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:57.879470 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c8398-47a4-4dd9-af6b-e494818fc5a7 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:57.879869 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c8398-47a4-4dd9-af6b-e494818fc5a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:57.880240 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2c8398-47a4-4dd9-af6b-e494818fc5a7 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:57.892436 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c8398-47a4-4dd9-af6b-e494818fc5a7 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:57.892436 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d2c8398-47a4-4dd9-af6b-e494818fc5a7 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:57.904048 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a905aca-b24d-4b8c-83f6-56681a47fad4 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:57.908347 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-1d2c8398-47a4-4dd9-af6b-e494818fc5a7 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 02:07:57.908347 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:57.908347 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:57.908347 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:57.908347 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:57.908347 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:57.908347 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:57.908347 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:57.908347 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:57.908347 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:57.908347 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:57.908347 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:57.908347 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:07:57.908347 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:07:57.908347 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:07:57.908347 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:07:57.909295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:57.909295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:57.909295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:07:57.909295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:07:57.909295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:07:57.909295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:07:57.909295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:57.909295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:57.909295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:57.909295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:57.909295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:57.909295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:57.909295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:57.909295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:57.909295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:57.909295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:57.909295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:57.909295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:57.910238 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:57.910238 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:57.910238 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:07:57.910238 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:07:57.910238 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:07:57.910238 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:07:57.910238 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:07:57.910238 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:07:57.910238 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 02:07:57.910238 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:57.913438 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 316/625] 10.222.0.15 () {56 vars in 1093 bytes} [Fri Aug 5 02:07:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:07:57.914975 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c8398-47a4-4dd9-af6b-e494818fc5a7 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:57.997574 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2edf3-11be-4754-bb8b-44ee9d5ce998 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:57.998786 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2edf3-11be-4754-bb8b-44ee9d5ce998 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:57.999227 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2edf3-11be-4754-bb8b-44ee9d5ce998 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:57.999644 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f2edf3-11be-4754-bb8b-44ee9d5ce998 None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:58.000581 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f2edf3-11be-4754-bb8b-44ee9d5ce998 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:58.001029 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f2edf3-11be-4754-bb8b-44ee9d5ce998 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:58.002596 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67f2edf3-11be-4754-bb8b-44ee9d5ce998 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:58.003091 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:58.029145 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2c8398-47a4-4dd9-af6b-e494818fc5a7 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:58.031747 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 310/626] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Aug 5 02:07:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:07:58.037143 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2edf3-11be-4754-bb8b-44ee9d5ce998 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:58.067228 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bcb2db-e201-4654-963d-d50b61729e7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:58.068009 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcb2db-e201-4654-963d-d50b61729e7b None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:58.068580 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcb2db-e201-4654-963d-d50b61729e7b None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:58.069604 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bcb2db-e201-4654-963d-d50b61729e7b None admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:58.070514 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bcb2db-e201-4654-963d-d50b61729e7b None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:58.070916 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bcb2db-e201-4654-963d-d50b61729e7b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:58.072634 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bcb2db-e201-4654-963d-d50b61729e7b None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:58.097930 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 317/627] 10.222.0.15 () {56 vars in 1133 bytes} [Fri Aug 5 02:07:57 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:07:58.099283 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bcb2db-e201-4654-963d-d50b61729e7b None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:58.217357 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f2edf3-11be-4754-bb8b-44ee9d5ce998 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:58.217937 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bcb2db-e201-4654-963d-d50b61729e7b None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:58.253323 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:58.258049 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb1cd6-cb75-4f2e-9e86-dde34b2f5c64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:58.258965 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb1cd6-cb75-4f2e-9e86-dde34b2f5c64 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:58.259450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb1cd6-cb75-4f2e-9e86-dde34b2f5c64 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:58.259922 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb1cd6-cb75-4f2e-9e86-dde34b2f5c64 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:58.264642 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:58.270305 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aa5651-24c8-4b22-ad80-912190217285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:58.271493 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa5651-24c8-4b22-ad80-912190217285 None admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:58.271790 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa5651-24c8-4b22-ad80-912190217285 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:58.272141 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aa5651-24c8-4b22-ad80-912190217285 None admin] PATH_INFO: `/v3/projects/95d88dece7184bf1842c4f8d275d52cd/users/f03233b0ee3540cdb5105f6603cfdff5/roles/876fd0d181d74df4bbc73b2db1c42fbe` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:58.292319 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa5651-24c8-4b22-ad80-912190217285 None admin] RBAC: Authorizing `identity:create_grant(project_id=95d88dece7184bf1842c4f8d275d52cd, user_id=f03233b0ee3540cdb5105f6603cfdff5, role_id=876fd0d181d74df4bbc73b2db1c42fbe)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:58.294048 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aa5651-24c8-4b22-ad80-912190217285 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:58.316367 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 311/628] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Aug 5 02:07:58 2022] PUT /identity/v3/projects/95d88dece7184bf1842c4f8d275d52cd/users/f03233b0ee3540cdb5105f6603cfdff5/roles/876fd0d181d74df4bbc73b2db1c42fbe => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:07:58.316367 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684feab-0133-4091-8cec-5413315b14c6 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:58.316367 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684feab-0133-4091-8cec-5413315b14c6 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:58.316367 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684feab-0133-4091-8cec-5413315b14c6 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:58.316756 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 312/629] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:58.335100 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559cf83-a2ab-47d7-8053-19939aaa980d None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:58.335686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559cf83-a2ab-47d7-8053-19939aaa980d None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:58.336234 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9559cf83-a2ab-47d7-8053-19939aaa980d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:58.367551 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-9559cf83-a2ab-47d7-8053-19939aaa980d None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:58.369012 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9559cf83-a2ab-47d7-8053-19939aaa980d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:58.371908 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cb1cd6-cb75-4f2e-9e86-dde34b2f5c64 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:58.373658 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cb1cd6-cb75-4f2e-9e86-dde34b2f5c64 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:58.468506 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 313/630] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:07:58.469789 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba4848-f251-4958-96c0-15072198e7d8 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:58.470073 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba4848-f251-4958-96c0-15072198e7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:58.470345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ba4848-f251-4958-96c0-15072198e7d8 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:58.477497 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 314/631] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:58 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:58.480499 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1a795-e307-4d56-add3-691e9c68c1e4 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:58.480780 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1a795-e307-4d56-add3-691e9c68c1e4 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:58.481052 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac1a795-e307-4d56-add3-691e9c68c1e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:58.510962 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-bac1a795-e307-4d56-add3-691e9c68c1e4 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:58.512416 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-bac1a795-e307-4d56-add3-691e9c68c1e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:58.517776 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 318/632] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:07:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 05 02:07:58.518704 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb1cd6-cb75-4f2e-9e86-dde34b2f5c64 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:58.566812 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:58.595764 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 315/633] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:07:58.596663 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1a795-e307-4d56-add3-691e9c68c1e4 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:58.633585 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:58.649417 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb1cd6-cb75-4f2e-9e86-dde34b2f5c64 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:58.687043 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712db8f-9436-4d45-8eb8-f9ebce55de3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:58.687765 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712db8f-9436-4d45-8eb8-f9ebce55de3d None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:58.688259 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712db8f-9436-4d45-8eb8-f9ebce55de3d None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:58.688400 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0712db8f-9436-4d45-8eb8-f9ebce55de3d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:58.700120 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0712db8f-9436-4d45-8eb8-f9ebce55de3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:58.705184 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-0712db8f-9436-4d45-8eb8-f9ebce55de3d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:07:58.705184 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:58.705184 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:58.705184 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:58.705184 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:58.705184 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:58.705184 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:58.705184 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:58.705184 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:58.705184 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:58.705184 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:58.705184 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:58.705184 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:58.705184 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:58.705184 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:58.705184 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:58.706152 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:58.706152 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:58.706152 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:58.706152 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:58.706152 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:58.706152 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:58.706152 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:58.706152 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:58.706152 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:58.706152 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:58.706152 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:58.706152 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:58.706152 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:58.706152 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:58.706152 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:58.706152 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:58.707533 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:58.707533 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:58.707533 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:58.707533 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:58.707533 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:58.707533 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:58.707533 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:58.707533 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:58.707533 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:58.707533 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:58.707533 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:07:58.707533 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:58.707533 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 319/634] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Aug 5 02:07:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:58.707533 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712db8f-9436-4d45-8eb8-f9ebce55de3d None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:58.718617 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac1a795-e307-4d56-add3-691e9c68c1e4 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:58.755953 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a2539-9b97-4455-8473-361c83f1f168 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:58.757152 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a2539-9b97-4455-8473-361c83f1f168 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:58.757582 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a2539-9b97-4455-8473-361c83f1f168 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:58.757860 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170a2539-9b97-4455-8473-361c83f1f168 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:58.768308 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a2539-9b97-4455-8473-361c83f1f168 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:58.769772 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170a2539-9b97-4455-8473-361c83f1f168 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:58.785426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-170a2539-9b97-4455-8473-361c83f1f168 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:58.785426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:58.785426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:58.785426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:58.785426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:58.785426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:58.785426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:58.785426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:58.785426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:58.785426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:58.785426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:58.785426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:58.785426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:07:58.785426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:07:58.785426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:07:58.786383 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:07:58.786383 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:58.786383 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:58.786383 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:58.786383 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:58.786383 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:58.786383 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:58.786383 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:58.786383 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:58.786383 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:58.786383 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:58.786383 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:58.786383 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:58.786383 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:58.786383 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:58.786383 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:58.786383 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:58.787302 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:07:58.787302 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:07:58.787302 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:58.787302 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:58.787302 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 316/635] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:07:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:58.788605 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a2539-9b97-4455-8473-361c83f1f168 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:58.817959 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:58.825826 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0712db8f-9436-4d45-8eb8-f9ebce55de3d None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:58.868264 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81873732-24ac-42c0-bdf2-6118f5d5cb91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:58.868942 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81873732-24ac-42c0-bdf2-6118f5d5cb91 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:58.869227 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81873732-24ac-42c0-bdf2-6118f5d5cb91 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:58.869505 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81873732-24ac-42c0-bdf2-6118f5d5cb91 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:58.879388 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:58.881229 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81873732-24ac-42c0-bdf2-6118f5d5cb91 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:58.887028 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-81873732-24ac-42c0-bdf2-6118f5d5cb91 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:07:58.887028 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:58.887028 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:58.887028 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:58.887028 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:58.887028 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:58.887028 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:58.887028 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:58.887028 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:58.887028 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:58.887028 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:58.887028 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:58.887028 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:58.887028 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:58.887028 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:58.887028 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:58.887973 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:58.887973 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:58.887973 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:58.887973 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:58.887973 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:58.887973 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:58.887973 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:58.887973 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:58.887973 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:58.887973 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:58.887973 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:58.887973 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:58.887973 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:58.887973 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:58.887973 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:58.887973 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:58.889532 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:58.889532 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:58.889532 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:58.889532 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:58.889532 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:58.889532 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:58.889532 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:58.889532 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:58.889532 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:58.889532 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:58.889532 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:07:58.889532 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:58.889532 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 320/636] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Aug 5 02:07:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:58.889532 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802823c-37a1-442b-880f-d0cd7cf27358 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:58.890292 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802823c-37a1-442b-880f-d0cd7cf27358 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:58.890292 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3802823c-37a1-442b-880f-d0cd7cf27358 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:58.891304 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 321/637] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:07:58 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:07:58.891846 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802823c-37a1-442b-880f-d0cd7cf27358 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:58.908362 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170a2539-9b97-4455-8473-361c83f1f168 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:58.947307 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5b59e-dd55-4684-83d6-d9a88deac562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:58.947931 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5b59e-dd55-4684-83d6-d9a88deac562 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:58.948216 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5b59e-dd55-4684-83d6-d9a88deac562 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:58.948519 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ae5b59e-dd55-4684-83d6-d9a88deac562 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:58.949236 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5b59e-dd55-4684-83d6-d9a88deac562 None admin] RBAC: Adding query filter params (name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:58.949541 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5b59e-dd55-4684-83d6-d9a88deac562 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:58.950915 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ae5b59e-dd55-4684-83d6-d9a88deac562 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:58.963671 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 317/638] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Aug 5 02:07:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:58.964498 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5b59e-dd55-4684-83d6-d9a88deac562 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:59.002062 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3802823c-37a1-442b-880f-d0cd7cf27358 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:59.037434 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557cf9ec-b35e-4096-8bf3-5aa1ad1139bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:59.038806 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cf9ec-b35e-4096-8bf3-5aa1ad1139bc None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:59.039086 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cf9ec-b35e-4096-8bf3-5aa1ad1139bc None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:59.039358 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557cf9ec-b35e-4096-8bf3-5aa1ad1139bc None admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:59.040050 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cf9ec-b35e-4096-8bf3-5aa1ad1139bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:59.040369 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cf9ec-b35e-4096-8bf3-5aa1ad1139bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:59.041729 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-557cf9ec-b35e-4096-8bf3-5aa1ad1139bc None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:59.059051 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 322/639] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:07:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:59.060434 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411cb835-03ef-49e0-98da-a5811fe2621b None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:59.060730 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411cb835-03ef-49e0-98da-a5811fe2621b None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:59.061021 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411cb835-03ef-49e0-98da-a5811fe2621b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:59.071220 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ae5b59e-dd55-4684-83d6-d9a88deac562 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:59.079157 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-411cb835-03ef-49e0-98da-a5811fe2621b None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:07:59.080368 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-411cb835-03ef-49e0-98da-a5811fe2621b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:07:59.091988 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:59.110292 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e4120-a710-4652-ba1d-8cc52295099b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:59.110913 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e4120-a710-4652-ba1d-8cc52295099b None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:59.111264 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e4120-a710-4652-ba1d-8cc52295099b None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:59.111459 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a0e4120-a710-4652-ba1d-8cc52295099b None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:59.112176 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e4120-a710-4652-ba1d-8cc52295099b None admin] RBAC: Adding query filter params (name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:59.112583 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e4120-a710-4652-ba1d-8cc52295099b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:59.113942 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a0e4120-a710-4652-ba1d-8cc52295099b None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:59.127238 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 318/640] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Aug 5 02:07:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:59.127238 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e4120-a710-4652-ba1d-8cc52295099b None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:59.136891 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:59.156300 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 323/641] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:07:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:07:59.157054 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411cb835-03ef-49e0-98da-a5811fe2621b None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:59.245665 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a0e4120-a710-4652-ba1d-8cc52295099b None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:59.269190 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411cb835-03ef-49e0-98da-a5811fe2621b None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:59.280238 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29724d2-f7ef-4c48-9ff8-219bc9d91001 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:59.280899 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29724d2-f7ef-4c48-9ff8-219bc9d91001 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:59.281180 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29724d2-f7ef-4c48-9ff8-219bc9d91001 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:59.281450 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29724d2-f7ef-4c48-9ff8-219bc9d91001 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:59.292130 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29724d2-f7ef-4c48-9ff8-219bc9d91001 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:59.293587 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29724d2-f7ef-4c48-9ff8-219bc9d91001 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:59.305703 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a00a3-cc06-4ce2-89ad-71dfb9a028e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:59.306506 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a00a3-cc06-4ce2-89ad-71dfb9a028e2 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:59.306956 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a00a3-cc06-4ce2-89ad-71dfb9a028e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:59.307373 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259a00a3-cc06-4ce2-89ad-71dfb9a028e2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:59.308865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-c29724d2-f7ef-4c48-9ff8-219bc9d91001 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:59.308865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:59.308865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:59.308865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:59.308865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:59.308865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:59.308865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:59.308865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:59.308865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:59.308865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:59.308865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:59.308865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:59.308865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:07:59.308865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:07:59.308865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:07:59.309901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:07:59.309901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:59.309901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:59.309901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:59.309901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:59.309901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:59.309901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:59.309901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:59.309901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:59.309901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:59.309901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:59.309901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:59.309901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:59.309901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:59.309901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:59.309901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:59.309901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:59.310806 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:07:59.310806 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:07:59.310806 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:59.310806 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:59.310806 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 319/642] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:07:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:59.310806 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29724d2-f7ef-4c48-9ff8-219bc9d91001 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:59.320646 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259a00a3-cc06-4ce2-89ad-71dfb9a028e2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:59.322273 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259a00a3-cc06-4ce2-89ad-71dfb9a028e2 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:59.333811 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-259a00a3-cc06-4ce2-89ad-71dfb9a028e2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:07:59.333811 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:59.333811 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:59.333811 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:59.333811 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:59.333811 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:59.333811 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:59.333811 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:59.333811 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:59.333811 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:59.333811 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:59.333811 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:59.333811 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:07:59.333811 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:07:59.333811 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:07:59.335454 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:07:59.335454 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:59.335454 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:59.335454 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:59.335454 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:59.335454 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:59.335454 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:59.335454 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:59.335454 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:59.335454 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:59.335454 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:59.335454 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:59.335454 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:59.335454 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:59.335454 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:59.335454 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:59.335454 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:59.336540 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:07:59.336540 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:07:59.336540 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:07:59.336540 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:07:59.336540 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:07:59.336540 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:07:59.336540 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:07:59.336540 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:59.338420 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 324/643] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:07:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:59.339501 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a00a3-cc06-4ce2-89ad-71dfb9a028e2 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:59.349130 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:59.379924 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:59.422087 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29724d2-f7ef-4c48-9ff8-219bc9d91001 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:59.456216 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4836515-e18c-496a-9595-f5aaeb6d1514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:59.456888 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4836515-e18c-496a-9595-f5aaeb6d1514 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:59.457172 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4836515-e18c-496a-9595-f5aaeb6d1514 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:59.457445 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4836515-e18c-496a-9595-f5aaeb6d1514 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:59.457549 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259a00a3-cc06-4ce2-89ad-71dfb9a028e2 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:59.469391 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4836515-e18c-496a-9595-f5aaeb6d1514 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:59.470848 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4836515-e18c-496a-9595-f5aaeb6d1514 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:59.487649 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-a4836515-e18c-496a-9595-f5aaeb6d1514 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:59.487649 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:59.487649 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:59.487649 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:59.487649 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:59.487649 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:59.487649 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:59.487649 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:59.487649 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:59.487649 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:59.487649 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:59.487649 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:59.487649 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:07:59.487649 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:07:59.487649 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:07:59.488646 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:07:59.488646 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:59.488646 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:59.488646 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:59.488646 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:59.488646 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:59.488646 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:59.488646 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:59.488646 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:59.488646 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:59.488646 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:59.488646 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:59.488646 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:59.488646 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:59.488646 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:59.488646 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:59.488646 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:59.489686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:07:59.489686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:07:59.489686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:07:59.489686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:59.489686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 320/644] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:07:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:59.489974 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4836515-e18c-496a-9595-f5aaeb6d1514 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:59.503861 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aeabac-9147-482f-a583-e7d001a2fa3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:59.504855 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aeabac-9147-482f-a583-e7d001a2fa3d None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:59.505138 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aeabac-9147-482f-a583-e7d001a2fa3d None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:59.505421 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7aeabac-9147-482f-a583-e7d001a2fa3d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:59.516623 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7aeabac-9147-482f-a583-e7d001a2fa3d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:07:59.522917 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-c7aeabac-9147-482f-a583-e7d001a2fa3d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:07:59.522917 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:59.522917 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:59.522917 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:59.522917 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:59.522917 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:59.522917 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:59.522917 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:59.522917 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:59.522917 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:59.522917 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:59.522917 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:59.522917 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:07:59.522917 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:07:59.522917 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:07:59.522917 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:07:59.524170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:07:59.524170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:07:59.524170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:07:59.524170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:07:59.524170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:59.524170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:59.524170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:59.524170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:59.524170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:59.524170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:59.524170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:59.524170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:59.524170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:59.524170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:59.524170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:59.524170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:59.525055 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:59.525055 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:59.525055 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:59.525055 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:59.525055 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:07:59.525055 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:07:59.525055 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:07:59.525055 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:07:59.525055 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:07:59.525055 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:07:59.525055 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:07:59.525055 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:07:59.525055 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 325/645] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Aug 5 02:07:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:59.525055 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aeabac-9147-482f-a583-e7d001a2fa3d None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:59.601346 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:59.602428 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4836515-e18c-496a-9595-f5aaeb6d1514 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:59.615290 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:59.637083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf169a6-b21d-4082-b6c2-59268ff63353 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:59.637690 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf169a6-b21d-4082-b6c2-59268ff63353 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:59.637970 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf169a6-b21d-4082-b6c2-59268ff63353 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:59.638244 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf169a6-b21d-4082-b6c2-59268ff63353 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:59.638937 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf169a6-b21d-4082-b6c2-59268ff63353 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:59.639238 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf169a6-b21d-4082-b6c2-59268ff63353 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:59.640620 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf169a6-b21d-4082-b6c2-59268ff63353 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:59.641157 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7aeabac-9147-482f-a583-e7d001a2fa3d None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:59.656397 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 321/646] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:59.656397 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf169a6-b21d-4082-b6c2-59268ff63353 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:59.682198 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7080b99-7c19-4ba4-bf12-e7bef92c35ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:59.682931 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7080b99-7c19-4ba4-bf12-e7bef92c35ae None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:59.683213 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7080b99-7c19-4ba4-bf12-e7bef92c35ae None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:59.683623 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7080b99-7c19-4ba4-bf12-e7bef92c35ae None admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:59.684431 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7080b99-7c19-4ba4-bf12-e7bef92c35ae None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:59.684739 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7080b99-7c19-4ba4-bf12-e7bef92c35ae None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:59.686277 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7080b99-7c19-4ba4-bf12-e7bef92c35ae None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:59.704032 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 326/647] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Aug 5 02:07:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:59.704032 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7080b99-7c19-4ba4-bf12-e7bef92c35ae None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:59.762988 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf169a6-b21d-4082-b6c2-59268ff63353 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:59.800899 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97020726-4521-421e-8461-4375656d66e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:59.801450 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97020726-4521-421e-8461-4375656d66e1 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:59.801724 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97020726-4521-421e-8461-4375656d66e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:59.801998 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97020726-4521-421e-8461-4375656d66e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:59.802689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97020726-4521-421e-8461-4375656d66e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:59.803114 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97020726-4521-421e-8461-4375656d66e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:59.804969 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97020726-4521-421e-8461-4375656d66e1 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:59.809339 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7080b99-7c19-4ba4-bf12-e7bef92c35ae None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:59.821906 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 322/648] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:07:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:59.821906 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97020726-4521-421e-8461-4375656d66e1 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:59.843540 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:59.855871 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f7ad45-6af9-47fd-a87e-a4b65afcf254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:59.856816 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7ad45-6af9-47fd-a87e-a4b65afcf254 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:59.857106 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7ad45-6af9-47fd-a87e-a4b65afcf254 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:59.857417 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f7ad45-6af9-47fd-a87e-a4b65afcf254 None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:59.858267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f7ad45-6af9-47fd-a87e-a4b65afcf254 None admin] RBAC: Adding query filter params (name=service) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:07:59.858722 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:07:59.858897 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f7ad45-6af9-47fd-a87e-a4b65afcf254 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:59.860899 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f7ad45-6af9-47fd-a87e-a4b65afcf254 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:59.875992 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 327/649] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Aug 5 02:07:59 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:07:59.875992 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f7ad45-6af9-47fd-a87e-a4b65afcf254 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:59.928164 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97020726-4521-421e-8461-4375656d66e1 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:07:59.961991 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364cd5d-3cea-42e6-b207-3096dd89747c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:07:59.962625 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364cd5d-3cea-42e6-b207-3096dd89747c None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:07:59.963535 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364cd5d-3cea-42e6-b207-3096dd89747c None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:07:59.963535 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a364cd5d-3cea-42e6-b207-3096dd89747c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:07:59.971417 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a364cd5d-3cea-42e6-b207-3096dd89747c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:07:59.972983 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a364cd5d-3cea-42e6-b207-3096dd89747c None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:07:59.985161 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-a364cd5d-3cea-42e6-b207-3096dd89747c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 02:07:59.985161 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:07:59.985161 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:07:59.985161 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:07:59.985161 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:07:59.985161 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:07:59.985161 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:07:59.985161 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:07:59.985161 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:07:59.985161 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:07:59.985161 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:07:59.985161 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:07:59.985161 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:07:59.985161 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:07:59.985161 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:07:59.985161 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:07:59.986140 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:07:59.986140 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:07:59.986140 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:07:59.986140 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:07:59.986140 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:07:59.986140 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:07:59.986140 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:07:59.986140 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:07:59.986140 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:07:59.986140 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:07:59.986140 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:07:59.986140 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:07:59.986140 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:07:59.986140 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:07:59.986140 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:07:59.986140 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:07:59.986140 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:07:59.986140 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:07:59.987079 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:07:59.987079 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:07:59.987079 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:07:59.987079 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:07:59.987079 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:07:59.987079 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:07:59.987079 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:07:59.987079 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:07:59.987079 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 02:07:59.987079 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:07:59.987079 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 323/650] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:07:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:07:59.987079 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364cd5d-3cea-42e6-b207-3096dd89747c None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:07:59.999447 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f7ad45-6af9-47fd-a87e-a4b65afcf254 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:00.033872 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b745102-f9a6-483a-a697-e48c5d6ee34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:00.034478 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b745102-f9a6-483a-a697-e48c5d6ee34a None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:00.034754 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b745102-f9a6-483a-a697-e48c5d6ee34a None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:00.035025 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b745102-f9a6-483a-a697-e48c5d6ee34a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:00.035803 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b745102-f9a6-483a-a697-e48c5d6ee34a None admin] RBAC: Adding query filter params (role.id=876fd0d181d74df4bbc73b2db1c42fbe, scope.project.id=95d88dece7184bf1842c4f8d275d52cd, user.id=4b5c0958604b436daa44b1f67c9dec26) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:00.036111 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b745102-f9a6-483a-a697-e48c5d6ee34a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:00.037579 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b745102-f9a6-483a-a697-e48c5d6ee34a None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:00.052443 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 328/651] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:07:59 2022] GET /identity/v3/role_assignments?user.id=4b5c0958604b436daa44b1f67c9dec26&scope.project.id=95d88dece7184bf1842c4f8d275d52cd&role.id=876fd0d181d74df4bbc73b2db1c42fbe => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:00.052443 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b745102-f9a6-483a-a697-e48c5d6ee34a None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:00.097282 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:00.109239 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a364cd5d-3cea-42e6-b207-3096dd89747c None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:00.120243 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:00.150516 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9710232-5868-458a-8c4a-f87e68045ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:00.151386 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9710232-5868-458a-8c4a-f87e68045ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:00.151743 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9710232-5868-458a-8c4a-f87e68045ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:00.152101 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9710232-5868-458a-8c4a-f87e68045ae7 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:00.161242 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9710232-5868-458a-8c4a-f87e68045ae7 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:00.163670 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9710232-5868-458a-8c4a-f87e68045ae7 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:00.176350 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b745102-f9a6-483a-a697-e48c5d6ee34a None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:00.177269 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-a9710232-5868-458a-8c4a-f87e68045ae7 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 05 02:08:00.177269 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:00.177269 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:00.177269 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:00.177269 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:00.177269 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:00.177269 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:00.177269 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:00.177269 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:00.177269 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:00.177269 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:00.177269 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:00.177269 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:08:00.177269 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:08:00.177269 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:08:00.177269 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:08:00.178171 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:00.178171 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:00.178171 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:08:00.178171 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:08:00.178171 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:08:00.178171 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:08:00.178171 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:00.178171 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:00.178171 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:00.178171 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:00.178171 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:00.178171 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:00.178171 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:00.178171 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:00.178171 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:00.178171 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:00.178171 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:00.178171 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:00.179507 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:00.179507 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:00.179507 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:08:00.179507 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:08:00.179507 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:08:00.179507 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:08:00.179507 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:08:00.179507 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:08:00.179507 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 05 02:08:00.179507 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:00.179507 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 324/652] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:07:59 2022] GET /identity/v3/users/glance => generated 84 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:00.180113 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9710232-5868-458a-8c4a-f87e68045ae7 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:00.217590 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a1108-1157-449c-8339-5932c6f4e867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:00.218241 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a1108-1157-449c-8339-5932c6f4e867 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:00.218520 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a1108-1157-449c-8339-5932c6f4e867 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:00.218794 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a1108-1157-449c-8339-5932c6f4e867 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:00.233128 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971a1108-1157-449c-8339-5932c6f4e867 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:00.234737 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971a1108-1157-449c-8339-5932c6f4e867 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:00.251910 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-971a1108-1157-449c-8339-5932c6f4e867 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:00.251910 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:00.251910 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:00.251910 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:00.251910 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:00.251910 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:00.251910 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:00.251910 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:00.251910 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:00.251910 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:00.251910 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:00.251910 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:00.251910 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:08:00.251910 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:08:00.251910 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:08:00.253071 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:08:00.253071 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:00.253071 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:00.253071 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:00.253071 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:00.253071 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:00.253071 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:00.253071 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:00.253071 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:00.253071 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:00.253071 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:00.253071 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:00.253071 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:00.253071 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:00.253071 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:00.253071 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:00.253071 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:00.254188 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:08:00.254188 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:08:00.254188 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:00.254188 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:00.254188 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 329/653] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:00.254188 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a1108-1157-449c-8339-5932c6f4e867 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:00.313884 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9710232-5868-458a-8c4a-f87e68045ae7 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:00.363037 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ebdf0-75be-4af8-bb8c-ce51cf9c5d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:00.363677 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ebdf0-75be-4af8-bb8c-ce51cf9c5d29 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:00.363961 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ebdf0-75be-4af8-bb8c-ce51cf9c5d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:00.364706 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88ebdf0-75be-4af8-bb8c-ce51cf9c5d29 None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:00.365252 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88ebdf0-75be-4af8-bb8c-ce51cf9c5d29 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:00.366583 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88ebdf0-75be-4af8-bb8c-ce51cf9c5d29 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:00.368303 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e88ebdf0-75be-4af8-bb8c-ce51cf9c5d29 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:00.385395 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a1108-1157-449c-8339-5932c6f4e867 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:00.390171 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:00.393548 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 325/654] 10.222.0.15 () {56 vars in 1137 bytes} [Fri Aug 5 02:08:00 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:00.393981 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ebdf0-75be-4af8-bb8c-ce51cf9c5d29 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:00.420728 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:00.432686 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177afcf9-9b23-4641-852a-a52255e40625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:00.433615 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177afcf9-9b23-4641-852a-a52255e40625 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:00.434031 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177afcf9-9b23-4641-852a-a52255e40625 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:00.434316 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177afcf9-9b23-4641-852a-a52255e40625 None admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:00.435473 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177afcf9-9b23-4641-852a-a52255e40625 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:00.435782 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177afcf9-9b23-4641-852a-a52255e40625 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:00.437252 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177afcf9-9b23-4641-852a-a52255e40625 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:00.456420 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 330/655] 10.222.0.15 () {56 vars in 1137 bytes} [Fri Aug 5 02:08:00 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:00.461282 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177afcf9-9b23-4641-852a-a52255e40625 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:00.521332 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e88ebdf0-75be-4af8-bb8c-ce51cf9c5d29 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:00.560459 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab219dd3-9b0a-4fb8-a1a3-e61be60decc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:00.561079 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab219dd3-9b0a-4fb8-a1a3-e61be60decc4 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:00.561360 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab219dd3-9b0a-4fb8-a1a3-e61be60decc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:00.561654 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab219dd3-9b0a-4fb8-a1a3-e61be60decc4 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:00.562334 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab219dd3-9b0a-4fb8-a1a3-e61be60decc4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:00.562624 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab219dd3-9b0a-4fb8-a1a3-e61be60decc4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:00.564049 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab219dd3-9b0a-4fb8-a1a3-e61be60decc4 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:00.566892 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177afcf9-9b23-4641-852a-a52255e40625 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:00.576558 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 326/656] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:00.582332 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19152c4d-b2ff-4e25-89e1-0694a7f5adcb None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:00.582624 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19152c4d-b2ff-4e25-89e1-0694a7f5adcb None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:00.583047 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19152c4d-b2ff-4e25-89e1-0694a7f5adcb None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:00.588367 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 327/657] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:08:00.588367 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19152c4d-b2ff-4e25-89e1-0694a7f5adcb None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:00.608178 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927b902-ea1a-41c7-8768-e400ea77f8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:00.608827 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927b902-ea1a-41c7-8768-e400ea77f8ab None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:00.609108 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927b902-ea1a-41c7-8768-e400ea77f8ab None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:00.609387 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6927b902-ea1a-41c7-8768-e400ea77f8ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:00.642426 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:00.657918 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:00.688108 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6927b902-ea1a-41c7-8768-e400ea77f8ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:00.689821 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6927b902-ea1a-41c7-8768-e400ea77f8ab None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:00.692864 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19152c4d-b2ff-4e25-89e1-0694a7f5adcb None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:00.728689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5dd4c8-2df9-4d7d-b82b-2dc6cb328945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:00.729311 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5dd4c8-2df9-4d7d-b82b-2dc6cb328945 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:00.729589 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5dd4c8-2df9-4d7d-b82b-2dc6cb328945 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:00.729861 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5dd4c8-2df9-4d7d-b82b-2dc6cb328945 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:00.798175 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 331/658] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:08:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:08:00.799015 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927b902-ea1a-41c7-8768-e400ea77f8ab None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:00.804212 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5dd4c8-2df9-4d7d-b82b-2dc6cb328945 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:00.805862 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c5dd4c8-2df9-4d7d-b82b-2dc6cb328945 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:00.875389 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:00.882056 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:00.922423 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6927b902-ea1a-41c7-8768-e400ea77f8ab None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:00.922654 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 328/659] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:08:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 332 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:08:00.922654 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ffe01-4ced-4e3f-9646-e08fec8223b2 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:00.922654 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ffe01-4ced-4e3f-9646-e08fec8223b2 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:00.922654 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5ffe01-4ced-4e3f-9646-e08fec8223b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:00.939751 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-8e5ffe01-4ced-4e3f-9646-e08fec8223b2 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:00.940980 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-8e5ffe01-4ced-4e3f-9646-e08fec8223b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:00.955837 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e7ffa-1d04-4bfa-9baa-5e82d7d87447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:00.956505 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e7ffa-1d04-4bfa-9baa-5e82d7d87447 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:00.956785 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e7ffa-1d04-4bfa-9baa-5e82d7d87447 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:00.957057 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0e7ffa-1d04-4bfa-9baa-5e82d7d87447 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:00.964542 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e7ffa-1d04-4bfa-9baa-5e82d7d87447 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:00.965969 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0e7ffa-1d04-4bfa-9baa-5e82d7d87447 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:00.979627 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-fd0e7ffa-1d04-4bfa-9baa-5e82d7d87447 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 05 02:08:00.979627 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:00.979627 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:00.979627 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:00.979627 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:00.979627 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:00.979627 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:00.979627 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:00.979627 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:00.979627 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:00.979627 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:00.979627 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:00.979627 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:08:00.979627 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:08:00.979627 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:08:00.979627 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:08:00.980846 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:00.980846 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:00.980846 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:08:00.980846 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:08:00.980846 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:08:00.980846 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:08:00.980846 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:00.980846 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:00.980846 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:00.980846 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:00.980846 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:00.980846 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:00.980846 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:00.980846 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:00.980846 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:00.980846 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:00.980846 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:00.980846 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:00.981773 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:00.981773 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:00.981773 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:08:00.981773 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:08:00.981773 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:08:00.981773 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:08:00.981773 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:08:00.981773 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:08:00.981773 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 05 02:08:00.981773 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:00.985492 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 332/660] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Aug 5 02:08:00 2022] GET /identity/v3/users/neutron => generated 85 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:00.986306 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e7ffa-1d04-4bfa-9baa-5e82d7d87447 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:01.020350 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 329/661] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:08:01.020350 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ffe01-4ced-4e3f-9646-e08fec8223b2 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:01.109101 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0e7ffa-1d04-4bfa-9baa-5e82d7d87447 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:01.111885 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:01.114706 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5ffe01-4ced-4e3f-9646-e08fec8223b2 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:01.133522 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:01.147166 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30bb798-09f3-41e8-bcb5-9fc9976bda49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:01.147807 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bb798-09f3-41e8-bcb5-9fc9976bda49 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:01.148156 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bb798-09f3-41e8-bcb5-9fc9976bda49 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:01.148724 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b30bb798-09f3-41e8-bcb5-9fc9976bda49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:01.153363 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf72641-4bd2-42db-bb21-ae3723d99f05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:01.154004 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf72641-4bd2-42db-bb21-ae3723d99f05 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:01.154286 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf72641-4bd2-42db-bb21-ae3723d99f05 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:01.154561 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf72641-4bd2-42db-bb21-ae3723d99f05 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:01.159453 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30bb798-09f3-41e8-bcb5-9fc9976bda49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:01.160919 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b30bb798-09f3-41e8-bcb5-9fc9976bda49 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:01.166409 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf72641-4bd2-42db-bb21-ae3723d99f05 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:01.167836 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf72641-4bd2-42db-bb21-ae3723d99f05 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:01.176607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-b30bb798-09f3-41e8-bcb5-9fc9976bda49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:01.176607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:01.176607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:01.176607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:01.176607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:01.176607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:01.176607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:01.176607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:01.176607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:01.176607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:01.176607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:01.176607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:01.176607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:08:01.176607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:08:01.176607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:08:01.177481 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:08:01.177481 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:01.177481 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:01.177481 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:01.177481 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:01.177481 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:01.177481 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:01.177481 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:01.177481 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:01.177481 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:01.177481 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:01.177481 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:01.177481 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:01.177481 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:01.177481 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:01.177481 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:01.177481 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:01.178934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:08:01.178934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:08:01.178934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:01.178934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:01.178934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 333/662] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:01.179218 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30bb798-09f3-41e8-bcb5-9fc9976bda49 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:01.188776 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-4bf72641-4bd2-42db-bb21-ae3723d99f05 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:01.188776 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:01.188776 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:01.188776 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:01.188776 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:01.188776 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:01.188776 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:01.188776 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:01.188776 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:01.188776 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:01.188776 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:01.188776 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:01.188776 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:08:01.188776 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:08:01.188776 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:08:01.189652 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:08:01.189652 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:01.189652 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:01.189652 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:01.189652 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:01.189652 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:01.189652 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:01.189652 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:01.189652 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:01.189652 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:01.189652 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:01.189652 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:01.189652 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:01.189652 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:01.189652 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:01.189652 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:01.189652 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:01.190616 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:08:01.190616 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:08:01.190616 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:01.190616 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:01.190616 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 330/663] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:01.190895 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf72641-4bd2-42db-bb21-ae3723d99f05 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:01.291265 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b30bb798-09f3-41e8-bcb5-9fc9976bda49 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:01.297008 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf72641-4bd2-42db-bb21-ae3723d99f05 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:01.329301 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d05cc4e-d7de-4688-a562-e59e5005a9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:01.329925 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05cc4e-d7de-4688-a562-e59e5005a9d9 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:01.330208 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05cc4e-d7de-4688-a562-e59e5005a9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:01.330507 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d05cc4e-d7de-4688-a562-e59e5005a9d9 None admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:01.331280 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d05cc4e-d7de-4688-a562-e59e5005a9d9 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:01.331579 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d05cc4e-d7de-4688-a562-e59e5005a9d9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:01.333078 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d05cc4e-d7de-4688-a562-e59e5005a9d9 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:01.336837 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864346a-321f-4b96-bf8d-2f9adc662933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:01.337482 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864346a-321f-4b96-bf8d-2f9adc662933 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:01.337762 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864346a-321f-4b96-bf8d-2f9adc662933 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:01.338034 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0864346a-321f-4b96-bf8d-2f9adc662933 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:01.349264 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0864346a-321f-4b96-bf8d-2f9adc662933 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:08:01.353719 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 334/664] 10.222.0.15 () {56 vars in 1139 bytes} [Fri Aug 5 02:08:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:01.358468 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d05cc4e-d7de-4688-a562-e59e5005a9d9 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:01.358570 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-0864346a-321f-4b96-bf8d-2f9adc662933 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:08:01.358570 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:01.358570 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:01.358570 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:01.358570 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:01.358570 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:01.358570 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:01.358570 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:01.358570 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:01.358570 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:01.358570 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:01.358570 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:01.358570 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:08:01.358570 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:08:01.358570 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:08:01.358570 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:08:01.359477 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:08:01.359477 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:08:01.359477 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:08:01.359477 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:08:01.359477 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:01.359477 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:01.359477 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:01.359477 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:01.359477 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:01.359477 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:01.359477 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:01.359477 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:01.359477 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:01.359477 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:01.359477 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:01.359477 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:01.360348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:01.360348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:01.360348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:01.360348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:01.360348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:08:01.360348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:08:01.360348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:08:01.360348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:08:01.360348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:08:01.360348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:08:01.360348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:08:01.360348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:01.360348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 331/665] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Aug 5 02:08:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:01.360348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864346a-321f-4b96-bf8d-2f9adc662933 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:01.377134 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:01.395823 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:01.470591 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d05cc4e-d7de-4688-a562-e59e5005a9d9 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:01.470993 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0864346a-321f-4b96-bf8d-2f9adc662933 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:01.506865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2679b8d-5e44-4492-8edd-9ffa330a9b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:01.507635 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c4752-43ef-4fa5-b1d8-848a32721298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:01.508066 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2679b8d-5e44-4492-8edd-9ffa330a9b0f None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:01.508237 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c4752-43ef-4fa5-b1d8-848a32721298 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:01.508370 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2679b8d-5e44-4492-8edd-9ffa330a9b0f None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:01.508556 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c4752-43ef-4fa5-b1d8-848a32721298 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:01.508661 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2679b8d-5e44-4492-8edd-9ffa330a9b0f None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:01.508834 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1c4752-43ef-4fa5-b1d8-848a32721298 None admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:01.509325 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2679b8d-5e44-4492-8edd-9ffa330a9b0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:01.509497 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1c4752-43ef-4fa5-b1d8-848a32721298 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:01.509662 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2679b8d-5e44-4492-8edd-9ffa330a9b0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:01.509815 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1c4752-43ef-4fa5-b1d8-848a32721298 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:01.510996 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2679b8d-5e44-4492-8edd-9ffa330a9b0f None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:01.511186 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1c4752-43ef-4fa5-b1d8-848a32721298 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:01.527899 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 332/666] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:01.528093 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 335/667] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:01.528198 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2679b8d-5e44-4492-8edd-9ffa330a9b0f None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:01.528286 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c4752-43ef-4fa5-b1d8-848a32721298 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:01.601533 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:01.627636 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:01.639263 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1c4752-43ef-4fa5-b1d8-848a32721298 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:01.639458 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2679b8d-5e44-4492-8edd-9ffa330a9b0f None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:01.674226 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182b620-8e73-4502-b5b3-e2c4f06abdb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:01.674840 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182b620-8e73-4502-b5b3-e2c4f06abdb2 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:01.675123 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182b620-8e73-4502-b5b3-e2c4f06abdb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:01.675399 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3182b620-8e73-4502-b5b3-e2c4f06abdb2 None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:01.676116 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182b620-8e73-4502-b5b3-e2c4f06abdb2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:01.676292 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288db961-404f-4c56-a4c7-d8391ed7a62e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:01.676493 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182b620-8e73-4502-b5b3-e2c4f06abdb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:01.676888 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288db961-404f-4c56-a4c7-d8391ed7a62e None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:01.677165 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288db961-404f-4c56-a4c7-d8391ed7a62e None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:01.677433 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-288db961-404f-4c56-a4c7-d8391ed7a62e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:01.677805 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3182b620-8e73-4502-b5b3-e2c4f06abdb2 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:01.690451 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 336/668] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Aug 5 02:08:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:01.690451 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182b620-8e73-4502-b5b3-e2c4f06abdb2 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:01.757470 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288db961-404f-4c56-a4c7-d8391ed7a62e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:01.758917 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-288db961-404f-4c56-a4c7-d8391ed7a62e None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:01.792352 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3182b620-8e73-4502-b5b3-e2c4f06abdb2 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:01.832824 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d3756-3b63-47a9-b98b-a0e697ae1379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:01.833626 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d3756-3b63-47a9-b98b-a0e697ae1379 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:01.834523 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d3756-3b63-47a9-b98b-a0e697ae1379 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:01.834523 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-519d3756-3b63-47a9-b98b-a0e697ae1379 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:01.835836 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:01.846847 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d3756-3b63-47a9-b98b-a0e697ae1379 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:01.848426 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-519d3756-3b63-47a9-b98b-a0e697ae1379 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:01.860896 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-519d3756-3b63-47a9-b98b-a0e697ae1379 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:08:01.860896 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:01.860896 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:01.860896 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:01.860896 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:01.860896 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:01.860896 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:01.860896 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:01.860896 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:01.860896 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:01.860896 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:01.860896 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:01.860896 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:08:01.860896 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:08:01.860896 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:08:01.861826 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:08:01.861826 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:01.861826 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:01.861826 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:01.861826 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:01.861826 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:01.861826 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:01.861826 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:01.861826 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:01.861826 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:01.861826 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:01.861826 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:01.861826 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:01.861826 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:01.861826 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:01.861826 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:01.861826 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:01.862732 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:08:01.862732 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:08:01.862732 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:08:01.862732 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:08:01.862732 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:08:01.862732 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:08:01.862732 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:08:01.862732 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:01.862732 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 337/669] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:08:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:01.863210 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d3756-3b63-47a9-b98b-a0e697ae1379 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:01.882804 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 333/670] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:08:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:08:01.882804 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288db961-404f-4c56-a4c7-d8391ed7a62e None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:01.885432 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:01.975816 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-519d3756-3b63-47a9-b98b-a0e697ae1379 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:01.988811 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-288db961-404f-4c56-a4c7-d8391ed7a62e None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:02.016267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d78b85-0010-4707-b042-18674379aead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:02.016934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d78b85-0010-4707-b042-18674379aead None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:02.017218 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d78b85-0010-4707-b042-18674379aead None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:02.017490 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21d78b85-0010-4707-b042-18674379aead None admin] PATH_INFO: `/v3/projects/service` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:02.024898 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d78b85-0010-4707-b042-18674379aead None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:02.025178 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f4a21-d489-4999-8e9f-1c4d2264cfc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:02.025813 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f4a21-d489-4999-8e9f-1c4d2264cfc2 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:02.026090 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f4a21-d489-4999-8e9f-1c4d2264cfc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:02.026326 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21d78b85-0010-4707-b042-18674379aead None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:02.026432 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04f4a21-d489-4999-8e9f-1c4d2264cfc2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:02.036584 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f4a21-d489-4999-8e9f-1c4d2264cfc2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:02.038409 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-21d78b85-0010-4707-b042-18674379aead None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:08:02.038409 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:02.038409 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:02.038409 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:02.038409 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:02.038409 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:02.038409 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:02.038409 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:02.038409 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:02.038409 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:02.038409 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:02.038409 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:02.038409 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:08:02.038409 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:08:02.038409 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:08:02.039293 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:08:02.039293 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:02.039293 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:02.039293 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:02.039293 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:02.039293 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:02.039293 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:02.039293 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:02.039293 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:02.039293 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:02.039293 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:02.039293 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:02.039293 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:02.039293 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:02.039293 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:02.039293 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:02.039293 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:02.040186 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:08:02.040186 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:08:02.040186 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:08:02.040186 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:08:02.040186 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:08:02.040186 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:08:02.040186 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:08:02.040186 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:02.040652 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b04f4a21-d489-4999-8e9f-1c4d2264cfc2 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:02.040722 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 338/671] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:08:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:02.040722 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d78b85-0010-4707-b042-18674379aead None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:02.060886 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-b04f4a21-d489-4999-8e9f-1c4d2264cfc2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:02.060886 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:02.060886 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:02.060886 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:02.060886 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:02.060886 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:02.060886 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:02.060886 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:02.060886 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:02.060886 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:02.060886 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:02.060886 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:02.060886 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:08:02.060886 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:08:02.060886 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:08:02.061810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:08:02.061810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:02.061810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:02.061810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:02.061810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:02.061810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:02.061810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:02.061810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:02.061810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:02.061810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:02.061810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:02.061810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:02.061810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:02.061810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:02.061810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:02.061810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:02.061810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:02.067996 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:08:02.067996 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:08:02.067996 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:02.067996 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:02.067996 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 334/672] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:02.067996 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f4a21-d489-4999-8e9f-1c4d2264cfc2 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:02.093813 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:02.128012 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:02.155817 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21d78b85-0010-4707-b042-18674379aead None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:02.183292 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04f4a21-d489-4999-8e9f-1c4d2264cfc2 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:02.192583 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8697f-605b-400e-9405-32df9ef643d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:02.193470 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8697f-605b-400e-9405-32df9ef643d7 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:02.194511 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8697f-605b-400e-9405-32df9ef643d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:02.195163 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f8697f-605b-400e-9405-32df9ef643d7 None admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:02.196100 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8697f-605b-400e-9405-32df9ef643d7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:02.196608 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8697f-605b-400e-9405-32df9ef643d7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:02.198483 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f8697f-605b-400e-9405-32df9ef643d7 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:02.212317 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 339/673] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Aug 5 02:08:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:02.213463 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8697f-605b-400e-9405-32df9ef643d7 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:02.226150 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff4aba-c029-4111-bcd0-f3f36cbd1471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:02.227210 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff4aba-c029-4111-bcd0-f3f36cbd1471 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:02.228113 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff4aba-c029-4111-bcd0-f3f36cbd1471 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:02.228810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ff4aba-c029-4111-bcd0-f3f36cbd1471 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:02.242679 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff4aba-c029-4111-bcd0-f3f36cbd1471 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:02.244127 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ff4aba-c029-4111-bcd0-f3f36cbd1471 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:02.259012 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-28ff4aba-c029-4111-bcd0-f3f36cbd1471 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:02.259012 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:02.259012 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:02.259012 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:02.259012 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:02.259012 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:02.259012 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:02.259012 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:02.259012 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:02.259012 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:02.259012 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:02.259012 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:02.259012 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:08:02.259012 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:08:02.259012 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:08:02.260094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:08:02.260094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:02.260094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:02.260094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:02.260094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:02.260094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:02.260094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:02.260094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:02.260094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:02.260094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:02.260094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:02.260094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:02.260094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:02.260094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:02.260094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:02.260094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:02.260094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:02.261193 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:08:02.261193 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:08:02.261193 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:02.261193 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:02.261193 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 335/674] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:02.261662 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff4aba-c029-4111-bcd0-f3f36cbd1471 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:02.317987 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f8697f-605b-400e-9405-32df9ef643d7 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:02.337956 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:02.353224 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84781f3-c7f5-4943-8c3c-cca7fb34a6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:02.353961 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84781f3-c7f5-4943-8c3c-cca7fb34a6b0 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:02.354326 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84781f3-c7f5-4943-8c3c-cca7fb34a6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:02.354691 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84781f3-c7f5-4943-8c3c-cca7fb34a6b0 None admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:02.355527 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84781f3-c7f5-4943-8c3c-cca7fb34a6b0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:02.355895 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84781f3-c7f5-4943-8c3c-cca7fb34a6b0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:02.357415 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84781f3-c7f5-4943-8c3c-cca7fb34a6b0 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:02.358953 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:02.360822 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ff4aba-c029-4111-bcd0-f3f36cbd1471 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:02.369900 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 340/675] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Aug 5 02:08:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:02.370691 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84781f3-c7f5-4943-8c3c-cca7fb34a6b0 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:02.396433 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9976151-d1e1-48d5-807a-4e50d84a92b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:02.397104 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9976151-d1e1-48d5-807a-4e50d84a92b2 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:02.397451 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9976151-d1e1-48d5-807a-4e50d84a92b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:02.397735 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9976151-d1e1-48d5-807a-4e50d84a92b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:02.398455 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9976151-d1e1-48d5-807a-4e50d84a92b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:02.398725 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9976151-d1e1-48d5-807a-4e50d84a92b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:02.400068 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9976151-d1e1-48d5-807a-4e50d84a92b2 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:02.411404 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 336/676] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:02.413066 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc806e65-e35b-4625-9694-57fa1cfa117b None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:02.413344 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc806e65-e35b-4625-9694-57fa1cfa117b None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:02.413611 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc806e65-e35b-4625-9694-57fa1cfa117b None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:02.415031 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 337/677] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:08:02.417691 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc806e65-e35b-4625-9694-57fa1cfa117b None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:02.475668 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84781f3-c7f5-4943-8c3c-cca7fb34a6b0 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:02.508906 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193fce0c-f8ee-4784-af0b-56e6f8335f12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:02.509522 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193fce0c-f8ee-4784-af0b-56e6f8335f12 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:02.509803 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193fce0c-f8ee-4784-af0b-56e6f8335f12 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:02.510077 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-193fce0c-f8ee-4784-af0b-56e6f8335f12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:02.510862 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193fce0c-f8ee-4784-af0b-56e6f8335f12 None admin] RBAC: Adding query filter params (role.id=876fd0d181d74df4bbc73b2db1c42fbe, scope.project.id=95d88dece7184bf1842c4f8d275d52cd, user.id=6a75ac3523564e1bb23469455fdba560) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:02.511172 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193fce0c-f8ee-4784-af0b-56e6f8335f12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:02.512653 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-193fce0c-f8ee-4784-af0b-56e6f8335f12 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:02.518336 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 341/678] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:08:02 2022] GET /identity/v3/role_assignments?user.id=6a75ac3523564e1bb23469455fdba560&scope.project.id=95d88dece7184bf1842c4f8d275d52cd&role.id=876fd0d181d74df4bbc73b2db1c42fbe => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:02.518539 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc806e65-e35b-4625-9694-57fa1cfa117b None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:02.519268 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193fce0c-f8ee-4784-af0b-56e6f8335f12 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:02.571997 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c2ef8-d484-4833-bf79-4f1c82e3c3d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:02.572952 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c2ef8-d484-4833-bf79-4f1c82e3c3d3 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:02.573162 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c2ef8-d484-4833-bf79-4f1c82e3c3d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:02.573500 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c2ef8-d484-4833-bf79-4f1c82e3c3d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:02.574354 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898c2ef8-d484-4833-bf79-4f1c82e3c3d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:02.574661 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898c2ef8-d484-4833-bf79-4f1c82e3c3d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:02.576141 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898c2ef8-d484-4833-bf79-4f1c82e3c3d3 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:02.579472 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:02.586852 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:02.592512 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 338/679] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:02.593474 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c2ef8-d484-4833-bf79-4f1c82e3c3d3 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:02.716575 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c2ef8-d484-4833-bf79-4f1c82e3c3d3 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:02.755081 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab66a2f-4d1f-4106-8cac-2b650488e571 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:02.755730 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab66a2f-4d1f-4106-8cac-2b650488e571 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:02.756011 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab66a2f-4d1f-4106-8cac-2b650488e571 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:02.756786 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab66a2f-4d1f-4106-8cac-2b650488e571 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:02.760195 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-193fce0c-f8ee-4784-af0b-56e6f8335f12 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:02.764729 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab66a2f-4d1f-4106-8cac-2b650488e571 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:02.766155 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab66a2f-4d1f-4106-8cac-2b650488e571 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:02.778323 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-dab66a2f-4d1f-4106-8cac-2b650488e571 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 05 02:08:02.778323 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:02.778323 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:02.778323 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:02.778323 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:02.778323 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:02.778323 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:02.778323 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:02.778323 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:02.778323 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:02.778323 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:02.778323 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:02.778323 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:08:02.778323 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:08:02.778323 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:08:02.778323 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:08:02.779316 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:02.779316 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:02.779316 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:08:02.779316 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:08:02.779316 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:08:02.779316 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:08:02.779316 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:02.779316 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:02.779316 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:02.779316 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:02.779316 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:02.779316 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:02.779316 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:02.779316 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:02.779316 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:02.779316 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:02.779316 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:02.779316 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:02.780306 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:02.780306 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:02.780306 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:08:02.780306 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:08:02.780306 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:08:02.780306 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:08:02.780306 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:08:02.780306 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:08:02.780306 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 05 02:08:02.780306 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:02.780306 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 339/680] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Aug 5 02:08:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:02.781484 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a33f30-0a0b-4800-a186-b4a35989b4a5 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:02.781484 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a33f30-0a0b-4800-a186-b4a35989b4a5 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:02.781484 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a33f30-0a0b-4800-a186-b4a35989b4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:02.799814 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-28a33f30-0a0b-4800-a186-b4a35989b4a5 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:02.801040 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-28a33f30-0a0b-4800-a186-b4a35989b4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:02.802731 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b258e-2a07-4a31-97e4-0022aa1259d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:02.804166 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b258e-2a07-4a31-97e4-0022aa1259d8 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:02.805860 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b258e-2a07-4a31-97e4-0022aa1259d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:02.806150 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635b258e-2a07-4a31-97e4-0022aa1259d8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:02.806952 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b258e-2a07-4a31-97e4-0022aa1259d8 None admin] RBAC: Adding query filter params (role.id=876fd0d181d74df4bbc73b2db1c42fbe, scope.project.id=95d88dece7184bf1842c4f8d275d52cd, user.id=5c09080c507f4c35b81d482cfbaa6a88) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:02.807264 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b258e-2a07-4a31-97e4-0022aa1259d8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:02.808740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635b258e-2a07-4a31-97e4-0022aa1259d8 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:02.824354 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 342/681] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:08:02 2022] GET /identity/v3/role_assignments?user.id=5c09080c507f4c35b81d482cfbaa6a88&scope.project.id=95d88dece7184bf1842c4f8d275d52cd&role.id=876fd0d181d74df4bbc73b2db1c42fbe => generated 608 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:02.824354 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b258e-2a07-4a31-97e4-0022aa1259d8 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:02.880817 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:02.913605 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 340/682] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:08:02.914698 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a33f30-0a0b-4800-a186-b4a35989b4a5 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:02.963288 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635b258e-2a07-4a31-97e4-0022aa1259d8 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:02.991626 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:03.003798 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc60f1f-9dfc-45a0-b317-a714ed3e0711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:03.005320 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc60f1f-9dfc-45a0-b317-a714ed3e0711 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:03.005320 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc60f1f-9dfc-45a0-b317-a714ed3e0711 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:03.005320 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecc60f1f-9dfc-45a0-b317-a714ed3e0711 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:03.014690 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc60f1f-9dfc-45a0-b317-a714ed3e0711 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:03.016312 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecc60f1f-9dfc-45a0-b317-a714ed3e0711 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:03.029798 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-ecc60f1f-9dfc-45a0-b317-a714ed3e0711 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:08:03.029798 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:03.029798 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:03.029798 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:03.029798 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:03.029798 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:03.029798 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:03.029798 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:03.029798 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:03.029798 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:03.029798 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:03.029798 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:03.029798 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:08:03.029798 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:08:03.029798 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:08:03.030922 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:08:03.030922 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:03.030922 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:03.030922 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:03.030922 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:03.030922 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:03.030922 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:03.030922 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:03.030922 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:03.030922 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:03.030922 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:03.030922 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:03.030922 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:03.030922 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:03.030922 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:03.030922 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:03.030922 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:03.032149 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:08:03.032149 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:08:03.032149 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:08:03.032149 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:08:03.032149 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:08:03.032149 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:08:03.032149 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:08:03.032149 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:03.032149 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 343/683] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:08:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:03.032149 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc60f1f-9dfc-45a0-b317-a714ed3e0711 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:03.046156 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a33f30-0a0b-4800-a186-b4a35989b4a5 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:03.090431 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894f2cc-5ed5-4a01-a7bf-3388adfc6432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:03.091062 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894f2cc-5ed5-4a01-a7bf-3388adfc6432 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:03.091345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894f2cc-5ed5-4a01-a7bf-3388adfc6432 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:03.091621 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d894f2cc-5ed5-4a01-a7bf-3388adfc6432 None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:03.093281 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894f2cc-5ed5-4a01-a7bf-3388adfc6432 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:03.093598 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894f2cc-5ed5-4a01-a7bf-3388adfc6432 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:03.095014 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d894f2cc-5ed5-4a01-a7bf-3388adfc6432 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:03.115884 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 341/684] 10.222.0.15 () {56 vars in 1135 bytes} [Fri Aug 5 02:08:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:03.117917 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894f2cc-5ed5-4a01-a7bf-3388adfc6432 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:03.165535 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecc60f1f-9dfc-45a0-b317-a714ed3e0711 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:03.183141 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:03.211446 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9c61c-3d26-40b5-8fe9-bef56c51d4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:03.212686 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9c61c-3d26-40b5-8fe9-bef56c51d4ad None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:03.212970 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9c61c-3d26-40b5-8fe9-bef56c51d4ad None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:03.213246 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9c61c-3d26-40b5-8fe9-bef56c51d4ad None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:03.227387 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce9c61c-3d26-40b5-8fe9-bef56c51d4ad None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:08:03.234288 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-cce9c61c-3d26-40b5-8fe9-bef56c51d4ad None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:08:03.234288 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:03.234288 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:03.234288 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:03.234288 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:03.234288 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:03.234288 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:03.234288 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:03.234288 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:03.234288 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:03.234288 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:03.234288 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:03.234288 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:08:03.234288 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:08:03.234288 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:08:03.234288 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:08:03.235207 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:08:03.235207 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:08:03.235207 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:08:03.235207 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:08:03.235207 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:03.235207 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:03.235207 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:03.235207 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:03.235207 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:03.235207 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:03.235207 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:03.235207 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:03.235207 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:03.235207 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:03.235207 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:03.235207 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:03.236029 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:03.236029 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:03.236029 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:03.236029 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:03.236029 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:08:03.236029 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:08:03.236029 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:08:03.236029 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:08:03.236029 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:08:03.236029 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:08:03.236029 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:08:03.236029 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:03.236714 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 344/685] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Aug 5 02:08:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:03.238216 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9c61c-3d26-40b5-8fe9-bef56c51d4ad None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:03.244699 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d894f2cc-5ed5-4a01-a7bf-3388adfc6432 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:03.292047 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:03.293789 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e61cfa-babc-493f-8003-fb626cc1f50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:03.294708 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e61cfa-babc-493f-8003-fb626cc1f50a None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:03.295567 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e61cfa-babc-493f-8003-fb626cc1f50a None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:03.296475 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33e61cfa-babc-493f-8003-fb626cc1f50a None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:03.297787 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e61cfa-babc-493f-8003-fb626cc1f50a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:03.298250 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e61cfa-babc-493f-8003-fb626cc1f50a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:03.300359 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33e61cfa-babc-493f-8003-fb626cc1f50a None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:03.317345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 342/686] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Aug 5 02:08:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:03.318479 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e61cfa-babc-493f-8003-fb626cc1f50a None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:03.358486 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9c61c-3d26-40b5-8fe9-bef56c51d4ad None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:03.400476 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc378c-f9d4-4c3f-8838-a828868e8320 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:03.401920 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc378c-f9d4-4c3f-8838-a828868e8320 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:03.402382 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc378c-f9d4-4c3f-8838-a828868e8320 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:03.403089 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbc378c-f9d4-4c3f-8838-a828868e8320 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:03.437950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33e61cfa-babc-493f-8003-fb626cc1f50a None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:03.441242 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:03.478604 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a17d3-c8d3-4a97-8396-5d9a3f55b960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:03.479278 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a17d3-c8d3-4a97-8396-5d9a3f55b960 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:03.479493 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a17d3-c8d3-4a97-8396-5d9a3f55b960 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:03.479785 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1a17d3-c8d3-4a97-8396-5d9a3f55b960 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:03.480518 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a17d3-c8d3-4a97-8396-5d9a3f55b960 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:03.480820 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a17d3-c8d3-4a97-8396-5d9a3f55b960 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:03.482419 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1a17d3-c8d3-4a97-8396-5d9a3f55b960 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:03.491510 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 343/687] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:08:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:03.496831 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbc378c-f9d4-4c3f-8838-a828868e8320 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:03.497300 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a17d3-c8d3-4a97-8396-5d9a3f55b960 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:03.499019 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbc378c-f9d4-4c3f-8838-a828868e8320 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:03.560383 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:03.609972 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1a17d3-c8d3-4a97-8396-5d9a3f55b960 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:03.644949 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 345/688] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:08:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:08:03.644949 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc378c-f9d4-4c3f-8838-a828868e8320 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:03.653511 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffad2f-2d28-4b32-93e9-bfb710b1a59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:03.654355 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffad2f-2d28-4b32-93e9-bfb710b1a59b None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:03.654811 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffad2f-2d28-4b32-93e9-bfb710b1a59b None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:03.655237 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73ffad2f-2d28-4b32-93e9-bfb710b1a59b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:03.656191 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ffad2f-2d28-4b32-93e9-bfb710b1a59b None admin] RBAC: Adding query filter params (role.id=876fd0d181d74df4bbc73b2db1c42fbe, scope.project.id=95d88dece7184bf1842c4f8d275d52cd, user.id=f81daf3da9b34e7380c61005019a53bd) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:03.656715 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ffad2f-2d28-4b32-93e9-bfb710b1a59b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:03.658336 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73ffad2f-2d28-4b32-93e9-bfb710b1a59b None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:03.665573 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 344/689] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:08:03 2022] GET /identity/v3/role_assignments?user.id=f81daf3da9b34e7380c61005019a53bd&scope.project.id=95d88dece7184bf1842c4f8d275d52cd&role.id=876fd0d181d74df4bbc73b2db1c42fbe => generated 608 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:03.666751 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffad2f-2d28-4b32-93e9-bfb710b1a59b None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:03.736972 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:03.842890 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbc378c-f9d4-4c3f-8838-a828868e8320 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:03.879111 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73ffad2f-2d28-4b32-93e9-bfb710b1a59b None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:03.906881 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d6e6d9-838e-42e1-858e-91b06f0d477f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:03.907529 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6e6d9-838e-42e1-858e-91b06f0d477f None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:03.907811 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6e6d9-838e-42e1-858e-91b06f0d477f None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:03.908624 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d6e6d9-838e-42e1-858e-91b06f0d477f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:03.927235 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d6e6d9-838e-42e1-858e-91b06f0d477f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:03.929471 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f658c-48e0-4ce6-bad1-4c945396b056 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:03.929606 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d6e6d9-838e-42e1-858e-91b06f0d477f None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:03.930125 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f658c-48e0-4ce6-bad1-4c945396b056 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:03.930410 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f658c-48e0-4ce6-bad1-4c945396b056 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:03.930686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9f658c-48e0-4ce6-bad1-4c945396b056 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:03.931509 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:03.945945 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f658c-48e0-4ce6-bad1-4c945396b056 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:03.947399 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9f658c-48e0-4ce6-bad1-4c945396b056 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:03.950108 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-71d6e6d9-838e-42e1-858e-91b06f0d477f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:03.950108 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:03.950108 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:03.950108 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:03.950108 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:03.950108 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:03.950108 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:03.950108 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:03.950108 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:03.950108 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:03.950108 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:03.950108 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:03.950108 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:08:03.950108 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:08:03.950108 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:08:03.951010 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:08:03.951010 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:03.951010 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:03.951010 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:03.951010 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:03.951010 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:03.951010 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:03.951010 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:03.951010 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:03.951010 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:03.951010 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:03.951010 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:03.951010 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:03.951010 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:03.951010 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:03.951010 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:03.951010 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:03.951920 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:08:03.951920 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:08:03.951920 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:03.951920 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:03.951920 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 346/690] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:03.958046 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d6e6d9-838e-42e1-858e-91b06f0d477f None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:03.974743 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-0d9f658c-48e0-4ce6-bad1-4c945396b056 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:03.974743 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:03.974743 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:03.974743 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:03.974743 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:03.974743 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:03.974743 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:03.974743 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:03.974743 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:03.974743 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:03.974743 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:03.974743 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:03.974743 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:08:03.974743 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:08:03.974743 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:08:03.976190 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:08:03.976190 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:03.976190 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:03.976190 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:03.976190 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:03.976190 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:03.976190 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:03.976190 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:03.976190 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:03.976190 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:03.976190 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:03.976190 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:03.976190 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:03.976190 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:03.976190 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:03.976190 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:03.976190 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:03.977097 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:08:03.977097 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:08:03.977097 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:03.977097 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:03.979335 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 345/691] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:03.989508 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f658c-48e0-4ce6-bad1-4c945396b056 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:04.097394 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d6e6d9-838e-42e1-858e-91b06f0d477f None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:04.105882 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:04.145016 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3865f-bef2-4bcb-820c-a0e65b012b83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:04.148048 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3865f-bef2-4bcb-820c-a0e65b012b83 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:04.149502 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3865f-bef2-4bcb-820c-a0e65b012b83 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:04.150017 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a3865f-bef2-4bcb-820c-a0e65b012b83 None admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:04.152003 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a3865f-bef2-4bcb-820c-a0e65b012b83 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:04.154338 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9f658c-48e0-4ce6-bad1-4c945396b056 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:04.154835 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a3865f-bef2-4bcb-820c-a0e65b012b83 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:04.157329 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a3865f-bef2-4bcb-820c-a0e65b012b83 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:04.189709 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 347/692] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:04.195863 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3865f-bef2-4bcb-820c-a0e65b012b83 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:04.250149 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3083c-d84e-4c2e-a416-62f224e7f911 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:04.251371 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3083c-d84e-4c2e-a416-62f224e7f911 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:04.253017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3083c-d84e-4c2e-a416-62f224e7f911 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:04.253447 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90a3083c-d84e-4c2e-a416-62f224e7f911 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:04.254305 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a3083c-d84e-4c2e-a416-62f224e7f911 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:04.255700 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a3083c-d84e-4c2e-a416-62f224e7f911 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:04.260149 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90a3083c-d84e-4c2e-a416-62f224e7f911 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:04.292351 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 346/693] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:08:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:04.297418 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:04.306529 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3083c-d84e-4c2e-a416-62f224e7f911 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:04.349497 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a3865f-bef2-4bcb-820c-a0e65b012b83 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:04.388613 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db307c-ad12-40c3-93cf-724855c05749 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:04.389730 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db307c-ad12-40c3-93cf-724855c05749 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:04.390220 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db307c-ad12-40c3-93cf-724855c05749 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:04.390647 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50db307c-ad12-40c3-93cf-724855c05749 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:04.399288 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db307c-ad12-40c3-93cf-724855c05749 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:04.402330 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50db307c-ad12-40c3-93cf-724855c05749 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:04.415555 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-50db307c-ad12-40c3-93cf-724855c05749 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 02:08:04.415555 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:04.415555 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:04.415555 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:04.415555 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:04.415555 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:04.415555 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:04.415555 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:04.415555 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:04.415555 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:04.415555 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:04.415555 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:04.415555 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:08:04.415555 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:08:04.415555 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:08:04.415555 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:08:04.416607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:04.416607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:04.416607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:08:04.416607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:08:04.416607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:08:04.416607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:08:04.416607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:04.416607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:04.416607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:04.416607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:04.416607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:04.416607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:04.416607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:04.416607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:04.416607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:04.416607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:04.416607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:04.416607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:04.417538 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:04.417538 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:04.417538 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:08:04.417538 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:08:04.417538 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:08:04.417538 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:08:04.417538 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:08:04.417538 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:08:04.417538 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 02:08:04.417538 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:04.417538 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 348/694] 10.222.0.15 () {56 vars in 1093 bytes} [Fri Aug 5 02:08:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:08:04.424567 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db307c-ad12-40c3-93cf-724855c05749 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:04.551385 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90a3083c-d84e-4c2e-a416-62f224e7f911 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:04.598972 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d0825-2fb5-41ee-9da7-5e9a37fe8762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:04.599959 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d0825-2fb5-41ee-9da7-5e9a37fe8762 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:04.600185 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d0825-2fb5-41ee-9da7-5e9a37fe8762 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:04.600495 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d0825-2fb5-41ee-9da7-5e9a37fe8762 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:04.608618 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d0825-2fb5-41ee-9da7-5e9a37fe8762 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:04.610220 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d0825-2fb5-41ee-9da7-5e9a37fe8762 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:04.624111 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-096d0825-2fb5-41ee-9da7-5e9a37fe8762 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:08:04.624111 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:04.624111 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:04.624111 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:04.624111 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:04.624111 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:04.624111 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:04.624111 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:04.624111 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:04.624111 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:04.624111 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:04.624111 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:04.624111 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:08:04.624111 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:08:04.624111 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:08:04.625084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:08:04.625084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:04.625084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:04.625084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:04.625084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:04.625084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:04.625084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:04.625084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:04.625084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:04.625084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:04.625084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:04.625084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:04.625084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:04.625084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:04.625084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:04.625084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:04.625084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:04.625986 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:08:04.625986 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:08:04.625986 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:08:04.625986 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:08:04.625986 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:08:04.625986 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:08:04.625986 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:08:04.625986 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:04.630334 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 347/695] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:08:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:04.636347 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d0825-2fb5-41ee-9da7-5e9a37fe8762 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:04.636347 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:04.657978 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50db307c-ad12-40c3-93cf-724855c05749 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:04.673424 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:04.697297 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09bff2dd-ca9c-40a8-b440-674b036fb6a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:04.698459 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bff2dd-ca9c-40a8-b440-674b036fb6a2 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:04.698948 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bff2dd-ca9c-40a8-b440-674b036fb6a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:04.699365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09bff2dd-ca9c-40a8-b440-674b036fb6a2 None admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:04.700180 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bff2dd-ca9c-40a8-b440-674b036fb6a2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:04.700675 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bff2dd-ca9c-40a8-b440-674b036fb6a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:04.702499 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09bff2dd-ca9c-40a8-b440-674b036fb6a2 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:04.726977 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 349/696] 10.222.0.15 () {56 vars in 1133 bytes} [Fri Aug 5 02:08:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:04.728584 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980ef62-1ca8-42e6-8778-36a70ec54223 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:04.728872 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980ef62-1ca8-42e6-8778-36a70ec54223 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:04.729152 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e980ef62-1ca8-42e6-8778-36a70ec54223 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:04.730822 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 350/697] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:08:04.733017 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980ef62-1ca8-42e6-8778-36a70ec54223 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:04.767241 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d0825-2fb5-41ee-9da7-5e9a37fe8762 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:04.804661 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90eab3b-c9b3-413e-b1b3-e5e28a8eb57d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:04.805458 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90eab3b-c9b3-413e-b1b3-e5e28a8eb57d None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:04.805842 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90eab3b-c9b3-413e-b1b3-e5e28a8eb57d None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:04.806271 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90eab3b-c9b3-413e-b1b3-e5e28a8eb57d None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:04.807445 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90eab3b-c9b3-413e-b1b3-e5e28a8eb57d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:04.807856 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90eab3b-c9b3-413e-b1b3-e5e28a8eb57d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:04.809491 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90eab3b-c9b3-413e-b1b3-e5e28a8eb57d None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:04.830411 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 348/698] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Aug 5 02:08:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:04.830752 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54191bee-472b-4b58-b395-90a35b74afc7 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:04.831139 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54191bee-472b-4b58-b395-90a35b74afc7 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:04.831521 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54191bee-472b-4b58-b395-90a35b74afc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:04.854781 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e980ef62-1ca8-42e6-8778-36a70ec54223 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:04.861871 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-54191bee-472b-4b58-b395-90a35b74afc7 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:04.863491 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-54191bee-472b-4b58-b395-90a35b74afc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:04.890395 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f9a73-1bcf-4dc8-8433-ca55434a9c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:04.891006 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f9a73-1bcf-4dc8-8433-ca55434a9c72 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:04.891284 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f9a73-1bcf-4dc8-8433-ca55434a9c72 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:04.891549 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428f9a73-1bcf-4dc8-8433-ca55434a9c72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:04.928845 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:04.939192 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:04.952348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 349/699] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:08:04.952348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54191bee-472b-4b58-b395-90a35b74afc7 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:04.989222 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f9a73-1bcf-4dc8-8433-ca55434a9c72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:04.990909 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428f9a73-1bcf-4dc8-8433-ca55434a9c72 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:05.081987 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54191bee-472b-4b58-b395-90a35b74afc7 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:05.099562 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 351/700] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:08:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:08:05.101326 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f9a73-1bcf-4dc8-8433-ca55434a9c72 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:05.130346 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b124864-ca30-4ece-9158-cf257c75d640 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:05.131453 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b124864-ca30-4ece-9158-cf257c75d640 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:05.131897 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b124864-ca30-4ece-9158-cf257c75d640 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:05.132626 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b124864-ca30-4ece-9158-cf257c75d640 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:05.133862 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b124864-ca30-4ece-9158-cf257c75d640 None admin] RBAC: Adding query filter params (role.id=876fd0d181d74df4bbc73b2db1c42fbe, scope.project.id=95d88dece7184bf1842c4f8d275d52cd, user.id=f03233b0ee3540cdb5105f6603cfdff5) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:05.134329 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b124864-ca30-4ece-9158-cf257c75d640 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:05.136607 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b124864-ca30-4ece-9158-cf257c75d640 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:05.144449 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 350/701] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:08:04 2022] GET /identity/v3/role_assignments?user.id=f03233b0ee3540cdb5105f6603cfdff5&scope.project.id=95d88dece7184bf1842c4f8d275d52cd&role.id=876fd0d181d74df4bbc73b2db1c42fbe => generated 608 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:05.145636 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b124864-ca30-4ece-9158-cf257c75d640 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:05.216718 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:05.237862 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:05.247582 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428f9a73-1bcf-4dc8-8433-ca55434a9c72 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:05.296187 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b124864-ca30-4ece-9158-cf257c75d640 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:05.298749 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c127f8-4214-43d7-965d-1c325bbcceff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:05.300434 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c127f8-4214-43d7-965d-1c325bbcceff None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:05.300729 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c127f8-4214-43d7-965d-1c325bbcceff None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:05.301009 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c127f8-4214-43d7-965d-1c325bbcceff None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:05.301657 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c127f8-4214-43d7-965d-1c325bbcceff None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:05.303339 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c127f8-4214-43d7-965d-1c325bbcceff None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:05.317822 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-85c127f8-4214-43d7-965d-1c325bbcceff None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 02:08:05.317822 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:05.317822 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:08:05.317822 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:08:05.317822 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:08:05.317822 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:08:05.317822 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:08:05.317822 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:08:05.317822 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 02:08:05.317822 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:05.317822 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:08:05.317822 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:05.317822 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:05.317822 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:05.317822 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:05.317822 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:05.318882 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:05.318882 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:05.318882 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:05.318882 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:05.318882 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:05.318882 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:05.318882 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:05.318882 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:08:05.318882 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:08:05.318882 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:08:05.318882 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:08:05.318882 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:05.318882 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:05.318882 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:05.318882 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:05.318882 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:05.319793 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:05.319793 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:05.319793 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:05.319793 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:05.319793 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:05.319793 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:05.319793 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:05.319793 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:05.319793 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:05.319793 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:05.319793 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:05.319793 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:08:05.319793 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:08:05.319793 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 02:08:05.319793 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:05.321091 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 352/702] 10.222.0.15 () {56 vars in 1129 bytes} [Fri Aug 5 02:08:05 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:05.322003 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88723966-da17-4b0f-a608-6bb6daea05b5 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:05.322450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88723966-da17-4b0f-a608-6bb6daea05b5 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:05.322737 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88723966-da17-4b0f-a608-6bb6daea05b5 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:05.324857 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 353/703] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:08:05.329450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88723966-da17-4b0f-a608-6bb6daea05b5 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:05.339313 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e2a7a7c-f5b6-4aaf-830e-f4f4889fb9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:05.339953 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a7a7c-f5b6-4aaf-830e-f4f4889fb9e6 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:05.340228 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a7a7c-f5b6-4aaf-830e-f4f4889fb9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:05.340528 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e2a7a7c-f5b6-4aaf-830e-f4f4889fb9e6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:05.351905 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2a7a7c-f5b6-4aaf-830e-f4f4889fb9e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:05.353374 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e2a7a7c-f5b6-4aaf-830e-f4f4889fb9e6 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:05.370722 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-5e2a7a7c-f5b6-4aaf-830e-f4f4889fb9e6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:05.370722 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:05.370722 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:05.370722 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:05.370722 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:05.370722 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:05.370722 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:05.370722 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:05.370722 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:05.370722 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:05.370722 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:05.370722 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:05.370722 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:08:05.370722 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:08:05.370722 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:08:05.371647 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:08:05.371647 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:05.371647 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:05.371647 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:05.371647 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:05.371647 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:05.371647 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:05.371647 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:05.371647 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:05.371647 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:05.371647 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:05.371647 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:05.371647 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:05.371647 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:05.371647 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:05.371647 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:05.371647 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:05.372628 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:08:05.372628 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:08:05.372628 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:05.372628 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:05.376435 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 351/704] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:05.377937 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1aebe-cd69-423f-97a5-cf34fa509ff6 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:05.378317 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1aebe-cd69-423f-97a5-cf34fa509ff6 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:05.379103 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f1aebe-cd69-423f-97a5-cf34fa509ff6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:05.403057 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-78f1aebe-cd69-423f-97a5-cf34fa509ff6 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:05.404164 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-78f1aebe-cd69-423f-97a5-cf34fa509ff6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:05.468799 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88723966-da17-4b0f-a608-6bb6daea05b5 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:05.502110 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 352/705] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:08:05.503977 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f1aebe-cd69-423f-97a5-cf34fa509ff6 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:05.508342 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50498053-f7d0-475f-b11b-13592a5d388d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:05.508545 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50498053-f7d0-475f-b11b-13592a5d388d None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:05.509012 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50498053-f7d0-475f-b11b-13592a5d388d None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:05.509349 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50498053-f7d0-475f-b11b-13592a5d388d None admin] PATH_INFO: `/v3/services` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:05.510091 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50498053-f7d0-475f-b11b-13592a5d388d None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:05.510457 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50498053-f7d0-475f-b11b-13592a5d388d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:05.512021 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50498053-f7d0-475f-b11b-13592a5d388d None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:05.514407 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:05.518280 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 354/706] 10.222.0.15 () {56 vars in 1124 bytes} [Fri Aug 5 02:08:05 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:05.524235 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50498053-f7d0-475f-b11b-13592a5d388d None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:05.562570 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:05.640980 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f1aebe-cd69-423f-97a5-cf34fa509ff6 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:05.654668 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50498053-f7d0-475f-b11b-13592a5d388d None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:05.678680 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86f1d8-d910-432d-9553-554322e0a26c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:05.679472 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86f1d8-d910-432d-9553-554322e0a26c None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:05.679712 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86f1d8-d910-432d-9553-554322e0a26c None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:05.680093 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e86f1d8-d910-432d-9553-554322e0a26c None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:05.681104 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86f1d8-d910-432d-9553-554322e0a26c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:05.681347 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86f1d8-d910-432d-9553-554322e0a26c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:05.682818 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e86f1d8-d910-432d-9553-554322e0a26c None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:05.700172 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 353/707] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:05.700172 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86f1d8-d910-432d-9553-554322e0a26c None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:05.710792 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165692ac-5530-41ac-b4fb-ef6fa6840582 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:05.712439 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165692ac-5530-41ac-b4fb-ef6fa6840582 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:05.712917 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165692ac-5530-41ac-b4fb-ef6fa6840582 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:05.713610 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165692ac-5530-41ac-b4fb-ef6fa6840582 None admin] PATH_INFO: `/v3/services` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:05.714447 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165692ac-5530-41ac-b4fb-ef6fa6840582 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:05.714908 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165692ac-5530-41ac-b4fb-ef6fa6840582 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:05.717180 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165692ac-5530-41ac-b4fb-ef6fa6840582 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:05.727096 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 355/708] 10.222.0.15 () {56 vars in 1124 bytes} [Fri Aug 5 02:08:05 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:05.728232 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165692ac-5530-41ac-b4fb-ef6fa6840582 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:05.816491 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:05.878726 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165692ac-5530-41ac-b4fb-ef6fa6840582 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:05.921579 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a59ea-c694-40ef-afbb-176da961ac19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:05.922837 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a59ea-c694-40ef-afbb-176da961ac19 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:05.923269 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a59ea-c694-40ef-afbb-176da961ac19 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:05.923702 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646a59ea-c694-40ef-afbb-176da961ac19 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:05.929648 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:05.933499 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e86f1d8-d910-432d-9553-554322e0a26c None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:05.933959 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646a59ea-c694-40ef-afbb-176da961ac19 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:05.935448 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646a59ea-c694-40ef-afbb-176da961ac19 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:05.953276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-646a59ea-c694-40ef-afbb-176da961ac19 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:08:05.953276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:05.953276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:05.953276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:05.953276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:05.953276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:05.953276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:05.953276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:05.953276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:05.953276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:05.953276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:05.953276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:05.953276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:08:05.953276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:08:05.953276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:08:05.954217 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:08:05.954217 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:05.954217 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:05.954217 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:05.954217 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:05.954217 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:05.954217 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:05.954217 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:05.954217 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:05.954217 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:05.954217 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:05.954217 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:05.954217 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:05.954217 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:05.954217 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:05.954217 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:05.954217 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:05.955124 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:08:05.955124 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:08:05.955124 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:08:05.955124 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:08:05.955124 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:08:05.955124 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:08:05.955124 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:08:05.955124 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:05.960474 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 356/709] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:08:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:05.962083 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a59ea-c694-40ef-afbb-176da961ac19 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:05.982629 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5b508-f164-4f5e-8e29-7ae00cf036e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:05.983717 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5b508-f164-4f5e-8e29-7ae00cf036e5 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:05.984219 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5b508-f164-4f5e-8e29-7ae00cf036e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:05.984745 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a5b508-f164-4f5e-8e29-7ae00cf036e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:05.998849 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a5b508-f164-4f5e-8e29-7ae00cf036e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:06.000863 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a5b508-f164-4f5e-8e29-7ae00cf036e5 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:06.018515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-84a5b508-f164-4f5e-8e29-7ae00cf036e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:06.018515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:06.018515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:06.018515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:06.018515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:06.018515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:06.018515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:06.018515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:06.018515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:06.018515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:06.018515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:06.018515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:06.018515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:08:06.018515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:08:06.018515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:08:06.019487 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:08:06.019487 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:06.019487 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:06.019487 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:06.019487 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:06.019487 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:06.019487 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:06.019487 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:06.019487 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:06.019487 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:06.019487 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:06.019487 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:06.019487 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:06.019487 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:06.019487 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:06.019487 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:06.019487 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:06.020484 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:08:06.020484 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:08:06.020484 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:06.020484 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:06.023659 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 354/710] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:06.029026 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5b508-f164-4f5e-8e29-7ae00cf036e5 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:06.090196 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646a59ea-c694-40ef-afbb-176da961ac19 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:06.121428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:06.136421 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c406f1c-8c36-454f-8f4f-682915f6e425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:06.137507 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c406f1c-8c36-454f-8f4f-682915f6e425 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:06.137809 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c406f1c-8c36-454f-8f4f-682915f6e425 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:06.138082 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c406f1c-8c36-454f-8f4f-682915f6e425 None admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:06.139273 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c406f1c-8c36-454f-8f4f-682915f6e425 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:06.139871 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c406f1c-8c36-454f-8f4f-682915f6e425 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:06.141894 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c406f1c-8c36-454f-8f4f-682915f6e425 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:06.160594 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 357/711] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Aug 5 02:08:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:06.162235 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0bf43-d3a7-43c3-8c7a-47fa8064e7b8 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:06.163022 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0bf43-d3a7-43c3-8c7a-47fa8064e7b8 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:06.163298 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffb0bf43-d3a7-43c3-8c7a-47fa8064e7b8 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:06.164140 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a5b508-f164-4f5e-8e29-7ae00cf036e5 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:06.164799 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 358/712] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:08:06.169407 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0bf43-d3a7-43c3-8c7a-47fa8064e7b8 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:06.209037 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85f86a33-12f1-4531-bbda-ec07e2dfc21d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:06.210635 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f86a33-12f1-4531-bbda-ec07e2dfc21d None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:06.210977 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f86a33-12f1-4531-bbda-ec07e2dfc21d None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:06.211315 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85f86a33-12f1-4531-bbda-ec07e2dfc21d None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:06.212078 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f86a33-12f1-4531-bbda-ec07e2dfc21d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:06.212468 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f86a33-12f1-4531-bbda-ec07e2dfc21d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:06.213894 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85f86a33-12f1-4531-bbda-ec07e2dfc21d None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:06.227220 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 355/713] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:06.228774 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fced370-4965-4502-875d-12d62b62b446 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:06.229127 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fced370-4965-4502-875d-12d62b62b446 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:06.229465 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fced370-4965-4502-875d-12d62b62b446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:06.249950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-1fced370-4965-4502-875d-12d62b62b446 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:06.251217 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-1fced370-4965-4502-875d-12d62b62b446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:06.254259 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:06.286321 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffb0bf43-d3a7-43c3-8c7a-47fa8064e7b8 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:06.329856 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc164fef-b3c1-49fe-adae-e455649fa180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:06.330465 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc164fef-b3c1-49fe-adae-e455649fa180 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:06.330743 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc164fef-b3c1-49fe-adae-e455649fa180 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:06.331010 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc164fef-b3c1-49fe-adae-e455649fa180 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:06.331783 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc164fef-b3c1-49fe-adae-e455649fa180 None admin] RBAC: Adding query filter params (role.id=e1b75d5eea2a43b2b1b14cf0515350fa, scope.project.id=95d88dece7184bf1842c4f8d275d52cd, user.id=4b5c0958604b436daa44b1f67c9dec26) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:06.332088 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc164fef-b3c1-49fe-adae-e455649fa180 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:06.333527 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc164fef-b3c1-49fe-adae-e455649fa180 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:06.339833 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 359/714] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:08:06 2022] GET /identity/v3/role_assignments?user.id=4b5c0958604b436daa44b1f67c9dec26&scope.project.id=95d88dece7184bf1842c4f8d275d52cd&role.id=e1b75d5eea2a43b2b1b14cf0515350fa => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:06.340776 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc164fef-b3c1-49fe-adae-e455649fa180 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:06.341436 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 356/715] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:08:06.364303 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fced370-4965-4502-875d-12d62b62b446 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:06.453975 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:06.488244 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fced370-4965-4502-875d-12d62b62b446 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:06.542727 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0c4da-f803-4c64-917b-1985fe68efc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:06.542727 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0c4da-f803-4c64-917b-1985fe68efc3 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:06.542727 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0c4da-f803-4c64-917b-1985fe68efc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:06.543123 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c0c4da-f803-4c64-917b-1985fe68efc3 None admin] PATH_INFO: `/v3/services/network` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:06.545044 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0c4da-f803-4c64-917b-1985fe68efc3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:06.545650 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c0c4da-f803-4c64-917b-1985fe68efc3 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:06.553363 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc164fef-b3c1-49fe-adae-e455649fa180 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:06.564701 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-80c0c4da-f803-4c64-917b-1985fe68efc3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 02:08:06.564701 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:06.564701 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:08:06.564701 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:08:06.564701 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:08:06.564701 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:08:06.564701 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:08:06.564701 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:08:06.564701 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 02:08:06.564701 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:06.564701 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:08:06.564701 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:06.564701 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:06.564701 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:06.564701 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:06.564701 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:06.564701 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:06.565942 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:06.565942 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:06.565942 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:06.565942 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:06.565942 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:06.565942 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:06.565942 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:08:06.565942 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:08:06.565942 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:08:06.565942 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:08:06.565942 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:06.565942 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:06.565942 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:06.565942 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:06.565942 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:06.565942 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:06.566818 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:06.566818 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:06.566818 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:06.566818 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:06.566818 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:06.566818 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:06.566818 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:06.566818 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:06.566818 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:06.566818 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:06.566818 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:08:06.566818 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:08:06.566818 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 02:08:06.566818 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:06.575203 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 357/716] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:08:06 2022] GET /identity/v3/services/network => generated 88 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:08:06.576866 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0c4da-f803-4c64-917b-1985fe68efc3 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:06.586906 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:06.619914 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce5479-2055-4120-8d33-b4f80013bb8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:06.620715 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce5479-2055-4120-8d33-b4f80013bb8e None admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:06.621097 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce5479-2055-4120-8d33-b4f80013bb8e None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:06.621470 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffce5479-2055-4120-8d33-b4f80013bb8e None admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:06.622312 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce5479-2055-4120-8d33-b4f80013bb8e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:06.623838 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffce5479-2055-4120-8d33-b4f80013bb8e None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:06.664228 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 360/717] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Aug 5 02:08:06 2022] POST /identity/v3/users => generated 254 bytes in 324 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:08:06.760803 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c0c4da-f803-4c64-917b-1985fe68efc3 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:06.814509 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2427604-3207-44f9-a030-ed06dc28b89a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:06.815280 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2427604-3207-44f9-a030-ed06dc28b89a None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:06.815663 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2427604-3207-44f9-a030-ed06dc28b89a None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:06.816037 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2427604-3207-44f9-a030-ed06dc28b89a None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:06.816856 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2427604-3207-44f9-a030-ed06dc28b89a None admin] RBAC: Adding query filter params (name=network) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:06.817259 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2427604-3207-44f9-a030-ed06dc28b89a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:06.818777 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2427604-3207-44f9-a030-ed06dc28b89a None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:06.830417 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 358/718] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Aug 5 02:08:06 2022] GET /identity/v3/services?name=network => generated 124 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:06.844193 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce5479-2055-4120-8d33-b4f80013bb8e None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:06.953523 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffce5479-2055-4120-8d33-b4f80013bb8e None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:06.957151 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:06.992929 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0adb103d-88a2-498e-9fe4-af6b5585ea4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:06.993576 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb103d-88a2-498e-9fe4-af6b5585ea4f None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:06.993857 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb103d-88a2-498e-9fe4-af6b5585ea4f None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:06.994133 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0adb103d-88a2-498e-9fe4-af6b5585ea4f None admin] PATH_INFO: `/v3/services` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:06.994814 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb103d-88a2-498e-9fe4-af6b5585ea4f None admin] RBAC: Adding query filter params (type=network) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:06.995118 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb103d-88a2-498e-9fe4-af6b5585ea4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:06.996516 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0adb103d-88a2-498e-9fe4-af6b5585ea4f None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:07.007269 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 361/719] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Aug 5 02:08:06 2022] GET /identity/v3/services?type=network => generated 124 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:07.516745 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2af50b-1dd3-4bd1-bd24-0050f644b0ab None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:07.517655 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2af50b-1dd3-4bd1-bd24-0050f644b0ab None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:07.518101 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b2af50b-1dd3-4bd1-bd24-0050f644b0ab None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:07.520252 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 359/720] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:08:07.526059 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742f7f7-f77e-4e3f-816b-144ffdd8c15c None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:07.526537 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742f7f7-f77e-4e3f-816b-144ffdd8c15c None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:07.526990 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c742f7f7-f77e-4e3f-816b-144ffdd8c15c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:07.547926 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-c742f7f7-f77e-4e3f-816b-144ffdd8c15c None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:07.549370 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-c742f7f7-f77e-4e3f-816b-144ffdd8c15c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:07.638170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 362/721] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:08:07.664119 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2af50b-1dd3-4bd1-bd24-0050f644b0ab None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:07.784930 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:07.848573 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b2af50b-1dd3-4bd1-bd24-0050f644b0ab None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:07.896101 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26689e8f-3b91-4e16-a5d2-9fbc00d30356 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:07.897370 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26689e8f-3b91-4e16-a5d2-9fbc00d30356 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:07.897655 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26689e8f-3b91-4e16-a5d2-9fbc00d30356 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:07.897913 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26689e8f-3b91-4e16-a5d2-9fbc00d30356 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:07.914333 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26689e8f-3b91-4e16-a5d2-9fbc00d30356 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:08:07.919773 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-26689e8f-3b91-4e16-a5d2-9fbc00d30356 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:08:07.919773 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:07.919773 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:07.919773 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:07.919773 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:07.919773 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:07.919773 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:07.919773 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:07.919773 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:07.919773 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:07.919773 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:07.919773 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:07.919773 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:08:07.919773 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:08:07.919773 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:08:07.919773 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:08:07.920744 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:08:07.920744 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:08:07.920744 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:08:07.920744 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:08:07.920744 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:07.920744 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:07.920744 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:07.920744 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:07.920744 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:07.920744 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:07.920744 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:07.920744 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:07.920744 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:07.920744 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:07.920744 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:07.920744 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:07.921988 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:07.921988 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:07.921988 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:07.921988 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:07.921988 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:08:07.921988 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:08:07.921988 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:08:07.921988 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:08:07.921988 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:08:07.921988 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:08:07.921988 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:08:07.921988 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:07.921988 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 360/722] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Aug 5 02:08:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:07.929452 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742f7f7-f77e-4e3f-816b-144ffdd8c15c None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:08.044175 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:08.051851 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c742f7f7-f77e-4e3f-816b-144ffdd8c15c None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:08.093794 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed42a8-7390-4dd3-ac02-213a7b8d865b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:08.094414 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed42a8-7390-4dd3-ac02-213a7b8d865b None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:08.094697 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed42a8-7390-4dd3-ac02-213a7b8d865b None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:08.094971 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ed42a8-7390-4dd3-ac02-213a7b8d865b None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:08.095745 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ed42a8-7390-4dd3-ac02-213a7b8d865b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:08.096306 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ed42a8-7390-4dd3-ac02-213a7b8d865b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:08.097750 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ed42a8-7390-4dd3-ac02-213a7b8d865b None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:08.106331 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 363/723] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:08:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:08.111525 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26689e8f-3b91-4e16-a5d2-9fbc00d30356 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:08.269356 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26689e8f-3b91-4e16-a5d2-9fbc00d30356 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:08.307441 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:08.319396 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-367388e8-69f7-4938-baed-00a6459605c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:08.320191 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367388e8-69f7-4938-baed-00a6459605c1 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:08.320515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367388e8-69f7-4938-baed-00a6459605c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:08.320782 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-367388e8-69f7-4938-baed-00a6459605c1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:08.334584 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367388e8-69f7-4938-baed-00a6459605c1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:08.336030 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-367388e8-69f7-4938-baed-00a6459605c1 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:08.354860 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-367388e8-69f7-4938-baed-00a6459605c1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:08.354860 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:08.354860 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:08.354860 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:08.354860 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:08.354860 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:08.354860 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:08.354860 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:08.354860 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:08.354860 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:08.354860 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:08.354860 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:08.354860 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:08:08.354860 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:08:08.354860 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:08:08.355806 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:08:08.355806 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:08.355806 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:08.355806 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:08.355806 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:08.355806 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:08.355806 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:08.355806 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:08.355806 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:08.355806 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:08.355806 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:08.355806 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:08.355806 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:08.355806 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:08.355806 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:08.355806 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:08.355806 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:08.357483 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:08:08.357483 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:08:08.357483 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:08.357483 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:08.357483 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 361/724] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:08.365960 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed42a8-7390-4dd3-ac02-213a7b8d865b None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:08.367768 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afaf1c2-039b-4e58-8632-aaec86a2de58 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:08.368053 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afaf1c2-039b-4e58-8632-aaec86a2de58 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:08.368344 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afaf1c2-039b-4e58-8632-aaec86a2de58 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:08.369938 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 362/725] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:08:08.374856 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcc1b9-51bc-45a5-9f94-c522b3139a56 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:08.375134 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcc1b9-51bc-45a5-9f94-c522b3139a56 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:08.375405 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79dcc1b9-51bc-45a5-9f94-c522b3139a56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:08.413598 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-79dcc1b9-51bc-45a5-9f94-c522b3139a56 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:08.414912 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-79dcc1b9-51bc-45a5-9f94-c522b3139a56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:08.494466 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ed42a8-7390-4dd3-ac02-213a7b8d865b None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:08.559423 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 363/726] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 05 02:08:08.561791 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3302b5-f0de-4312-8579-405e5d6ac161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:08.562414 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3302b5-f0de-4312-8579-405e5d6ac161 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:08.562698 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3302b5-f0de-4312-8579-405e5d6ac161 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:08.562974 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c3302b5-f0de-4312-8579-405e5d6ac161 None admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:08.563670 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3302b5-f0de-4312-8579-405e5d6ac161 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:08.563973 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3302b5-f0de-4312-8579-405e5d6ac161 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:08.565365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c3302b5-f0de-4312-8579-405e5d6ac161 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:08.578699 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 364/727] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:08:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:08.584358 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dcc1b9-51bc-45a5-9f94-c522b3139a56 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:08.601430 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3302b5-f0de-4312-8579-405e5d6ac161 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:08.623681 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:08.708252 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c3302b5-f0de-4312-8579-405e5d6ac161 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:08.746684 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070a70a-0352-4b0d-8701-ad596507ab67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:08.747315 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070a70a-0352-4b0d-8701-ad596507ab67 None admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:08.747592 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070a70a-0352-4b0d-8701-ad596507ab67 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:08.747865 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e070a70a-0352-4b0d-8701-ad596507ab67 None admin] PATH_INFO: `/v3/services` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:08.748928 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070a70a-0352-4b0d-8701-ad596507ab67 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:08.750560 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e070a70a-0352-4b0d-8701-ad596507ab67 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:08.758157 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79dcc1b9-51bc-45a5-9f94-c522b3139a56 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:08.773348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:08.780349 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 365/728] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Aug 5 02:08:08 2022] POST /identity/v3/services => generated 251 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:08:08.854358 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a63eddb-2b48-4a4d-86b9-8b7ca356d3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:08.855535 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63eddb-2b48-4a4d-86b9-8b7ca356d3f3 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:08.856063 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63eddb-2b48-4a4d-86b9-8b7ca356d3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:08.856570 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a63eddb-2b48-4a4d-86b9-8b7ca356d3f3 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:08.872164 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63eddb-2b48-4a4d-86b9-8b7ca356d3f3 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:08.874010 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a63eddb-2b48-4a4d-86b9-8b7ca356d3f3 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:08.890035 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-8a63eddb-2b48-4a4d-86b9-8b7ca356d3f3 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 05 02:08:08.890035 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:08.890035 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:08.890035 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:08.890035 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:08.890035 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:08.890035 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:08.890035 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:08.890035 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:08.890035 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:08.890035 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:08.890035 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:08.890035 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:08:08.890035 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:08:08.890035 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:08:08.890035 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:08:08.891083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:08.891083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:08.891083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:08:08.891083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:08:08.891083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:08:08.891083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:08:08.891083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:08.891083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:08.891083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:08.891083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:08.891083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:08.891083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:08.891083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:08.891083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:08.891083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:08.891083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:08.891083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:08.891083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:08.892032 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:08.892032 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:08.892032 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:08:08.892032 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:08:08.892032 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:08:08.892032 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:08:08.892032 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:08:08.892032 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:08:08.892032 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 05 02:08:08.892032 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:08.894350 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 364/729] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Aug 5 02:08:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:08.900380 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070a70a-0352-4b0d-8701-ad596507ab67 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:09.005444 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b600e0e-5ca5-4ae3-b3b5-27ee439d73db None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:09.006078 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b600e0e-5ca5-4ae3-b3b5-27ee439d73db None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:09.006551 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b600e0e-5ca5-4ae3-b3b5-27ee439d73db None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:09.008696 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 365/730] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:08:09.013634 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df2b83-7afe-484e-bb45-5d11d21eef79 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:09.014184 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df2b83-7afe-484e-bb45-5d11d21eef79 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:09.014657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23df2b83-7afe-484e-bb45-5d11d21eef79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:09.028816 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:09.045862 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-23df2b83-7afe-484e-bb45-5d11d21eef79 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:09.047338 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-23df2b83-7afe-484e-bb45-5d11d21eef79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:09.055073 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e070a70a-0352-4b0d-8701-ad596507ab67 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:09.094024 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e6aec-5c6e-41a1-86d9-2bd6788cb8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:09.094694 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e6aec-5c6e-41a1-86d9-2bd6788cb8f0 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:09.095088 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e6aec-5c6e-41a1-86d9-2bd6788cb8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:09.095431 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199e6aec-5c6e-41a1-86d9-2bd6788cb8f0 None admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:09.097205 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e6aec-5c6e-41a1-86d9-2bd6788cb8f0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:09.097524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e6aec-5c6e-41a1-86d9-2bd6788cb8f0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:09.098951 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199e6aec-5c6e-41a1-86d9-2bd6788cb8f0 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:09.119239 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 366/731] 10.222.0.15 () {56 vars in 1135 bytes} [Fri Aug 5 02:08:08 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:09.128556 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e6aec-5c6e-41a1-86d9-2bd6788cb8f0 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:09.140704 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 366/732] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:09 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:08:09.164118 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df2b83-7afe-484e-bb45-5d11d21eef79 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:09.244722 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199e6aec-5c6e-41a1-86d9-2bd6788cb8f0 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:09.265708 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:09.273197 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23df2b83-7afe-484e-bb45-5d11d21eef79 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:09.285389 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb6a66-ea43-446a-8f0e-4943924ce097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:09.286103 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb6a66-ea43-446a-8f0e-4943924ce097 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:09.286385 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb6a66-ea43-446a-8f0e-4943924ce097 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:09.286654 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfb6a66-ea43-446a-8f0e-4943924ce097 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:09.295854 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:09.310952 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1dbde-a02a-4b34-a0e3-41e88e827b55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:09.311604 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1dbde-a02a-4b34-a0e3-41e88e827b55 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:09.311882 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1dbde-a02a-4b34-a0e3-41e88e827b55 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:09.312482 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b1dbde-a02a-4b34-a0e3-41e88e827b55 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:09.323669 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b1dbde-a02a-4b34-a0e3-41e88e827b55 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:08:09.328594 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-c9b1dbde-a02a-4b34-a0e3-41e88e827b55 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:08:09.328594 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:09.328594 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:09.328594 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:09.328594 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:09.328594 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:09.328594 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:09.328594 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:09.328594 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:09.328594 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:09.328594 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:09.328594 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:09.328594 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:08:09.328594 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:08:09.328594 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:08:09.328594 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:08:09.329683 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:08:09.329683 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:08:09.329683 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:08:09.329683 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:08:09.329683 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:09.329683 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:09.329683 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:09.329683 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:09.329683 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:09.329683 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:09.329683 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:09.329683 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:09.329683 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:09.329683 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:09.329683 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:09.329683 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:09.330792 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:09.330792 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:09.330792 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:09.330792 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:09.330792 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:08:09.330792 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:08:09.330792 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:08:09.330792 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:08:09.330792 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:08:09.330792 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:08:09.330792 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:08:09.330792 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:09.330792 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 367/733] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Aug 5 02:08:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:08:09.341320 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1dbde-a02a-4b34-a0e3-41e88e827b55 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:09.370069 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb6a66-ea43-446a-8f0e-4943924ce097 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:09.371907 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfb6a66-ea43-446a-8f0e-4943924ce097 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:09.455103 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b1dbde-a02a-4b34-a0e3-41e88e827b55 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:09.490921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02402489-c10e-43fa-8bcd-8a59438167f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:09.491347 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 367/734] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:08:09 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 05 02:08:09.491561 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02402489-c10e-43fa-8bcd-8a59438167f7 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:09.491797 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02402489-c10e-43fa-8bcd-8a59438167f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:09.492069 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02402489-c10e-43fa-8bcd-8a59438167f7 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:09.493137 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02402489-c10e-43fa-8bcd-8a59438167f7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:09.493445 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02402489-c10e-43fa-8bcd-8a59438167f7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:09.494307 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb6a66-ea43-446a-8f0e-4943924ce097 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:09.494811 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02402489-c10e-43fa-8bcd-8a59438167f7 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:09.503779 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 368/735] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:08:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:09.509329 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02402489-c10e-43fa-8bcd-8a59438167f7 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:09.530133 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:09.543405 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:09.611991 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfb6a66-ea43-446a-8f0e-4943924ce097 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:09.616822 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02402489-c10e-43fa-8bcd-8a59438167f7 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:09.652046 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ee642a-1fcd-4452-ae75-22f2c94af6ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:09.652236 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-170181b7-e2af-4685-a6a8-872414643bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:09.652889 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170181b7-e2af-4685-a6a8-872414643bc0 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:09.653245 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170181b7-e2af-4685-a6a8-872414643bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:09.653526 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-170181b7-e2af-4685-a6a8-872414643bc0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:09.653952 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee642a-1fcd-4452-ae75-22f2c94af6ba None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:09.654420 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee642a-1fcd-4452-ae75-22f2c94af6ba None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:09.654880 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ee642a-1fcd-4452-ae75-22f2c94af6ba None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:09.665145 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170181b7-e2af-4685-a6a8-872414643bc0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:09.666586 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-170181b7-e2af-4685-a6a8-872414643bc0 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:09.666927 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee642a-1fcd-4452-ae75-22f2c94af6ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:09.668734 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ee642a-1fcd-4452-ae75-22f2c94af6ba None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:09.682557 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-170181b7-e2af-4685-a6a8-872414643bc0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:09.682557 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:09.682557 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:09.682557 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:09.682557 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:09.682557 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:09.682557 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:09.682557 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:09.682557 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:09.682557 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:09.682557 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:09.682557 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:09.682557 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:08:09.682557 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:08:09.682557 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:08:09.683626 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:08:09.683626 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:09.683626 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:09.683626 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:09.683626 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:09.683626 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:09.683626 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:09.683626 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:09.683626 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:09.683626 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:09.683626 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:09.683626 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:09.683626 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:09.683626 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:09.683626 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:09.683626 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:09.683626 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:09.684538 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:08:09.684538 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:08:09.684538 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:09.684538 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:09.686242 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-32ee642a-1fcd-4452-ae75-22f2c94af6ba None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:09.686242 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:09.686242 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:09.686242 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:09.686242 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:09.686242 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:09.686242 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:09.686242 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:09.686242 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:09.686242 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:09.686242 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:09.686242 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:09.686242 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:08:09.686242 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:08:09.686242 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:08:09.687057 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:08:09.687057 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:09.687057 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:09.687057 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:09.687057 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:09.687057 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:09.687057 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:09.687057 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:09.687057 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:09.687057 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:09.687057 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:09.687057 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:09.687057 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:09.687057 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:09.687057 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:09.687057 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:09.687057 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:09.693042 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:08:09.693042 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:08:09.693042 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:09.693042 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:09.693042 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 368/736] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:08:09.693762 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 369/737] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:09.693919 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf1997-e2e4-4f71-a4ad-44baa6217ac2 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:09.693919 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf1997-e2e4-4f71-a4ad-44baa6217ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:09.693919 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccf1997-e2e4-4f71-a4ad-44baa6217ac2 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:09.695134 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b1f26-f3d3-4687-84fb-3f7d581ad627 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:09.695134 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b1f26-f3d3-4687-84fb-3f7d581ad627 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:09.695134 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9b1f26-f3d3-4687-84fb-3f7d581ad627 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:09.695682 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 369/738] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:09 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:08:09.695831 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 370/739] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:08:09.696183 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccf1997-e2e4-4f71-a4ad-44baa6217ac2 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:09.698376 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58416730-95cb-4049-bd2e-edd742f02c66 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:09.698376 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58416730-95cb-4049-bd2e-edd742f02c66 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:09.698376 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58416730-95cb-4049-bd2e-edd742f02c66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:09.716350 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-58416730-95cb-4049-bd2e-edd742f02c66 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:09.717546 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-58416730-95cb-4049-bd2e-edd742f02c66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:09.785659 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:09.792254 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:09.800815 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 371/740] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:09 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:08:09.801935 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58416730-95cb-4049-bd2e-edd742f02c66 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:09.811345 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccf1997-e2e4-4f71-a4ad-44baa6217ac2 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:09.855184 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed67e9e6-dcd3-4256-b85a-4f236eec3d13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:09.856295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67e9e6-dcd3-4256-b85a-4f236eec3d13 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:09.856614 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67e9e6-dcd3-4256-b85a-4f236eec3d13 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:09.856889 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed67e9e6-dcd3-4256-b85a-4f236eec3d13 None admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:09.857897 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67e9e6-dcd3-4256-b85a-4f236eec3d13 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:09.858202 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67e9e6-dcd3-4256-b85a-4f236eec3d13 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:09.859572 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed67e9e6-dcd3-4256-b85a-4f236eec3d13 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:09.871746 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 370/741] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:09.873045 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480f36d-dabd-4a0a-9830-e53ee1b7aeee None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:09.873333 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480f36d-dabd-4a0a-9830-e53ee1b7aeee None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:09.873604 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5480f36d-dabd-4a0a-9830-e53ee1b7aeee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:09.891054 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-5480f36d-dabd-4a0a-9830-e53ee1b7aeee None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:09.892369 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-5480f36d-dabd-4a0a-9830-e53ee1b7aeee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:09.930574 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58416730-95cb-4049-bd2e-edd742f02c66 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:09.966566 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 371/742] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:09 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 05 02:08:09.967408 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480f36d-dabd-4a0a-9830-e53ee1b7aeee None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:09.973076 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0029fd5-302b-489f-82e8-63577e1765e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:09.973965 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0029fd5-302b-489f-82e8-63577e1765e0 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:09.974462 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0029fd5-302b-489f-82e8-63577e1765e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:09.974939 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0029fd5-302b-489f-82e8-63577e1765e0 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:09.975846 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0029fd5-302b-489f-82e8-63577e1765e0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:09.976408 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0029fd5-302b-489f-82e8-63577e1765e0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:09.978033 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0029fd5-302b-489f-82e8-63577e1765e0 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:09.990610 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 372/743] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:09.991849 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0029fd5-302b-489f-82e8-63577e1765e0 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:10.055536 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:10.062071 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:10.083094 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5480f36d-dabd-4a0a-9830-e53ee1b7aeee None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:10.101462 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0029fd5-302b-489f-82e8-63577e1765e0 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:10.126546 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4030e70-c232-4483-860a-846a8e4d1623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:10.127252 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4030e70-c232-4483-860a-846a8e4d1623 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:10.127565 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4030e70-c232-4483-860a-846a8e4d1623 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:10.127829 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4030e70-c232-4483-860a-846a8e4d1623 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:10.136784 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00984f-124e-4bf4-98be-4caf2e47adba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:10.137429 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00984f-124e-4bf4-98be-4caf2e47adba None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:10.137717 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00984f-124e-4bf4-98be-4caf2e47adba None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:10.137991 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00984f-124e-4bf4-98be-4caf2e47adba None admin] PATH_INFO: `/v3/users/nova` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:10.138701 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4030e70-c232-4483-860a-846a8e4d1623 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:08:10.143788 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-d4030e70-c232-4483-860a-846a8e4d1623 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:08:10.143788 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:10.143788 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:10.143788 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:10.143788 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:10.143788 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:10.143788 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:10.143788 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:10.143788 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:10.143788 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:10.143788 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:10.143788 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:10.143788 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:08:10.143788 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:08:10.143788 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:08:10.143788 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:08:10.144726 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:08:10.144726 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:08:10.144726 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:08:10.144726 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:08:10.144726 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:10.144726 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:10.144726 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:10.144726 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:10.144726 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:10.144726 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:10.144726 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:10.144726 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:10.144726 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:10.144726 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:10.144726 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:10.144726 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:10.145588 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:10.145588 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:10.145588 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:10.145588 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:10.145588 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:08:10.145588 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:08:10.145588 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:08:10.145588 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:08:10.145588 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:08:10.145588 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:08:10.145588 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:08:10.145588 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:10.145588 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 372/744] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Aug 5 02:08:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:10.147043 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4030e70-c232-4483-860a-846a8e4d1623 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:10.150137 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e00984f-124e-4bf4-98be-4caf2e47adba None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:10.152110 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e00984f-124e-4bf4-98be-4caf2e47adba None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:10.165200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-2e00984f-124e-4bf4-98be-4caf2e47adba None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 02:08:10.165200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:10.165200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:10.165200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:10.165200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:10.165200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:10.165200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:10.165200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:10.165200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:10.165200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:10.165200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:10.165200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:10.165200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:08:10.165200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:08:10.165200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:08:10.165200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:08:10.166166 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:10.166166 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:10.166166 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:08:10.166166 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:08:10.166166 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:08:10.166166 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:08:10.166166 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:10.166166 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:10.166166 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:10.166166 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:10.166166 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:10.166166 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:10.166166 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:10.166166 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:10.166166 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:10.166166 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:10.166166 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:10.166166 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:10.167087 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:10.167087 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:10.167087 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:08:10.167087 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:08:10.167087 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:08:10.167087 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:08:10.167087 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:08:10.167087 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:08:10.167087 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 02:08:10.167087 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:10.167087 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 373/745] 10.222.0.15 () {56 vars in 1093 bytes} [Fri Aug 5 02:08:09 2022] GET /identity/v3/users/nova => generated 82 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:10.167674 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00984f-124e-4bf4-98be-4caf2e47adba None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:10.263736 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4030e70-c232-4483-860a-846a8e4d1623 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:10.305289 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031cea2c-9b13-4eee-9046-2b28fab949cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:10.305937 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031cea2c-9b13-4eee-9046-2b28fab949cd None admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:10.306218 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031cea2c-9b13-4eee-9046-2b28fab949cd None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:10.306489 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031cea2c-9b13-4eee-9046-2b28fab949cd None admin] PATH_INFO: `/v3/services` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:10.307200 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031cea2c-9b13-4eee-9046-2b28fab949cd None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:10.308640 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-031cea2c-9b13-4eee-9046-2b28fab949cd None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:10.321738 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:10.328092 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 373/746] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Aug 5 02:08:10 2022] POST /identity/v3/services => generated 240 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:08:10.337050 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031cea2c-9b13-4eee-9046-2b28fab949cd None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:10.406859 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00984f-124e-4bf4-98be-4caf2e47adba None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:10.430725 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:10.453753 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea335575-1da1-415c-ab5f-8874bdcbbf21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:10.454669 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea335575-1da1-415c-ab5f-8874bdcbbf21 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:10.455116 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea335575-1da1-415c-ab5f-8874bdcbbf21 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:10.455485 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea335575-1da1-415c-ab5f-8874bdcbbf21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:10.463601 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea335575-1da1-415c-ab5f-8874bdcbbf21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:10.465337 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea335575-1da1-415c-ab5f-8874bdcbbf21 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:10.476932 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031cea2c-9b13-4eee-9046-2b28fab949cd None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:10.478739 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-ea335575-1da1-415c-ab5f-8874bdcbbf21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:08:10.478739 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:10.478739 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:10.478739 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:10.478739 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:10.478739 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:10.478739 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:10.478739 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:10.478739 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:10.478739 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:10.478739 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:10.478739 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:10.478739 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:08:10.478739 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:08:10.478739 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:08:10.479832 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:08:10.479832 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:10.479832 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:10.479832 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:10.479832 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:10.479832 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:10.479832 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:10.479832 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:10.479832 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:10.479832 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:10.479832 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:10.479832 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:10.479832 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:10.479832 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:10.479832 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:10.479832 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:10.479832 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:10.480798 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:08:10.480798 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:08:10.480798 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:08:10.480798 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:08:10.480798 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:08:10.480798 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:08:10.480798 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:08:10.480798 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:10.481375 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 374/747] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:08:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:10.482201 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea335575-1da1-415c-ab5f-8874bdcbbf21 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:10.540945 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c1980-75cc-411c-bcb7-fe9bf9be8239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:10.541498 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c1980-75cc-411c-bcb7-fe9bf9be8239 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:10.541795 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c1980-75cc-411c-bcb7-fe9bf9be8239 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:10.542061 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-139c1980-75cc-411c-bcb7-fe9bf9be8239 None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:10.542786 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c1980-75cc-411c-bcb7-fe9bf9be8239 None admin] RBAC: Adding query filter params (name=service) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:10.543091 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c1980-75cc-411c-bcb7-fe9bf9be8239 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:10.545105 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-139c1980-75cc-411c-bcb7-fe9bf9be8239 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:10.554518 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 374/748] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Aug 5 02:08:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:10.555791 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c1980-75cc-411c-bcb7-fe9bf9be8239 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:10.615471 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea335575-1da1-415c-ab5f-8874bdcbbf21 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:10.626863 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:10.659871 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09ae9a-1f23-4e82-9d35-018aa52dc9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:10.660590 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09ae9a-1f23-4e82-9d35-018aa52dc9b4 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:10.660854 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09ae9a-1f23-4e82-9d35-018aa52dc9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:10.661125 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c09ae9a-1f23-4e82-9d35-018aa52dc9b4 None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:10.663070 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c09ae9a-1f23-4e82-9d35-018aa52dc9b4 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:10.663364 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c09ae9a-1f23-4e82-9d35-018aa52dc9b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:10.664811 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c09ae9a-1f23-4e82-9d35-018aa52dc9b4 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:10.676582 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-139c1980-75cc-411c-bcb7-fe9bf9be8239 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:10.687968 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 375/749] 10.222.0.15 () {56 vars in 1133 bytes} [Fri Aug 5 02:08:10 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:10.689029 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09ae9a-1f23-4e82-9d35-018aa52dc9b4 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:10.727506 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4c5a0-78a6-453a-b87a-e9e6bdfc5d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:10.728147 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4c5a0-78a6-453a-b87a-e9e6bdfc5d29 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:10.728463 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4c5a0-78a6-453a-b87a-e9e6bdfc5d29 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:10.728899 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa4c5a0-78a6-453a-b87a-e9e6bdfc5d29 None admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:10.729983 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4c5a0-78a6-453a-b87a-e9e6bdfc5d29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:10.730571 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4c5a0-78a6-453a-b87a-e9e6bdfc5d29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:10.732027 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa4c5a0-78a6-453a-b87a-e9e6bdfc5d29 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:10.732772 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:10.748404 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 375/750] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Aug 5 02:08:10 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:10.749571 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4c5a0-78a6-453a-b87a-e9e6bdfc5d29 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:10.814248 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c09ae9a-1f23-4e82-9d35-018aa52dc9b4 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:10.862237 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce96b2c-6c80-4592-b6b4-69cefdafc082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:10.863127 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce96b2c-6c80-4592-b6b4-69cefdafc082 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:10.863585 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce96b2c-6c80-4592-b6b4-69cefdafc082 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:10.864048 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce96b2c-6c80-4592-b6b4-69cefdafc082 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:10.875763 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce96b2c-6c80-4592-b6b4-69cefdafc082 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:10.877424 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce96b2c-6c80-4592-b6b4-69cefdafc082 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:10.882761 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa4c5a0-78a6-453a-b87a-e9e6bdfc5d29 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:10.894527 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-2ce96b2c-6c80-4592-b6b4-69cefdafc082 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:10.894527 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:10.894527 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:10.894527 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:10.894527 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:10.894527 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:10.894527 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:10.894527 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:10.894527 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:10.894527 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:10.894527 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:10.894527 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:10.894527 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:08:10.894527 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:08:10.894527 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:08:10.895656 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:08:10.895656 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:10.895656 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:10.895656 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:10.895656 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:10.895656 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:10.895656 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:10.895656 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:10.895656 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:10.895656 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:10.895656 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:10.895656 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:10.895656 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:10.895656 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:10.895656 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:10.895656 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:10.895656 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:10.896920 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:08:10.896920 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:08:10.896920 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:10.896920 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:10.903404 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 376/751] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:10.904459 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce96b2c-6c80-4592-b6b4-69cefdafc082 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:10.908644 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:10.923224 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b324a2-8ed9-471a-a112-4de38fe42804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:10.923870 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b324a2-8ed9-471a-a112-4de38fe42804 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:10.924154 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b324a2-8ed9-471a-a112-4de38fe42804 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:10.924468 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b324a2-8ed9-471a-a112-4de38fe42804 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:10.938291 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b324a2-8ed9-471a-a112-4de38fe42804 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:10.940031 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b324a2-8ed9-471a-a112-4de38fe42804 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:10.960282 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-95b324a2-8ed9-471a-a112-4de38fe42804 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:10.960282 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:10.960282 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:10.960282 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:10.960282 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:10.960282 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:10.960282 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:10.960282 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:10.960282 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:10.960282 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:10.960282 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:10.960282 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:10.960282 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:08:10.960282 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:08:10.960282 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:08:10.961253 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:08:10.961253 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:10.961253 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:10.961253 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:10.961253 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:10.961253 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:10.961253 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:10.961253 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:10.961253 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:10.961253 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:10.961253 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:10.961253 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:10.961253 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:10.961253 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:10.961253 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:10.961253 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:10.961253 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:10.962721 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:08:10.962721 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:08:10.962721 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:10.962721 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:10.962721 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 376/752] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:10.962721 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b324a2-8ed9-471a-a112-4de38fe42804 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:11.031614 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:11.054667 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce96b2c-6c80-4592-b6b4-69cefdafc082 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:11.091231 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b324a2-8ed9-471a-a112-4de38fe42804 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:11.105293 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec857d9-0e71-471b-ac7a-7e2af219b198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:11.106534 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec857d9-0e71-471b-ac7a-7e2af219b198 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:11.107032 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec857d9-0e71-471b-ac7a-7e2af219b198 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:11.107764 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec857d9-0e71-471b-ac7a-7e2af219b198 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:11.109256 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec857d9-0e71-471b-ac7a-7e2af219b198 None admin] RBAC: Adding query filter params (role.id=e1b75d5eea2a43b2b1b14cf0515350fa, scope.project.id=95d88dece7184bf1842c4f8d275d52cd, user.id=f03233b0ee3540cdb5105f6603cfdff5) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:11.110016 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec857d9-0e71-471b-ac7a-7e2af219b198 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:11.112291 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec857d9-0e71-471b-ac7a-7e2af219b198 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:11.122078 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 377/753] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:08:10 2022] GET /identity/v3/role_assignments?user.id=f03233b0ee3540cdb5105f6603cfdff5&scope.project.id=95d88dece7184bf1842c4f8d275d52cd&role.id=e1b75d5eea2a43b2b1b14cf0515350fa => generated 259 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:11.123389 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec857d9-0e71-471b-ac7a-7e2af219b198 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:11.153486 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b896d-58f0-45a6-b966-da9e75b9b61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:11.154775 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b896d-58f0-45a6-b966-da9e75b9b61d None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:11.156240 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b896d-58f0-45a6-b966-da9e75b9b61d None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:11.156957 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3b896d-58f0-45a6-b966-da9e75b9b61d None admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:11.159420 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b896d-58f0-45a6-b966-da9e75b9b61d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:11.159984 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b896d-58f0-45a6-b966-da9e75b9b61d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:11.161949 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3b896d-58f0-45a6-b966-da9e75b9b61d None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:11.192560 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 377/754] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:08:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:11.198441 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b896d-58f0-45a6-b966-da9e75b9b61d None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:11.263914 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:11.311206 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec857d9-0e71-471b-ac7a-7e2af219b198 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:11.348816 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6e0b19-4218-4b6f-89b0-727cd2056977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:11.349410 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e0b19-4218-4b6f-89b0-727cd2056977 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:11.350632 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e0b19-4218-4b6f-89b0-727cd2056977 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:11.350632 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6e0b19-4218-4b6f-89b0-727cd2056977 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:11.351256 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6e0b19-4218-4b6f-89b0-727cd2056977 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:11.351563 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6e0b19-4218-4b6f-89b0-727cd2056977 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:11.352993 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6e0b19-4218-4b6f-89b0-727cd2056977 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:11.358592 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3b896d-58f0-45a6-b966-da9e75b9b61d None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:11.365306 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 378/755] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:08:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:11.366644 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42a1ee-0e45-4bc1-883c-a43d847ee02d None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:11.366931 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42a1ee-0e45-4bc1-883c-a43d847ee02d None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:11.367207 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c42a1ee-0e45-4bc1-883c-a43d847ee02d None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:11.368757 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 379/756] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:08:11.381694 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80426c-9a04-48e5-8aa8-8051b43b2a5a None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:11.381978 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80426c-9a04-48e5-8aa8-8051b43b2a5a None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:11.382259 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f80426c-9a04-48e5-8aa8-8051b43b2a5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:11.403603 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bca49c-bfa5-44a8-ad58-612f5d1824e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:11.404685 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bca49c-bfa5-44a8-ad58-612f5d1824e3 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:11.405195 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bca49c-bfa5-44a8-ad58-612f5d1824e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:11.405676 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bca49c-bfa5-44a8-ad58-612f5d1824e3 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:11.407649 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-8f80426c-9a04-48e5-8aa8-8051b43b2a5a None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:11.409353 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-8f80426c-9a04-48e5-8aa8-8051b43b2a5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:11.412746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:11.416642 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bca49c-bfa5-44a8-ad58-612f5d1824e3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:11.418101 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bca49c-bfa5-44a8-ad58-612f5d1824e3 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:11.435633 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-20bca49c-bfa5-44a8-ad58-612f5d1824e3 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 02:08:11.435633 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:11.435633 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:11.435633 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:11.435633 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:11.435633 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:11.435633 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:11.435633 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:11.435633 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:11.435633 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:11.435633 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:11.435633 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:11.435633 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:08:11.435633 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:08:11.435633 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:08:11.435633 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:08:11.436719 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:11.436719 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:11.436719 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:08:11.436719 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:08:11.436719 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:08:11.436719 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:08:11.436719 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:11.436719 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:11.436719 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:11.436719 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:11.436719 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:11.436719 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:11.436719 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:11.436719 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:11.436719 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:11.436719 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:11.436719 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:11.436719 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:11.437663 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:11.437663 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:11.437663 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:08:11.437663 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:08:11.437663 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:08:11.437663 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:08:11.437663 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:08:11.437663 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:08:11.437663 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 02:08:11.437663 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:11.440178 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 378/757] 10.222.0.15 () {56 vars in 1117 bytes} [Fri Aug 5 02:08:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:11.440792 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bca49c-bfa5-44a8-ad58-612f5d1824e3 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:11.501443 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 380/758] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:11 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 02:08:11.502869 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80426c-9a04-48e5-8aa8-8051b43b2a5a None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:11.580620 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:11.588386 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bca49c-bfa5-44a8-ad58-612f5d1824e3 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:11.625861 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9368c-8e2c-4415-875a-1584eea80602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:11.626523 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9368c-8e2c-4415-875a-1584eea80602 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:11.626808 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9368c-8e2c-4415-875a-1584eea80602 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:11.627421 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f9368c-8e2c-4415-875a-1584eea80602 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:11.631003 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f80426c-9a04-48e5-8aa8-8051b43b2a5a None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:11.640446 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9368c-8e2c-4415-875a-1584eea80602 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:11.640446 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f9368c-8e2c-4415-875a-1584eea80602 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:11.653344 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-a8f9368c-8e2c-4415-875a-1584eea80602 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:08:11.653344 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:11.653344 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:11.653344 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:11.653344 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:11.653344 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:11.653344 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:11.653344 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:11.653344 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:11.653344 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:11.653344 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:11.653344 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:11.653344 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:08:11.653344 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:08:11.653344 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:08:11.654424 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:08:11.654424 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:11.654424 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:11.654424 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:11.654424 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:11.654424 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:11.654424 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:11.654424 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:11.654424 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:11.654424 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:11.654424 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:11.654424 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:11.654424 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:11.654424 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:11.654424 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:11.654424 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:11.654424 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:11.655457 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:08:11.655457 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:08:11.655457 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:08:11.655457 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:08:11.655457 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:08:11.655457 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:08:11.655457 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:08:11.655457 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:11.657748 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 379/759] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:08:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:11.658785 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9368c-8e2c-4415-875a-1584eea80602 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:11.675629 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432cd604-3682-45fe-8ff5-17c915c78d12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:11.676313 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cd604-3682-45fe-8ff5-17c915c78d12 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:11.676567 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cd604-3682-45fe-8ff5-17c915c78d12 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:11.676847 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-432cd604-3682-45fe-8ff5-17c915c78d12 None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:11.677994 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432cd604-3682-45fe-8ff5-17c915c78d12 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:11.678302 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432cd604-3682-45fe-8ff5-17c915c78d12 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:11.680590 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-432cd604-3682-45fe-8ff5-17c915c78d12 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:11.694136 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:11.712136 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 381/760] 10.222.0.15 () {56 vars in 1149 bytes} [Fri Aug 5 02:08:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:11.712136 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432cd604-3682-45fe-8ff5-17c915c78d12 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:11.783698 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f9368c-8e2c-4415-875a-1584eea80602 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:11.824679 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ccfa6-4308-4b72-ab31-39fb81ab452f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:11.825337 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ccfa6-4308-4b72-ab31-39fb81ab452f None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:11.825622 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ccfa6-4308-4b72-ab31-39fb81ab452f None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:11.825901 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402ccfa6-4308-4b72-ab31-39fb81ab452f None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:11.826812 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ccfa6-4308-4b72-ab31-39fb81ab452f None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:11.828487 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402ccfa6-4308-4b72-ab31-39fb81ab452f None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:11.841993 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-402ccfa6-4308-4b72-ab31-39fb81ab452f None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 02:08:11.841993 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:11.841993 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:08:11.841993 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:08:11.841993 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:08:11.841993 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:08:11.841993 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:08:11.841993 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:08:11.841993 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 02:08:11.841993 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:11.841993 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:08:11.841993 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:11.841993 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:11.841993 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:11.841993 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:11.841993 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:11.842965 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:11.842965 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:11.842965 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:11.842965 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:11.842965 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:11.842965 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:11.842965 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:11.842965 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:08:11.842965 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:08:11.842965 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:08:11.842965 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:08:11.842965 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:11.842965 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:11.842965 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:11.842965 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:11.842965 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:11.843808 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:11.843808 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:11.843808 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:11.843808 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:11.843808 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:11.843808 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:11.843808 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:11.843808 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:11.843808 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:11.843808 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:11.843808 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:11.843808 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:08:11.843808 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:08:11.843808 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 02:08:11.843808 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:11.843808 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 380/761] 10.222.0.15 () {56 vars in 1129 bytes} [Fri Aug 5 02:08:11 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:11.845204 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ccfa6-4308-4b72-ab31-39fb81ab452f None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:11.857953 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-432cd604-3682-45fe-8ff5-17c915c78d12 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:11.870228 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:11.899706 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c0727-05bb-408b-9f35-7bfdfeaa407c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:11.900731 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c0727-05bb-408b-9f35-7bfdfeaa407c None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:11.901257 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c0727-05bb-408b-9f35-7bfdfeaa407c None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:11.901724 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4c0727-05bb-408b-9f35-7bfdfeaa407c None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:11.902725 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c0727-05bb-408b-9f35-7bfdfeaa407c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:11.903095 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c0727-05bb-408b-9f35-7bfdfeaa407c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:11.904790 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4c0727-05bb-408b-9f35-7bfdfeaa407c None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:11.920879 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 382/762] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Aug 5 02:08:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:11.921950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c0727-05bb-408b-9f35-7bfdfeaa407c None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:11.967819 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402ccfa6-4308-4b72-ab31-39fb81ab452f None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:11.987306 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:12.004261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90419060-aee3-4bc3-b488-fe85e2b69a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:12.005223 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90419060-aee3-4bc3-b488-fe85e2b69a3d None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:12.006267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90419060-aee3-4bc3-b488-fe85e2b69a3d None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:12.006801 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90419060-aee3-4bc3-b488-fe85e2b69a3d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:12.034572 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4c0727-05bb-408b-9f35-7bfdfeaa407c None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:12.073012 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a30e8e-5a94-41d5-9e7a-0418f844ce11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:12.073643 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a30e8e-5a94-41d5-9e7a-0418f844ce11 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:12.073918 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a30e8e-5a94-41d5-9e7a-0418f844ce11 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:12.074187 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a30e8e-5a94-41d5-9e7a-0418f844ce11 None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:12.074922 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a30e8e-5a94-41d5-9e7a-0418f844ce11 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:12.075157 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a30e8e-5a94-41d5-9e7a-0418f844ce11 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:12.076614 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71a30e8e-5a94-41d5-9e7a-0418f844ce11 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:12.081729 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 383/763] 10.222.0.15 () {56 vars in 1124 bytes} [Fri Aug 5 02:08:11 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:12.082735 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a30e8e-5a94-41d5-9e7a-0418f844ce11 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:12.085460 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90419060-aee3-4bc3-b488-fe85e2b69a3d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:12.087435 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90419060-aee3-4bc3-b488-fe85e2b69a3d None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:12.108246 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:12.197208 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a30e8e-5a94-41d5-9e7a-0418f844ce11 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:12.203260 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 381/764] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:08:11 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 02:08:12.204586 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90419060-aee3-4bc3-b488-fe85e2b69a3d None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:12.228070 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:12.240764 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9fb28-82cb-4aaa-9b0f-d1a338e424c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:12.241499 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9fb28-82cb-4aaa-9b0f-d1a338e424c9 None admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:12.241836 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9fb28-82cb-4aaa-9b0f-d1a338e424c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:12.242102 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d9fb28-82cb-4aaa-9b0f-d1a338e424c9 None admin] PATH_INFO: `/v3/projects/95d88dece7184bf1842c4f8d275d52cd/users/4b5c0958604b436daa44b1f67c9dec26/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:12.244458 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d9fb28-82cb-4aaa-9b0f-d1a338e424c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=95d88dece7184bf1842c4f8d275d52cd, user_id=4b5c0958604b436daa44b1f67c9dec26, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:12.246084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d9fb28-82cb-4aaa-9b0f-d1a338e424c9 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:12.262741 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 384/765] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Aug 5 02:08:12 2022] PUT /identity/v3/projects/95d88dece7184bf1842c4f8d275d52cd/users/4b5c0958604b436daa44b1f67c9dec26/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:08:12.263741 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9fb28-82cb-4aaa-9b0f-d1a338e424c9 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:12.326028 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90419060-aee3-4bc3-b488-fe85e2b69a3d None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:12.351123 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:12.379991 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd395413-b07f-464e-99c8-7d5290e2abd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:12.380982 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd395413-b07f-464e-99c8-7d5290e2abd7 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:12.381373 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd395413-b07f-464e-99c8-7d5290e2abd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:12.381783 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd395413-b07f-464e-99c8-7d5290e2abd7 None admin] PATH_INFO: `/v3/services` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:12.382606 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd395413-b07f-464e-99c8-7d5290e2abd7 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:12.383023 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd395413-b07f-464e-99c8-7d5290e2abd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:12.385811 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd395413-b07f-464e-99c8-7d5290e2abd7 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:12.394238 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 382/766] 10.222.0.15 () {56 vars in 1124 bytes} [Fri Aug 5 02:08:12 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:12.403474 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd395413-b07f-464e-99c8-7d5290e2abd7 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:12.424221 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d9fb28-82cb-4aaa-9b0f-d1a338e424c9 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:12.534054 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424f669-cbeb-40cb-a5be-0ee7a5d99eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:12.534639 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424f669-cbeb-40cb-a5be-0ee7a5d99eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:12.534920 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424f669-cbeb-40cb-a5be-0ee7a5d99eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:12.535197 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d424f669-cbeb-40cb-a5be-0ee7a5d99eb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:12.535702 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd395413-b07f-464e-99c8-7d5290e2abd7 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:12.550536 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d424f669-cbeb-40cb-a5be-0ee7a5d99eb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:12.551815 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d424f669-cbeb-40cb-a5be-0ee7a5d99eb5 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:12.576241 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-d424f669-cbeb-40cb-a5be-0ee7a5d99eb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:12.576241 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:12.576241 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:12.576241 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:12.576241 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:12.576241 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:12.576241 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:12.576241 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:12.576241 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:12.576241 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:12.576241 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:12.576241 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:12.576241 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:08:12.576241 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:08:12.576241 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:08:12.577824 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:08:12.577824 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:12.577824 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:12.577824 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:12.577824 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:12.577824 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:12.577824 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:12.577824 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:12.577824 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:12.577824 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:12.577824 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:12.577824 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:12.577824 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:12.577824 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:12.577824 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:12.577824 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:12.577824 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:12.578848 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:08:12.578848 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:08:12.578848 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:12.578848 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:12.579529 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 385/767] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:12.586987 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424f669-cbeb-40cb-a5be-0ee7a5d99eb5 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:12.588973 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7123a1a1-7b0f-49d7-a20a-69b42ae625a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:12.590187 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123a1a1-7b0f-49d7-a20a-69b42ae625a7 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:12.590707 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123a1a1-7b0f-49d7-a20a-69b42ae625a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:12.592220 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7123a1a1-7b0f-49d7-a20a-69b42ae625a7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:12.593404 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7123a1a1-7b0f-49d7-a20a-69b42ae625a7 None admin] RBAC: Adding query filter params (interface=public, service_id=fdbae0d8d8d44213b97f9a787c2b373f, region_id=RegionOne) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:12.593973 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7123a1a1-7b0f-49d7-a20a-69b42ae625a7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:12.595917 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7123a1a1-7b0f-49d7-a20a-69b42ae625a7 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:12.610944 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 383/768] 10.222.0.15 () {56 vars in 1251 bytes} [Fri Aug 5 02:08:12 2022] GET /identity/v3/endpoints?service_id=fdbae0d8d8d44213b97f9a787c2b373f&interface=public®ion_id=RegionOne => generated 194 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:12.612185 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc0c71-280f-4abb-ac37-84a6b000f856 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:12.612669 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc0c71-280f-4abb-ac37-84a6b000f856 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:12.612847 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cc0c71-280f-4abb-ac37-84a6b000f856 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:12.614380 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 384/769] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:08:12.616674 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc0c71-280f-4abb-ac37-84a6b000f856 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:12.640436 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:12.680537 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:12.713888 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d424f669-cbeb-40cb-a5be-0ee7a5d99eb5 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:12.751711 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cc0c71-280f-4abb-ac37-84a6b000f856 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:12.751934 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cf5455-c797-4a71-beda-0c4a6e93021c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:12.752563 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf5455-c797-4a71-beda-0c4a6e93021c None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:12.752845 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf5455-c797-4a71-beda-0c4a6e93021c None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:12.753119 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cf5455-c797-4a71-beda-0c4a6e93021c None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:12.753920 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf5455-c797-4a71-beda-0c4a6e93021c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:12.754323 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf5455-c797-4a71-beda-0c4a6e93021c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:12.756268 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95cf5455-c797-4a71-beda-0c4a6e93021c None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:12.774566 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 386/770] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:08:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:12.776038 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4905b49-1d8d-48c3-92e3-bc73eabfe360 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:12.776319 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4905b49-1d8d-48c3-92e3-bc73eabfe360 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:12.776686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4905b49-1d8d-48c3-92e3-bc73eabfe360 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:12.791593 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cde35b-0283-4b42-a8dc-ef8b3af6d8c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:12.792438 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cde35b-0283-4b42-a8dc-ef8b3af6d8c9 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:12.792723 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cde35b-0283-4b42-a8dc-ef8b3af6d8c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:12.792996 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9cde35b-0283-4b42-a8dc-ef8b3af6d8c9 None admin] PATH_INFO: `/v3/services` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:12.793649 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cde35b-0283-4b42-a8dc-ef8b3af6d8c9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:12.795091 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9cde35b-0283-4b42-a8dc-ef8b3af6d8c9 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:12.796137 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-f4905b49-1d8d-48c3-92e3-bc73eabfe360 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:12.797517 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-f4905b49-1d8d-48c3-92e3-bc73eabfe360 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:12.801724 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 385/771] 10.222.0.15 () {56 vars in 1087 bytes} [Fri Aug 5 02:08:12 2022] GET /identity/v3/services => generated 772 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:12.803171 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cde35b-0283-4b42-a8dc-ef8b3af6d8c9 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:12.902901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 387/772] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:12 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:08:12.928901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4905b49-1d8d-48c3-92e3-bc73eabfe360 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:12.936499 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9cde35b-0283-4b42-a8dc-ef8b3af6d8c9 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:12.948955 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:12.982354 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa0985-983a-4a0e-8e21-36f7036e2db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:12.986211 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa0985-983a-4a0e-8e21-36f7036e2db2 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:12.986560 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa0985-983a-4a0e-8e21-36f7036e2db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:12.986911 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26aa0985-983a-4a0e-8e21-36f7036e2db2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:12.998016 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:13.001464 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa0985-983a-4a0e-8e21-36f7036e2db2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:13.004661 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26aa0985-983a-4a0e-8e21-36f7036e2db2 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:13.025986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-26aa0985-983a-4a0e-8e21-36f7036e2db2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:08:13.025986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:13.025986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:13.025986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:13.025986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:13.025986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:13.025986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:13.025986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:13.025986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:13.025986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:13.025986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:13.025986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:13.025986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:08:13.025986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:08:13.025986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:08:13.026935 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:08:13.026935 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:13.026935 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:13.026935 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:13.026935 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:13.026935 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:13.026935 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:13.026935 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:13.026935 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:13.026935 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:13.026935 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:13.026935 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:13.026935 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:13.026935 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:13.026935 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:13.026935 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:13.026935 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:13.028265 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:08:13.028265 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:08:13.028265 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:08:13.028265 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:08:13.028265 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:08:13.028265 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:08:13.028265 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:08:13.028265 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:13.028265 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 386/773] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:08:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:13.033120 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa0985-983a-4a0e-8e21-36f7036e2db2 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:13.120910 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4905b49-1d8d-48c3-92e3-bc73eabfe360 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:13.174110 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26aa0985-983a-4a0e-8e21-36f7036e2db2 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:13.199853 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717ae8d-47cf-4bdf-9590-9b6d0c2c5a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:13.200542 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717ae8d-47cf-4bdf-9590-9b6d0c2c5a2f None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:13.200874 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717ae8d-47cf-4bdf-9590-9b6d0c2c5a2f None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:13.201153 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6717ae8d-47cf-4bdf-9590-9b6d0c2c5a2f None admin] PATH_INFO: `/v3/services/network` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:13.201794 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6717ae8d-47cf-4bdf-9590-9b6d0c2c5a2f None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:13.203150 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6717ae8d-47cf-4bdf-9590-9b6d0c2c5a2f None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:13.212760 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904e049-edb2-459d-90b5-f592ef3dec67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:13.213668 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904e049-edb2-459d-90b5-f592ef3dec67 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:13.213957 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904e049-edb2-459d-90b5-f592ef3dec67 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:13.214244 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904e049-edb2-459d-90b5-f592ef3dec67 None admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:13.215007 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1904e049-edb2-459d-90b5-f592ef3dec67 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:13.215357 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1904e049-edb2-459d-90b5-f592ef3dec67 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:13.216833 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1904e049-edb2-459d-90b5-f592ef3dec67 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:13.223048 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-6717ae8d-47cf-4bdf-9590-9b6d0c2c5a2f None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 02:08:13.223048 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:13.223048 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:08:13.223048 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:08:13.223048 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:08:13.223048 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:08:13.223048 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:08:13.223048 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:08:13.223048 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 02:08:13.223048 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:13.223048 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:08:13.223048 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:13.223048 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:13.223048 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:13.223048 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:13.223048 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:13.223048 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:13.238616 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:13.238616 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:13.238616 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:13.238616 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:13.238616 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:13.238616 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:13.238616 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:08:13.238616 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:08:13.238616 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:08:13.238616 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:08:13.238616 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:13.238616 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:13.238616 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:13.238616 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:13.238616 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:13.238616 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:13.240609 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:13.240609 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:13.240609 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:13.240609 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:13.240609 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:13.240609 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:13.240609 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:13.240609 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:13.240609 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:13.240609 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:13.240609 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:08:13.240609 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:08:13.240609 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 02:08:13.240609 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:13.240609 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 388/774] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:08:12 2022] GET /identity/v3/services/network => generated 88 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:13.242321 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 387/775] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Aug 5 02:08:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:13.245683 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717ae8d-47cf-4bdf-9590-9b6d0c2c5a2f None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:13.249712 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904e049-edb2-459d-90b5-f592ef3dec67 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:13.289755 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:13.369322 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904e049-edb2-459d-90b5-f592ef3dec67 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:13.417278 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70dc223-1b3b-4cad-a6dd-cf25044a21c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:13.418200 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70dc223-1b3b-4cad-a6dd-cf25044a21c1 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:13.418482 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70dc223-1b3b-4cad-a6dd-cf25044a21c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:13.419031 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70dc223-1b3b-4cad-a6dd-cf25044a21c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:13.419843 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70dc223-1b3b-4cad-a6dd-cf25044a21c1 None admin] RBAC: Adding query filter params (role.id=876fd0d181d74df4bbc73b2db1c42fbe, scope.project.id=95d88dece7184bf1842c4f8d275d52cd, user.id=36970f0778384576b599cd7217b5084d) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:13.420317 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70dc223-1b3b-4cad-a6dd-cf25044a21c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:13.422207 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70dc223-1b3b-4cad-a6dd-cf25044a21c1 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:13.424103 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:13.429897 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 388/776] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:08:13 2022] GET /identity/v3/role_assignments?user.id=36970f0778384576b599cd7217b5084d&scope.project.id=95d88dece7184bf1842c4f8d275d52cd&role.id=876fd0d181d74df4bbc73b2db1c42fbe => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:13.431764 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700f070-3c8d-4a58-ab89-e56959dfa660 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:13.432360 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700f070-3c8d-4a58-ab89-e56959dfa660 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:13.432648 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9700f070-3c8d-4a58-ab89-e56959dfa660 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:13.434791 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 389/777] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:08:13.440369 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2afbe8-3104-4783-970a-7ec08d52876a None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:13.440741 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2afbe8-3104-4783-970a-7ec08d52876a None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:13.440915 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2afbe8-3104-4783-970a-7ec08d52876a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:13.449147 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6717ae8d-47cf-4bdf-9590-9b6d0c2c5a2f None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:13.464893 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-bc2afbe8-3104-4783-970a-7ec08d52876a None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:13.466132 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-bc2afbe8-3104-4783-970a-7ec08d52876a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:13.499007 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50472d-f1de-4e0b-8025-33a6ad4751b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:13.500287 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50472d-f1de-4e0b-8025-33a6ad4751b8 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:13.501059 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50472d-f1de-4e0b-8025-33a6ad4751b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:13.501535 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f50472d-f1de-4e0b-8025-33a6ad4751b8 None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:13.503168 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f50472d-f1de-4e0b-8025-33a6ad4751b8 None admin] RBAC: Adding query filter params (name=network) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:13.503771 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f50472d-f1de-4e0b-8025-33a6ad4751b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:13.506089 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f50472d-f1de-4e0b-8025-33a6ad4751b8 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:13.513172 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 389/778] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Aug 5 02:08:13 2022] GET /identity/v3/services?name=network => generated 124 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:13.523481 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50472d-f1de-4e0b-8025-33a6ad4751b8 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:13.556355 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 390/779] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:13 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:08:13.584827 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2afbe8-3104-4783-970a-7ec08d52876a None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:13.631997 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:13.733018 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f50472d-f1de-4e0b-8025-33a6ad4751b8 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:13.780793 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2afbe8-3104-4783-970a-7ec08d52876a None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:13.800392 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712352f-90a5-498c-8304-fd9f9401940e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:13.801043 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712352f-90a5-498c-8304-fd9f9401940e None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:13.801325 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712352f-90a5-498c-8304-fd9f9401940e None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:13.801598 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f712352f-90a5-498c-8304-fd9f9401940e None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:13.802361 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712352f-90a5-498c-8304-fd9f9401940e None admin] RBAC: Adding query filter params (type=network) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:13.802671 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712352f-90a5-498c-8304-fd9f9401940e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:13.804053 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f712352f-90a5-498c-8304-fd9f9401940e None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:13.819886 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 390/780] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Aug 5 02:08:13 2022] GET /identity/v3/services?type=network => generated 350 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:13.819886 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712352f-90a5-498c-8304-fd9f9401940e None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:13.843127 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806efaf-9f64-471a-bda7-ad895d8ac9a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:13.843944 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806efaf-9f64-471a-bda7-ad895d8ac9a5 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:13.844231 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806efaf-9f64-471a-bda7-ad895d8ac9a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:13.844540 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e806efaf-9f64-471a-bda7-ad895d8ac9a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:13.865200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:13.870121 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e806efaf-9f64-471a-bda7-ad895d8ac9a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:08:13.876660 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-e806efaf-9f64-471a-bda7-ad895d8ac9a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:08:13.876660 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:13.876660 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:13.876660 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:13.876660 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:13.876660 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:13.876660 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:13.876660 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:13.876660 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:13.876660 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:13.876660 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:13.876660 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:13.876660 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:08:13.876660 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:08:13.876660 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:08:13.876660 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:08:13.877615 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:08:13.877615 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:08:13.877615 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:08:13.877615 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:08:13.877615 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:13.877615 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:13.877615 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:13.877615 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:13.877615 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:13.877615 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:13.877615 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:13.877615 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:13.877615 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:13.877615 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:13.877615 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:13.877615 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:13.878446 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:13.878446 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:13.878446 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:13.878446 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:13.878446 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:08:13.878446 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:08:13.878446 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:08:13.878446 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:08:13.878446 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:08:13.878446 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:08:13.878446 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:08:13.878446 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:13.879070 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 391/781] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Aug 5 02:08:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:13.888468 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806efaf-9f64-471a-bda7-ad895d8ac9a5 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:13.981132 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f712352f-90a5-498c-8304-fd9f9401940e None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:14.050255 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547e502-f31d-44a0-8992-cb94447d37db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:14.050807 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547e502-f31d-44a0-8992-cb94447d37db None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:14.051130 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547e502-f31d-44a0-8992-cb94447d37db None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:14.051409 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3547e502-f31d-44a0-8992-cb94447d37db None admin] PATH_INFO: `/v3/endpoints` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:14.052206 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547e502-f31d-44a0-8992-cb94447d37db None admin] RBAC: Adding query filter params (interface=public, service_id=4afaf4d1d6e34e8f8bce6e1f0d17aec1, region_id=RegionOne) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:14.052572 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547e502-f31d-44a0-8992-cb94447d37db None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:14.053938 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3547e502-f31d-44a0-8992-cb94447d37db None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:14.064909 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:14.068288 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 391/782] 10.222.0.15 () {56 vars in 1251 bytes} [Fri Aug 5 02:08:13 2022] GET /identity/v3/endpoints?service_id=4afaf4d1d6e34e8f8bce6e1f0d17aec1&interface=public®ion_id=RegionOne => generated 194 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:14.073454 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547e502-f31d-44a0-8992-cb94447d37db None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:14.085478 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e806efaf-9f64-471a-bda7-ad895d8ac9a5 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:14.137029 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a78775-9b5d-403e-af9a-4f8d3663b59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:14.138016 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a78775-9b5d-403e-af9a-4f8d3663b59a None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:14.138510 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a78775-9b5d-403e-af9a-4f8d3663b59a None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:14.138991 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48a78775-9b5d-403e-af9a-4f8d3663b59a None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:14.139924 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a78775-9b5d-403e-af9a-4f8d3663b59a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:14.140486 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a78775-9b5d-403e-af9a-4f8d3663b59a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:14.142173 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48a78775-9b5d-403e-af9a-4f8d3663b59a None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:14.160712 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:14.162296 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 392/783] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:08:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:14.168191 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a78775-9b5d-403e-af9a-4f8d3663b59a None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:14.180586 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3547e502-f31d-44a0-8992-cb94447d37db None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:14.227882 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5407495-aba9-4df8-afd4-16bbdf7b4867 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:14.228535 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5407495-aba9-4df8-afd4-16bbdf7b4867 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:14.228815 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5407495-aba9-4df8-afd4-16bbdf7b4867 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:14.229085 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5407495-aba9-4df8-afd4-16bbdf7b4867 None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:14.231583 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5407495-aba9-4df8-afd4-16bbdf7b4867 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:14.231583 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5407495-aba9-4df8-afd4-16bbdf7b4867 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:14.236822 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 392/784] 10.222.0.15 () {56 vars in 1087 bytes} [Fri Aug 5 02:08:14 2022] GET /identity/v3/services => generated 772 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:14.366280 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48a78775-9b5d-403e-af9a-4f8d3663b59a None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:14.418061 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62cf53-a3f9-408a-88c5-c3a9f8d11728 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:14.418717 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62cf53-a3f9-408a-88c5-c3a9f8d11728 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:14.418995 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62cf53-a3f9-408a-88c5-c3a9f8d11728 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:14.419262 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e62cf53-a3f9-408a-88c5-c3a9f8d11728 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:14.439623 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e62cf53-a3f9-408a-88c5-c3a9f8d11728 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:14.442436 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e62cf53-a3f9-408a-88c5-c3a9f8d11728 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:14.452463 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:14.462641 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-2e62cf53-a3f9-408a-88c5-c3a9f8d11728 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:14.462641 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:14.462641 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:14.462641 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:14.462641 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:14.462641 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:14.462641 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:14.462641 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:14.462641 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:14.462641 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:14.462641 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:14.462641 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:14.462641 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:08:14.462641 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:08:14.462641 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:08:14.463740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:08:14.463740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:14.463740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:14.463740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:14.463740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:14.463740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:14.463740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:14.463740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:14.463740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:14.463740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:14.463740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:14.463740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:14.463740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:14.463740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:14.463740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:14.463740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:14.463740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:14.464766 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:08:14.464766 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:08:14.464766 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:14.464766 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:14.469903 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 393/785] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:08:14.476642 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5407495-aba9-4df8-afd4-16bbdf7b4867 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:14.589194 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5407495-aba9-4df8-afd4-16bbdf7b4867 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:14.625245 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55cd6741-1e37-4e16-8329-a694a814ec92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:14.625782 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd6741-1e37-4e16-8329-a694a814ec92 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:14.626061 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd6741-1e37-4e16-8329-a694a814ec92 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:14.626334 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cd6741-1e37-4e16-8329-a694a814ec92 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:14.627021 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cd6741-1e37-4e16-8329-a694a814ec92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:14.627320 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cd6741-1e37-4e16-8329-a694a814ec92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:14.628695 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55cd6741-1e37-4e16-8329-a694a814ec92 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:14.644505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 393/786] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:08:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:14.649834 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62cf53-a3f9-408a-88c5-c3a9f8d11728 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:14.774735 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e62cf53-a3f9-408a-88c5-c3a9f8d11728 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:14.819378 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd0511-7920-41b9-bbc2-98c3f75c9d0f None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:14.820284 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85747e-0a1f-40dc-bf50-2e706aec4b71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:14.820612 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd0511-7920-41b9-bbc2-98c3f75c9d0f None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:14.820961 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85747e-0a1f-40dc-bf50-2e706aec4b71 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:14.821239 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85747e-0a1f-40dc-bf50-2e706aec4b71 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:14.821514 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e85747e-0a1f-40dc-bf50-2e706aec4b71 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:14.821615 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bd0511-7920-41b9-bbc2-98c3f75c9d0f None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:14.823407 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 394/787] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:14 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:08:14.834078 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e85747e-0a1f-40dc-bf50-2e706aec4b71 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:14.834821 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edbc7e-9f90-4652-84ea-25b984ec85df None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:14.835306 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edbc7e-9f90-4652-84ea-25b984ec85df None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:14.835531 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e85747e-0a1f-40dc-bf50-2e706aec4b71 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:14.835988 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41edbc7e-9f90-4652-84ea-25b984ec85df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:14.848587 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-7e85747e-0a1f-40dc-bf50-2e706aec4b71 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 05 02:08:14.848587 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:14.848587 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:14.848587 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:14.848587 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:14.848587 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:14.848587 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:14.848587 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:14.848587 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:14.848587 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:14.848587 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:14.848587 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:14.848587 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:08:14.848587 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:08:14.848587 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:08:14.848587 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:08:14.849662 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:14.849662 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:14.849662 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:08:14.849662 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:08:14.849662 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:08:14.849662 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:08:14.849662 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:14.849662 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:14.849662 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:14.849662 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:14.849662 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:14.849662 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:14.849662 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:14.849662 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:14.849662 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:14.849662 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:14.849662 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:14.849662 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:14.850629 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:14.850629 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:14.850629 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:08:14.850629 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:08:14.850629 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:08:14.850629 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:08:14.850629 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:08:14.850629 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:08:14.850629 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 05 02:08:14.850629 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:14.850629 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 394/788] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Aug 5 02:08:14 2022] GET /identity/v3/users/swift => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:14.856702 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:14.857877 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85747e-0a1f-40dc-bf50-2e706aec4b71 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:14.883430 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-41edbc7e-9f90-4652-84ea-25b984ec85df None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:14.884924 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-41edbc7e-9f90-4652-84ea-25b984ec85df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:14.923563 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:14.969976 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e85747e-0a1f-40dc-bf50-2e706aec4b71 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:15.007479 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4fd4a5-473a-4ec4-b472-f42962de6a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:15.011672 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fd4a5-473a-4ec4-b472-f42962de6a70 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:15.011972 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fd4a5-473a-4ec4-b472-f42962de6a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:15.012255 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4fd4a5-473a-4ec4-b472-f42962de6a70 None admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:15.014185 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4fd4a5-473a-4ec4-b472-f42962de6a70 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:15.014508 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4fd4a5-473a-4ec4-b472-f42962de6a70 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:15.016983 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c4fd4a5-473a-4ec4-b472-f42962de6a70 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:15.036383 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 395/789] 10.222.0.15 () {56 vars in 1135 bytes} [Fri Aug 5 02:08:14 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:15.041992 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4fd4a5-473a-4ec4-b472-f42962de6a70 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:15.114497 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 395/790] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:14 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) Aug 05 02:08:15.152606 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c4fd4a5-473a-4ec4-b472-f42962de6a70 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:15.154524 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edbc7e-9f90-4652-84ea-25b984ec85df None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:15.172966 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:15.194195 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1d925-022e-4b27-b00e-99ecc44db636 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:15.194848 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1d925-022e-4b27-b00e-99ecc44db636 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:15.195133 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1d925-022e-4b27-b00e-99ecc44db636 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:15.195410 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe1d925-022e-4b27-b00e-99ecc44db636 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:15.206672 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe1d925-022e-4b27-b00e-99ecc44db636 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:15.208796 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fe1d925-022e-4b27-b00e-99ecc44db636 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:15.225554 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-6fe1d925-022e-4b27-b00e-99ecc44db636 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:15.225554 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:15.225554 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:15.225554 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:15.225554 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:15.225554 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:15.225554 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:15.225554 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:15.225554 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:15.225554 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:15.225554 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:15.225554 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:15.225554 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:08:15.225554 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:08:15.225554 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:08:15.226524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:08:15.226524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:15.226524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:15.226524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:15.226524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:15.226524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:15.226524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:15.226524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:15.226524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:15.226524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:15.226524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:15.226524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:15.226524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:15.226524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:15.226524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:15.226524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:15.226524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:15.227835 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:08:15.227835 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:08:15.227835 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:15.227835 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:15.227835 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 396/791] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:08:15.232773 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1d925-022e-4b27-b00e-99ecc44db636 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:15.339857 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe1d925-022e-4b27-b00e-99ecc44db636 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:15.357199 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41edbc7e-9f90-4652-84ea-25b984ec85df None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:15.392496 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe396a0-d9bf-4c90-8517-73cf9d8023b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:15.393140 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe396a0-d9bf-4c90-8517-73cf9d8023b7 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:15.393422 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe396a0-d9bf-4c90-8517-73cf9d8023b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:15.393695 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe396a0-d9bf-4c90-8517-73cf9d8023b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:15.395667 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:15.400443 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86a880-9b0c-4358-8a8e-e658e20dcff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:15.401120 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86a880-9b0c-4358-8a8e-e658e20dcff1 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:15.401379 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86a880-9b0c-4358-8a8e-e658e20dcff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:15.402446 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa86a880-9b0c-4358-8a8e-e658e20dcff1 None admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:15.403218 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa86a880-9b0c-4358-8a8e-e658e20dcff1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:15.403483 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa86a880-9b0c-4358-8a8e-e658e20dcff1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:15.404909 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa86a880-9b0c-4358-8a8e-e658e20dcff1 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:15.417674 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efe396a0-d9bf-4c90-8517-73cf9d8023b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:08:15.418950 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 397/792] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:08:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:15.422627 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-efe396a0-d9bf-4c90-8517-73cf9d8023b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:08:15.422627 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:15.422627 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:15.422627 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:15.422627 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:15.422627 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:15.422627 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:15.422627 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:15.422627 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:15.422627 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:15.422627 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:15.422627 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:15.422627 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:08:15.422627 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:08:15.422627 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:08:15.422627 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:08:15.423790 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:08:15.423790 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:08:15.423790 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:08:15.423790 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:08:15.423790 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:15.423790 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:15.423790 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:15.423790 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:15.423790 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:15.423790 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:15.423790 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:15.423790 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:15.423790 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:15.423790 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:15.423790 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:15.423790 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:15.424652 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:15.424652 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:15.424652 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:15.424652 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:15.424652 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:08:15.424652 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:08:15.424652 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:08:15.424652 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:08:15.424652 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:08:15.424652 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:08:15.424652 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:08:15.424652 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:15.425292 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86a880-9b0c-4358-8a8e-e658e20dcff1 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:15.432755 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 396/793] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Aug 5 02:08:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:08:15.438844 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe396a0-d9bf-4c90-8517-73cf9d8023b7 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:15.476705 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:15.543206 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa86a880-9b0c-4358-8a8e-e658e20dcff1 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:15.574099 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe396a0-d9bf-4c90-8517-73cf9d8023b7 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:15.579946 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4a633a-7483-4ca2-848c-0863072cd58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:15.580893 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a633a-7483-4ca2-848c-0863072cd58b None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:15.581374 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a633a-7483-4ca2-848c-0863072cd58b None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:15.581901 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4a633a-7483-4ca2-848c-0863072cd58b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:15.589721 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a633a-7483-4ca2-848c-0863072cd58b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:15.591444 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4a633a-7483-4ca2-848c-0863072cd58b None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:15.603679 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-6e4a633a-7483-4ca2-848c-0863072cd58b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:08:15.603679 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:15.603679 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:15.603679 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:15.603679 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:15.603679 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:15.603679 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:15.603679 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:15.603679 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:15.603679 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:15.603679 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:15.603679 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:15.603679 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:08:15.603679 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:08:15.603679 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:08:15.604577 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:08:15.604577 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:15.604577 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:15.604577 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:15.604577 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:15.604577 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:15.604577 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:15.604577 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:15.604577 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:15.604577 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:15.604577 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:15.604577 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:15.604577 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:15.604577 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:15.604577 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:15.604577 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:15.604577 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:15.605475 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:08:15.605475 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:08:15.605475 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:08:15.605475 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:08:15.605475 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:08:15.605475 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:08:15.605475 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:08:15.605475 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:15.607976 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 398/794] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:08:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:08:15.609435 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4f3c3-976f-4934-afeb-d0d806f9768a None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:15.609914 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4f3c3-976f-4934-afeb-d0d806f9768a None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:15.610379 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c4f3c3-976f-4934-afeb-d0d806f9768a None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:15.616488 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 399/795] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:08:15.617427 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4f3c3-976f-4934-afeb-d0d806f9768a None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:15.618186 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f12cb982-b0a5-46e2-8cde-1f938dfb4e23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:15.618930 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cb982-b0a5-46e2-8cde-1f938dfb4e23 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:15.619313 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cb982-b0a5-46e2-8cde-1f938dfb4e23 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:15.619680 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f12cb982-b0a5-46e2-8cde-1f938dfb4e23 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:15.620550 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12cb982-b0a5-46e2-8cde-1f938dfb4e23 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:15.620961 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12cb982-b0a5-46e2-8cde-1f938dfb4e23 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:15.622990 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f12cb982-b0a5-46e2-8cde-1f938dfb4e23 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:15.635896 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 397/796] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:08:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:15.635896 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224b0b2-7722-4c36-809e-f2423d472b9d None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:15.635896 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224b0b2-7722-4c36-809e-f2423d472b9d None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:15.635896 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224b0b2-7722-4c36-809e-f2423d472b9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:15.656214 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-c224b0b2-7722-4c36-809e-f2423d472b9d None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:15.657369 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-c224b0b2-7722-4c36-809e-f2423d472b9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:15.710374 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:15.731779 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:15.736565 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 398/797] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:15 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:08:15.737478 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224b0b2-7722-4c36-809e-f2423d472b9d None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:15.748229 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c4f3c3-976f-4934-afeb-d0d806f9768a None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:15.784834 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1cafd-8c3b-4a24-87c4-3e60c0ce565c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:15.785863 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1cafd-8c3b-4a24-87c4-3e60c0ce565c None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:15.786354 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1cafd-8c3b-4a24-87c4-3e60c0ce565c None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:15.786887 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad1cafd-8c3b-4a24-87c4-3e60c0ce565c None admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:15.787843 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad1cafd-8c3b-4a24-87c4-3e60c0ce565c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:15.788381 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad1cafd-8c3b-4a24-87c4-3e60c0ce565c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:15.790060 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad1cafd-8c3b-4a24-87c4-3e60c0ce565c None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:15.803955 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 400/798] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Aug 5 02:08:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:15.805192 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1cafd-8c3b-4a24-87c4-3e60c0ce565c None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:15.869241 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224b0b2-7722-4c36-809e-f2423d472b9d None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:15.905397 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172bc9ab-213e-405a-b8bc-885fe1b651db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:15.906047 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bc9ab-213e-405a-b8bc-885fe1b651db None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:15.906387 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bc9ab-213e-405a-b8bc-885fe1b651db None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:15.906610 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172bc9ab-213e-405a-b8bc-885fe1b651db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:15.915363 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad1cafd-8c3b-4a24-87c4-3e60c0ce565c None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:15.918391 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172bc9ab-213e-405a-b8bc-885fe1b651db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:15.919854 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-172bc9ab-213e-405a-b8bc-885fe1b651db None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:15.935185 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-172bc9ab-213e-405a-b8bc-885fe1b651db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:15.935185 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:15.935185 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:15.935185 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:15.935185 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:15.935185 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:15.935185 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:15.935185 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:15.935185 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:15.935185 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:15.935185 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:15.935185 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:15.935185 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:08:15.935185 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:08:15.935185 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:08:15.936130 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:08:15.936130 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:15.936130 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:15.936130 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:15.936130 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:15.936130 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:15.936130 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:15.936130 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:15.936130 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:15.936130 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:15.936130 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:15.936130 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:15.936130 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:15.936130 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:15.936130 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:15.936130 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:15.936130 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:15.937086 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:08:15.937086 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:08:15.937086 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:15.937086 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:15.937086 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 399/799] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:15.937086 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172bc9ab-213e-405a-b8bc-885fe1b651db None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:15.954114 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d80db8f2-71a5-448e-930f-e65f99a69939 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:15.954756 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80db8f2-71a5-448e-930f-e65f99a69939 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:15.955040 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80db8f2-71a5-448e-930f-e65f99a69939 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:15.955326 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d80db8f2-71a5-448e-930f-e65f99a69939 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:15.955941 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80db8f2-71a5-448e-930f-e65f99a69939 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:15.957356 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d80db8f2-71a5-448e-930f-e65f99a69939 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:15.966989 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-d80db8f2-71a5-448e-930f-e65f99a69939 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 02:08:15.966989 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:15.966989 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:08:15.966989 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:08:15.966989 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:08:15.966989 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:08:15.966989 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:08:15.966989 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:08:15.966989 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 02:08:15.966989 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:15.966989 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:08:15.966989 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:15.966989 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:15.966989 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:15.966989 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:15.966989 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:15.967953 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:15.967953 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:15.967953 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:15.967953 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:15.967953 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:15.967953 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:15.967953 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:15.967953 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:08:15.967953 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:08:15.967953 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:08:15.967953 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:08:15.967953 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:15.967953 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:15.967953 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:15.967953 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:15.967953 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:15.968824 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:15.968824 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:15.968824 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:15.968824 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:15.968824 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:15.968824 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:15.968824 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:15.968824 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:15.968824 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:15.968824 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:15.968824 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:15.968824 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:08:15.968824 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:08:15.968824 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 05 02:08:15.968824 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:15.968824 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 401/800] 10.222.0.15 () {56 vars in 1129 bytes} [Fri Aug 5 02:08:15 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:15.970302 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac35b9-a4e0-4917-8a15-ecd31f13b85b None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:15.970302 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac35b9-a4e0-4917-8a15-ecd31f13b85b None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:15.970302 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ac35b9-a4e0-4917-8a15-ecd31f13b85b None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:15.971470 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 402/801] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:08:15.975945 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac35b9-a4e0-4917-8a15-ecd31f13b85b None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:15.986648 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:15.992116 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:16.051885 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-172bc9ab-213e-405a-b8bc-885fe1b651db None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:16.087066 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ac35b9-a4e0-4917-8a15-ecd31f13b85b None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:16.091629 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3b8df-e90c-44ec-996d-9391fb04ea3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:16.092298 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3b8df-e90c-44ec-996d-9391fb04ea3e None admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:16.092624 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3b8df-e90c-44ec-996d-9391fb04ea3e None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:16.092903 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b3b8df-e90c-44ec-996d-9391fb04ea3e None admin] PATH_INFO: `/v3/projects/95d88dece7184bf1842c4f8d275d52cd/users/f03233b0ee3540cdb5105f6603cfdff5/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:16.094858 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3b8df-e90c-44ec-996d-9391fb04ea3e None admin] RBAC: Authorizing `identity:create_grant(project_id=95d88dece7184bf1842c4f8d275d52cd, user_id=f03233b0ee3540cdb5105f6603cfdff5, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:16.096811 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b3b8df-e90c-44ec-996d-9391fb04ea3e None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:16.111203 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 400/802] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Aug 5 02:08:15 2022] PUT /identity/v3/projects/95d88dece7184bf1842c4f8d275d52cd/users/f03233b0ee3540cdb5105f6603cfdff5/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:08:16.112318 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3b8df-e90c-44ec-996d-9391fb04ea3e None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:16.136793 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c196a563-5bed-4ab7-aece-c192621ac085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:16.137578 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196a563-5bed-4ab7-aece-c192621ac085 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:16.137988 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196a563-5bed-4ab7-aece-c192621ac085 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:16.138380 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c196a563-5bed-4ab7-aece-c192621ac085 None admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:16.139294 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c196a563-5bed-4ab7-aece-c192621ac085 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:16.139679 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c196a563-5bed-4ab7-aece-c192621ac085 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:16.141562 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c196a563-5bed-4ab7-aece-c192621ac085 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:16.160886 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 403/803] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:08:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:16.160886 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3206acf-54de-4c0b-b960-3c980c46cab0 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:16.160886 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3206acf-54de-4c0b-b960-3c980c46cab0 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:16.160886 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3206acf-54de-4c0b-b960-3c980c46cab0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:16.180124 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-a3206acf-54de-4c0b-b960-3c980c46cab0 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:16.181557 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-a3206acf-54de-4c0b-b960-3c980c46cab0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:16.265051 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:16.272180 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 404/804] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:16 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:08:16.272568 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b3b8df-e90c-44ec-996d-9391fb04ea3e None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:16.273462 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3206acf-54de-4c0b-b960-3c980c46cab0 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:16.277160 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:16.319010 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01682d-5e8b-48e7-ae58-8274e55655e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:16.319957 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01682d-5e8b-48e7-ae58-8274e55655e4 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:16.320489 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01682d-5e8b-48e7-ae58-8274e55655e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:16.320971 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f01682d-5e8b-48e7-ae58-8274e55655e4 None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:16.321889 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f01682d-5e8b-48e7-ae58-8274e55655e4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:16.322414 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f01682d-5e8b-48e7-ae58-8274e55655e4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:16.323992 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f01682d-5e8b-48e7-ae58-8274e55655e4 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:16.329364 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 401/805] 10.222.0.15 () {56 vars in 1124 bytes} [Fri Aug 5 02:08:16 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:16.332070 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01682d-5e8b-48e7-ae58-8274e55655e4 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:16.404384 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3206acf-54de-4c0b-b960-3c980c46cab0 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:16.445246 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a7db8-bec6-4bb5-9f3a-faeb76508d5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:16.445999 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a7db8-bec6-4bb5-9f3a-faeb76508d5c None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:16.446288 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a7db8-bec6-4bb5-9f3a-faeb76508d5c None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:16.446573 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45a7db8-bec6-4bb5-9f3a-faeb76508d5c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:16.454791 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a7db8-bec6-4bb5-9f3a-faeb76508d5c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:16.456388 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45a7db8-bec6-4bb5-9f3a-faeb76508d5c None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:16.465699 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f01682d-5e8b-48e7-ae58-8274e55655e4 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:16.472884 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-a45a7db8-bec6-4bb5-9f3a-faeb76508d5c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 02:08:16.472884 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:16.472884 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:16.472884 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:16.472884 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:16.472884 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:16.472884 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:16.472884 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:16.472884 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:16.472884 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:16.472884 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:16.472884 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:16.472884 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:08:16.472884 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:08:16.472884 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:08:16.472884 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:08:16.473827 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:16.473827 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:16.473827 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:08:16.473827 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:08:16.473827 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:08:16.473827 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:08:16.473827 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:16.473827 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:16.473827 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:16.473827 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:16.473827 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:16.473827 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:16.473827 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:16.473827 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:16.473827 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:16.473827 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:16.473827 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:16.473827 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:16.476191 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:16.476191 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:16.476191 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:08:16.476191 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:08:16.476191 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:08:16.476191 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:08:16.476191 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:08:16.476191 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:08:16.476191 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 02:08:16.476191 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:16.476191 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 405/806] 10.222.0.15 () {56 vars in 1093 bytes} [Fri Aug 5 02:08:16 2022] GET /identity/v3/users/nova => generated 82 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:16.476822 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a7db8-bec6-4bb5-9f3a-faeb76508d5c None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:16.516650 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a113181-505d-43fe-9524-ec53f1ae9808 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:16.517820 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a113181-505d-43fe-9524-ec53f1ae9808 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:16.518304 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a113181-505d-43fe-9524-ec53f1ae9808 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:16.519026 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a113181-505d-43fe-9524-ec53f1ae9808 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:16.531771 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a113181-505d-43fe-9524-ec53f1ae9808 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:08:16.538723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-7a113181-505d-43fe-9524-ec53f1ae9808 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:08:16.538723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:16.538723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:16.538723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:16.538723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:16.538723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:16.538723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:16.538723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:16.538723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:16.538723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:16.538723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:16.538723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:16.538723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:08:16.538723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:08:16.538723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:08:16.538723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:08:16.539662 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:08:16.539662 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:08:16.539662 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:08:16.539662 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:08:16.539662 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:16.539662 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:16.539662 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:16.539662 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:16.539662 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:16.539662 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:16.539662 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:16.539662 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:16.539662 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:16.539662 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:16.539662 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:16.539662 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:16.540523 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:16.540523 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:16.540523 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:16.540523 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:16.540523 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:08:16.540523 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:08:16.540523 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:08:16.540523 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:08:16.540523 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:08:16.540523 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:08:16.540523 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:08:16.540523 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:16.543474 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 402/807] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Aug 5 02:08:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:16.544771 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a113181-505d-43fe-9524-ec53f1ae9808 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:16.550676 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:16.574724 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:16.596360 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45a7db8-bec6-4bb5-9f3a-faeb76508d5c None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:16.633943 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc1c61-8133-452f-ae95-f762ada30df9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:16.634631 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc1c61-8133-452f-ae95-f762ada30df9 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:16.634919 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc1c61-8133-452f-ae95-f762ada30df9 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:16.635199 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bc1c61-8133-452f-ae95-f762ada30df9 None admin] PATH_INFO: `/v3/services` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:16.635995 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc1c61-8133-452f-ae95-f762ada30df9 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:16.636307 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc1c61-8133-452f-ae95-f762ada30df9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:16.637840 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bc1c61-8133-452f-ae95-f762ada30df9 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:16.643446 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 406/808] 10.222.0.15 () {56 vars in 1124 bytes} [Fri Aug 5 02:08:16 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:16.644519 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc1c61-8133-452f-ae95-f762ada30df9 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:16.662972 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a113181-505d-43fe-9524-ec53f1ae9808 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:16.700132 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef3eae-9199-4498-8c6e-eb8261f8a552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:16.701243 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef3eae-9199-4498-8c6e-eb8261f8a552 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:16.701725 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef3eae-9199-4498-8c6e-eb8261f8a552 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:16.702196 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbef3eae-9199-4498-8c6e-eb8261f8a552 None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:16.703287 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef3eae-9199-4498-8c6e-eb8261f8a552 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:16.703794 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef3eae-9199-4498-8c6e-eb8261f8a552 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:16.705591 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbef3eae-9199-4498-8c6e-eb8261f8a552 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:16.732278 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 403/809] 10.222.0.15 () {56 vars in 1133 bytes} [Fri Aug 5 02:08:16 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:16.733602 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef3eae-9199-4498-8c6e-eb8261f8a552 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:16.756609 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bc1c61-8133-452f-ae95-f762ada30df9 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:16.784093 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:16.794820 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831212e6-c0c7-4b44-988f-c191c1504e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:16.795462 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831212e6-c0c7-4b44-988f-c191c1504e06 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:16.795748 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831212e6-c0c7-4b44-988f-c191c1504e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:16.796028 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831212e6-c0c7-4b44-988f-c191c1504e06 None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:16.796785 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831212e6-c0c7-4b44-988f-c191c1504e06 None admin] RBAC: Adding query filter params (name=service) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:16.797080 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831212e6-c0c7-4b44-988f-c191c1504e06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:16.798448 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831212e6-c0c7-4b44-988f-c191c1504e06 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:16.808386 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 407/810] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Aug 5 02:08:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:16.808386 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831212e6-c0c7-4b44-988f-c191c1504e06 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:16.825966 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:16.854310 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbef3eae-9199-4498-8c6e-eb8261f8a552 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:16.890227 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0956252b-2153-42e7-8216-774986eb0592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:16.890869 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956252b-2153-42e7-8216-774986eb0592 None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:16.891101 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956252b-2153-42e7-8216-774986eb0592 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:16.891369 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0956252b-2153-42e7-8216-774986eb0592 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:16.892073 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956252b-2153-42e7-8216-774986eb0592 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:16.893442 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0956252b-2153-42e7-8216-774986eb0592 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:16.919319 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 404/811] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:08:16 2022] POST /identity/v3/endpoints => generated 346 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:08:16.921072 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7805f7-1724-4ec7-bda2-b91f2c86847e None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:16.921387 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831212e6-c0c7-4b44-988f-c191c1504e06 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:16.921790 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7805f7-1724-4ec7-bda2-b91f2c86847e None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:16.922279 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7805f7-1724-4ec7-bda2-b91f2c86847e None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:16.929972 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 405/812] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:16 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:08:16.929972 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7805f7-1724-4ec7-bda2-b91f2c86847e None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:16.972718 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30d6d5-d6c0-48bf-a8a5-1c0d9459d646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:16.973260 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30d6d5-d6c0-48bf-a8a5-1c0d9459d646 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:16.973543 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30d6d5-d6c0-48bf-a8a5-1c0d9459d646 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:16.973820 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30d6d5-d6c0-48bf-a8a5-1c0d9459d646 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:17.052655 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:17.069403 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc30d6d5-d6c0-48bf-a8a5-1c0d9459d646 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:17.070883 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc30d6d5-d6c0-48bf-a8a5-1c0d9459d646 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:17.077150 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7805f7-1724-4ec7-bda2-b91f2c86847e None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:17.116391 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5cc0580-78d5-431d-a8b9-c4e758c2a8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:17.117080 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc0580-78d5-431d-a8b9-c4e758c2a8f0 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:17.117487 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc0580-78d5-431d-a8b9-c4e758c2a8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:17.117989 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5cc0580-78d5-431d-a8b9-c4e758c2a8f0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:17.121337 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:17.133151 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc0580-78d5-431d-a8b9-c4e758c2a8f0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:17.134645 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5cc0580-78d5-431d-a8b9-c4e758c2a8f0 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:17.153155 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-b5cc0580-78d5-431d-a8b9-c4e758c2a8f0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:17.153155 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:17.153155 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:17.153155 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:17.153155 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:17.153155 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:17.153155 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:17.153155 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:17.153155 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:17.153155 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:17.153155 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:17.153155 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:17.153155 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:08:17.153155 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:08:17.153155 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:08:17.154127 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:08:17.154127 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:17.154127 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:17.154127 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:17.154127 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:17.154127 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:17.154127 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:17.154127 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:17.154127 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:17.154127 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:17.154127 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:17.154127 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:17.154127 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:17.154127 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:17.154127 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:17.154127 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:17.154127 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:17.155007 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:08:17.155007 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:08:17.155007 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:17.155007 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:17.155007 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 406/813] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:17.160424 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd517f-ac6b-45f0-9b0d-e2060466f4c1 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:17.160714 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd517f-ac6b-45f0-9b0d-e2060466f4c1 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:17.160995 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44dd517f-ac6b-45f0-9b0d-e2060466f4c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:17.179788 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-44dd517f-ac6b-45f0-9b0d-e2060466f4c1 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:17.181023 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-44dd517f-ac6b-45f0-9b0d-e2060466f4c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:17.206433 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 408/814] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:08:16 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 398 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 02:08:17.207798 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30d6d5-d6c0-48bf-a8a5-1c0d9459d646 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:17.271284 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 407/815] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:17 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:08:17.272490 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd517f-ac6b-45f0-9b0d-e2060466f4c1 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:17.332763 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:17.340700 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc30d6d5-d6c0-48bf-a8a5-1c0d9459d646 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:17.379071 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd7b5f7-8cb4-4872-8e40-7407f39ec879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:17.379682 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7b5f7-8cb4-4872-8e40-7407f39ec879 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:17.379961 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7b5f7-8cb4-4872-8e40-7407f39ec879 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:17.381203 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7b5f7-8cb4-4872-8e40-7407f39ec879 None admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:17.382005 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd7b5f7-8cb4-4872-8e40-7407f39ec879 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:17.382309 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd7b5f7-8cb4-4872-8e40-7407f39ec879 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:17.383826 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd7b5f7-8cb4-4872-8e40-7407f39ec879 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:17.396890 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 409/816] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:17.398090 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd7b5f7-8cb4-4872-8e40-7407f39ec879 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:17.405513 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44dd517f-ac6b-45f0-9b0d-e2060466f4c1 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:17.428063 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:17.447714 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d9908-9b3e-4d68-a1c9-d307151d6f43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:17.448731 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d9908-9b3e-4d68-a1c9-d307151d6f43 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:17.449220 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d9908-9b3e-4d68-a1c9-d307151d6f43 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:17.449727 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48d9908-9b3e-4d68-a1c9-d307151d6f43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:17.461219 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d9908-9b3e-4d68-a1c9-d307151d6f43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:17.462764 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48d9908-9b3e-4d68-a1c9-d307151d6f43 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:17.479577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-e48d9908-9b3e-4d68-a1c9-d307151d6f43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:17.479577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:17.479577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:17.479577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:17.479577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:17.479577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:17.479577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:17.479577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:17.479577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:17.479577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:17.479577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:17.479577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:17.479577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:08:17.479577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:08:17.479577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:08:17.480533 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:08:17.480533 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:17.480533 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:17.480533 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:17.480533 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:17.480533 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:17.480533 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:17.480533 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:17.480533 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:17.480533 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:17.480533 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:17.480533 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:17.480533 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:17.480533 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:17.480533 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:17.480533 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:17.480533 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:17.481405 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:08:17.481405 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:08:17.481405 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:17.481405 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:17.481405 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 408/817] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:17.482118 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d9908-9b3e-4d68-a1c9-d307151d6f43 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:17.515557 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd7b5f7-8cb4-4872-8e40-7407f39ec879 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:17.557070 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b03bc4-5f02-41df-9014-9af2a31630c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:17.558257 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b03bc4-5f02-41df-9014-9af2a31630c9 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:17.558647 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b03bc4-5f02-41df-9014-9af2a31630c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:17.559148 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0b03bc4-5f02-41df-9014-9af2a31630c9 None admin] PATH_INFO: `/v3/services/network` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:17.560004 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b03bc4-5f02-41df-9014-9af2a31630c9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:17.562418 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0b03bc4-5f02-41df-9014-9af2a31630c9 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:17.574025 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-a0b03bc4-5f02-41df-9014-9af2a31630c9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 02:08:17.574025 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:17.574025 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:08:17.574025 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:08:17.574025 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:08:17.574025 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:08:17.574025 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:08:17.574025 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:08:17.574025 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 02:08:17.574025 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:17.574025 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:08:17.574025 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:17.574025 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:17.574025 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:17.574025 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:17.574025 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:17.574025 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:17.575000 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:17.575000 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:17.575000 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:17.575000 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:17.575000 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:17.575000 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:17.575000 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:08:17.575000 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:08:17.575000 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:08:17.575000 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:08:17.575000 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:17.575000 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:17.575000 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:17.575000 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:17.575000 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:17.575000 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:17.575817 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:17.575817 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:17.575817 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:17.575817 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:17.575817 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:17.575817 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:17.575817 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:17.575817 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:17.575817 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:17.575817 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:17.575817 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:08:17.575817 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:08:17.575817 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 05 02:08:17.575817 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:17.576597 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 410/818] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:08:17 2022] GET /identity/v3/services/network => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:17.577173 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b03bc4-5f02-41df-9014-9af2a31630c9 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:17.591294 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:17.594225 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48d9908-9b3e-4d68-a1c9-d307151d6f43 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:17.635397 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a6d00-30f1-4cc0-881a-e526ee35ce2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:17.636036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a6d00-30f1-4cc0-881a-e526ee35ce2d None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:17.636399 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a6d00-30f1-4cc0-881a-e526ee35ce2d None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:17.636673 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1a6d00-30f1-4cc0-881a-e526ee35ce2d None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:17.644578 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a6d00-30f1-4cc0-881a-e526ee35ce2d None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:17.646656 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1a6d00-30f1-4cc0-881a-e526ee35ce2d None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:17.658436 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-1d1a6d00-30f1-4cc0-881a-e526ee35ce2d None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 02:08:17.658436 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:17.658436 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:17.658436 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:17.658436 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:17.658436 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:17.658436 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:17.658436 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:17.658436 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:17.658436 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:17.658436 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:17.658436 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:17.658436 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:08:17.658436 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:08:17.658436 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:08:17.658436 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:08:17.659609 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:17.659609 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:17.659609 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:08:17.659609 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:08:17.659609 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:08:17.659609 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:08:17.659609 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:17.659609 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:17.659609 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:17.659609 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:17.659609 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:17.659609 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:17.659609 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:17.659609 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:17.659609 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:17.659609 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:17.659609 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:17.659609 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:17.660663 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:17.660663 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:17.660663 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:08:17.660663 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:08:17.660663 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:08:17.660663 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:08:17.660663 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:08:17.660663 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:08:17.660663 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 02:08:17.660663 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:17.660663 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 409/819] 10.222.0.15 () {56 vars in 1117 bytes} [Fri Aug 5 02:08:17 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:17.661370 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a6d00-30f1-4cc0-881a-e526ee35ce2d None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:17.695393 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:17.712974 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0b03bc4-5f02-41df-9014-9af2a31630c9 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:17.761056 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b0444-cf67-4dbc-b5ad-a67f449b8467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:17.761772 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b0444-cf67-4dbc-b5ad-a67f449b8467 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:17.762057 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b0444-cf67-4dbc-b5ad-a67f449b8467 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:17.762329 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1b0444-cf67-4dbc-b5ad-a67f449b8467 None admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:17.763111 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b0444-cf67-4dbc-b5ad-a67f449b8467 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:17.763471 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b0444-cf67-4dbc-b5ad-a67f449b8467 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:17.764908 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1b0444-cf67-4dbc-b5ad-a67f449b8467 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:17.780987 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1a6d00-30f1-4cc0-881a-e526ee35ce2d None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:17.783172 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 411/820] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:17.784385 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b0444-cf67-4dbc-b5ad-a67f449b8467 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:17.826949 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022395c-534b-401e-8f75-0ee7bb86ded0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:17.828310 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022395c-534b-401e-8f75-0ee7bb86ded0 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:17.828903 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022395c-534b-401e-8f75-0ee7bb86ded0 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:17.829328 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a022395c-534b-401e-8f75-0ee7bb86ded0 None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:17.830159 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022395c-534b-401e-8f75-0ee7bb86ded0 None admin] RBAC: Adding query filter params (name=network) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:17.834523 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022395c-534b-401e-8f75-0ee7bb86ded0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:17.836813 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a022395c-534b-401e-8f75-0ee7bb86ded0 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:17.843163 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 410/821] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Aug 5 02:08:17 2022] GET /identity/v3/services?name=network => generated 124 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:17.844570 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022395c-534b-401e-8f75-0ee7bb86ded0 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:17.866011 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:17.905303 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1b0444-cf67-4dbc-b5ad-a67f449b8467 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:17.946028 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f32114-c3c1-4563-bb4b-c35c3c3fef79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:17.947025 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f32114-c3c1-4563-bb4b-c35c3c3fef79 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:17.947535 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f32114-c3c1-4563-bb4b-c35c3c3fef79 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:17.948030 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f32114-c3c1-4563-bb4b-c35c3c3fef79 None admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:17.949069 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f32114-c3c1-4563-bb4b-c35c3c3fef79 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:17.949583 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f32114-c3c1-4563-bb4b-c35c3c3fef79 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:17.951214 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f32114-c3c1-4563-bb4b-c35c3c3fef79 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:17.964034 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:17.971411 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 412/822] 10.222.0.15 () {56 vars in 1149 bytes} [Fri Aug 5 02:08:17 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:17.971929 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a022395c-534b-401e-8f75-0ee7bb86ded0 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:17.972886 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f32114-c3c1-4563-bb4b-c35c3c3fef79 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:18.009046 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822a3be-62b3-4886-b991-d0124e2cebf4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:18.009690 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822a3be-62b3-4886-b991-d0124e2cebf4 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:18.009969 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822a3be-62b3-4886-b991-d0124e2cebf4 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:18.010242 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a822a3be-62b3-4886-b991-d0124e2cebf4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:18.017439 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a822a3be-62b3-4886-b991-d0124e2cebf4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:18.018893 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a822a3be-62b3-4886-b991-d0124e2cebf4 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:18.031530 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-a822a3be-62b3-4886-b991-d0124e2cebf4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:08:18.031530 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:18.031530 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:18.031530 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:18.031530 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:18.031530 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:18.031530 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:18.031530 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:18.031530 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:18.031530 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:18.031530 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:18.031530 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:18.031530 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:08:18.031530 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:08:18.031530 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:08:18.032517 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:08:18.032517 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:18.032517 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:18.032517 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:18.032517 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:18.032517 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:18.032517 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:18.032517 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:18.032517 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:18.032517 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:18.032517 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:18.032517 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:18.032517 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:18.032517 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:18.032517 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:18.032517 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:18.032517 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:18.033432 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:08:18.033432 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:08:18.033432 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:08:18.033432 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:08:18.033432 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:08:18.033432 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:08:18.033432 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:08:18.033432 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:18.037488 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 411/823] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:08:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:18.038621 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822a3be-62b3-4886-b991-d0124e2cebf4 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:18.085155 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f32114-c3c1-4563-bb4b-c35c3c3fef79 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:18.112744 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:18.123519 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94198a00-c1b7-41f1-96aa-7d2f8253b69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:18.124513 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94198a00-c1b7-41f1-96aa-7d2f8253b69f None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:18.125008 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94198a00-c1b7-41f1-96aa-7d2f8253b69f None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:18.125510 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94198a00-c1b7-41f1-96aa-7d2f8253b69f None admin] PATH_INFO: `/v3/services` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:18.126412 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94198a00-c1b7-41f1-96aa-7d2f8253b69f None admin] RBAC: Adding query filter params (type=network) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:18.126920 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94198a00-c1b7-41f1-96aa-7d2f8253b69f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:18.128528 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94198a00-c1b7-41f1-96aa-7d2f8253b69f None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:18.134312 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 413/824] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Aug 5 02:08:17 2022] GET /identity/v3/services?type=network => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:18.135358 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94198a00-c1b7-41f1-96aa-7d2f8253b69f None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:18.148187 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a822a3be-62b3-4886-b991-d0124e2cebf4 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:18.188134 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3175b61-61ca-4c10-979a-87e7371a0063 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:18.189134 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3175b61-61ca-4c10-979a-87e7371a0063 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:18.189516 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3175b61-61ca-4c10-979a-87e7371a0063 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:18.189882 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3175b61-61ca-4c10-979a-87e7371a0063 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:18.203035 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3175b61-61ca-4c10-979a-87e7371a0063 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:18.204838 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3175b61-61ca-4c10-979a-87e7371a0063 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:18.221038 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-b3175b61-61ca-4c10-979a-87e7371a0063 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:18.221038 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:18.221038 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:18.221038 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:18.221038 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:18.221038 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:18.221038 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:18.221038 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:18.221038 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:18.221038 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:18.221038 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:18.221038 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:18.221038 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:08:18.221038 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:08:18.221038 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:08:18.222036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:08:18.222036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:18.222036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:18.222036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:18.222036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:18.222036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:18.222036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:18.222036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:18.222036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:18.222036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:18.222036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:18.222036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:18.222036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:18.222036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:18.222036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:18.222036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:18.222036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:18.222925 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:08:18.222925 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:08:18.222925 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:18.222925 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:18.222925 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 412/825] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:18.223595 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3175b61-61ca-4c10-979a-87e7371a0063 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:18.234993 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:18.248376 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94198a00-c1b7-41f1-96aa-7d2f8253b69f None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:18.285138 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb351f27-7113-4eb3-b47c-0ebe8c37ecb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:18.285748 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb351f27-7113-4eb3-b47c-0ebe8c37ecb4 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:18.286016 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb351f27-7113-4eb3-b47c-0ebe8c37ecb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:18.287233 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb351f27-7113-4eb3-b47c-0ebe8c37ecb4 None admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:18.287986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb351f27-7113-4eb3-b47c-0ebe8c37ecb4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:18.288288 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb351f27-7113-4eb3-b47c-0ebe8c37ecb4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:18.289792 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb351f27-7113-4eb3-b47c-0ebe8c37ecb4 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:18.301611 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 414/826] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Aug 5 02:08:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:18.302952 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb351f27-7113-4eb3-b47c-0ebe8c37ecb4 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:18.339453 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3175b61-61ca-4c10-979a-87e7371a0063 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:18.356932 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:18.378648 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d9707-ad9a-4ae1-a29e-6d500b206900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:18.379506 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d9707-ad9a-4ae1-a29e-6d500b206900 None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:18.380521 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d9707-ad9a-4ae1-a29e-6d500b206900 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:18.381052 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d9707-ad9a-4ae1-a29e-6d500b206900 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:18.381943 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d9707-ad9a-4ae1-a29e-6d500b206900 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:18.383620 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d9707-ad9a-4ae1-a29e-6d500b206900 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:18.405257 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 413/827] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:08:18 2022] POST /identity/v3/endpoints => generated 337 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:08:18.406731 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266f6d6-8db5-4da3-a058-4a49347fd90f None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:18.407019 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266f6d6-8db5-4da3-a058-4a49347fd90f None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:18.407298 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2266f6d6-8db5-4da3-a058-4a49347fd90f None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:18.408791 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 414/828] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:08:18.409299 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266f6d6-8db5-4da3-a058-4a49347fd90f None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:18.415170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb351f27-7113-4eb3-b47c-0ebe8c37ecb4 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:18.475210 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ca38a5-887c-4916-8bd2-2422f507d8bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:18.476276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca38a5-887c-4916-8bd2-2422f507d8bd None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:18.476667 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca38a5-887c-4916-8bd2-2422f507d8bd None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:18.477035 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ca38a5-887c-4916-8bd2-2422f507d8bd None admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:18.477831 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca38a5-887c-4916-8bd2-2422f507d8bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:18.478263 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca38a5-887c-4916-8bd2-2422f507d8bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:18.480667 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89ca38a5-887c-4916-8bd2-2422f507d8bd None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:18.495792 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 415/829] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:08:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:18.497291 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05305b8-9437-49e5-b34b-fad395d8ff2e None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:18.497661 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05305b8-9437-49e5-b34b-fad395d8ff2e None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:18.498206 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05305b8-9437-49e5-b34b-fad395d8ff2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:18.501229 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:18.518948 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-c05305b8-9437-49e5-b34b-fad395d8ff2e None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:18.520354 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-c05305b8-9437-49e5-b34b-fad395d8ff2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:18.554068 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2266f6d6-8db5-4da3-a058-4a49347fd90f None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:18.597412 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2344b91-0595-494d-8f95-c3aedfbffe97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:18.598322 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2344b91-0595-494d-8f95-c3aedfbffe97 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:18.599461 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2344b91-0595-494d-8f95-c3aedfbffe97 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:18.600262 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 416/830] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:18 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:08:18.600887 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2344b91-0595-494d-8f95-c3aedfbffe97 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:18.601196 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05305b8-9437-49e5-b34b-fad395d8ff2e None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:18.602171 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2344b91-0595-494d-8f95-c3aedfbffe97 None admin] RBAC: Adding query filter params (role.id=e1b75d5eea2a43b2b1b14cf0515350fa, scope.project.id=95d88dece7184bf1842c4f8d275d52cd, user.id=4b5c0958604b436daa44b1f67c9dec26) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:18.602666 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2344b91-0595-494d-8f95-c3aedfbffe97 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:18.604746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2344b91-0595-494d-8f95-c3aedfbffe97 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:18.612447 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 415/831] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:08:18 2022] GET /identity/v3/role_assignments?user.id=4b5c0958604b436daa44b1f67c9dec26&scope.project.id=95d88dece7184bf1842c4f8d275d52cd&role.id=e1b75d5eea2a43b2b1b14cf0515350fa => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:18.635632 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2344b91-0595-494d-8f95-c3aedfbffe97 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:18.648353 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:18.740543 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05305b8-9437-49e5-b34b-fad395d8ff2e None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:18.788622 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8771848-df82-4147-a9fe-bfb7c5b554d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:18.789591 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2344b91-0595-494d-8f95-c3aedfbffe97 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:18.789731 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8771848-df82-4147-a9fe-bfb7c5b554d9 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:18.790178 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8771848-df82-4147-a9fe-bfb7c5b554d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:18.790640 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8771848-df82-4147-a9fe-bfb7c5b554d9 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:18.799041 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8771848-df82-4147-a9fe-bfb7c5b554d9 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:18.800950 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8771848-df82-4147-a9fe-bfb7c5b554d9 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:18.815324 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-f8771848-df82-4147-a9fe-bfb7c5b554d9 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:08:18.815324 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:18.815324 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:18.815324 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:18.815324 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:18.815324 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:18.815324 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:18.815324 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:18.815324 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:18.815324 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:18.815324 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:18.815324 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:18.815324 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:08:18.815324 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:08:18.815324 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:08:18.816267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:08:18.816267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:18.816267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:18.816267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:18.816267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:18.816267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:18.816267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:18.816267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:18.816267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:18.816267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:18.816267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:18.816267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:18.816267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:18.816267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:18.816267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:18.816267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:18.816267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:18.817201 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:08:18.817201 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:08:18.817201 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:08:18.817201 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:08:18.817201 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:08:18.817201 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:08:18.817201 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:08:18.817201 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:18.820098 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:18.821472 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 417/832] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:08:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:18.826672 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8771848-df82-4147-a9fe-bfb7c5b554d9 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:18.846919 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce62624-18a5-4902-81f8-13b0877d4970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:18.847727 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce62624-18a5-4902-81f8-13b0877d4970 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:18.847949 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce62624-18a5-4902-81f8-13b0877d4970 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:18.848218 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce62624-18a5-4902-81f8-13b0877d4970 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:18.861926 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce62624-18a5-4902-81f8-13b0877d4970 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:08:18.869161 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-4ce62624-18a5-4902-81f8-13b0877d4970 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:08:18.869161 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:18.869161 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:18.869161 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:18.869161 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:18.869161 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:18.869161 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:18.869161 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:18.869161 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:18.869161 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:18.869161 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:18.869161 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:18.869161 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:08:18.869161 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:08:18.869161 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:08:18.869161 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:08:18.870141 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:08:18.870141 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:08:18.870141 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:08:18.870141 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:08:18.870141 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:18.870141 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:18.870141 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:18.870141 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:18.870141 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:18.870141 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:18.870141 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:18.870141 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:18.870141 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:18.870141 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:18.870141 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:18.870141 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:18.871395 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:18.871395 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:18.871395 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:18.871395 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:18.871395 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:08:18.871395 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:08:18.871395 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:08:18.871395 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:08:18.871395 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:08:18.871395 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:08:18.871395 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:08:18.871395 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:18.871395 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 416/833] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Aug 5 02:08:18 2022] GET /identity/v3/roles/admin => generated 83 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:08:18.876173 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce62624-18a5-4902-81f8-13b0877d4970 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:18.967280 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:18.975226 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8771848-df82-4147-a9fe-bfb7c5b554d9 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:18.993564 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce62624-18a5-4902-81f8-13b0877d4970 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:19.013369 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a56207-fd9e-4b86-8273-07346d876443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:19.013991 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a56207-fd9e-4b86-8273-07346d876443 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:19.014270 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a56207-fd9e-4b86-8273-07346d876443 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:19.014544 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a56207-fd9e-4b86-8273-07346d876443 None admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:19.015394 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a56207-fd9e-4b86-8273-07346d876443 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:19.015703 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a56207-fd9e-4b86-8273-07346d876443 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:19.017157 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a56207-fd9e-4b86-8273-07346d876443 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:19.029908 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0996c-1c70-4f02-94d1-5ca40af75bcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:19.030539 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 418/834] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Aug 5 02:08:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:19.030653 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0996c-1c70-4f02-94d1-5ca40af75bcf None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:19.030972 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0996c-1c70-4f02-94d1-5ca40af75bcf None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:19.031325 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac0996c-1c70-4f02-94d1-5ca40af75bcf None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:19.032124 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0996c-1c70-4f02-94d1-5ca40af75bcf None admin] RBAC: Adding query filter params (name=admin) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:19.032520 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0996c-1c70-4f02-94d1-5ca40af75bcf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:19.033957 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac0996c-1c70-4f02-94d1-5ca40af75bcf None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:19.036802 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a56207-fd9e-4b86-8273-07346d876443 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:19.044134 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 417/835] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:08:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:19.049805 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0996c-1c70-4f02-94d1-5ca40af75bcf None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:19.101768 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:19.148755 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a56207-fd9e-4b86-8273-07346d876443 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:19.155423 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac0996c-1c70-4f02-94d1-5ca40af75bcf None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:19.187121 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de69833c-85b9-451f-8a9e-c781723d22d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:19.187780 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69833c-85b9-451f-8a9e-c781723d22d1 None admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:19.188054 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69833c-85b9-451f-8a9e-c781723d22d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:19.188438 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de69833c-85b9-451f-8a9e-c781723d22d1 None admin] PATH_INFO: `/v3/projects/95d88dece7184bf1842c4f8d275d52cd/users/36970f0778384576b599cd7217b5084d/roles/876fd0d181d74df4bbc73b2db1c42fbe` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:19.197195 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba917f-d3c1-43f2-9560-fbe67c6c99a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:19.197852 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba917f-d3c1-43f2-9560-fbe67c6c99a8 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:19.198289 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba917f-d3c1-43f2-9560-fbe67c6c99a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:19.198702 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ba917f-d3c1-43f2-9560-fbe67c6c99a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:19.203766 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69833c-85b9-451f-8a9e-c781723d22d1 None admin] RBAC: Authorizing `identity:create_grant(project_id=95d88dece7184bf1842c4f8d275d52cd, user_id=36970f0778384576b599cd7217b5084d, role_id=876fd0d181d74df4bbc73b2db1c42fbe)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:19.205265 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de69833c-85b9-451f-8a9e-c781723d22d1 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:19.210945 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba917f-d3c1-43f2-9560-fbe67c6c99a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:19.212673 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7ba917f-d3c1-43f2-9560-fbe67c6c99a8 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:19.221558 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 419/836] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Aug 5 02:08:19 2022] PUT /identity/v3/projects/95d88dece7184bf1842c4f8d275d52cd/users/36970f0778384576b599cd7217b5084d/roles/876fd0d181d74df4bbc73b2db1c42fbe => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:08:19.222902 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f87bb-9506-4fe4-9caf-49ef63b2384b None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:19.223262 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f87bb-9506-4fe4-9caf-49ef63b2384b None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:19.223632 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f87bb-9506-4fe4-9caf-49ef63b2384b None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:19.228371 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 420/837] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:08:19.231466 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66b176-9b75-40b3-87d9-ee3a3db32f40 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:19.231750 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66b176-9b75-40b3-87d9-ee3a3db32f40 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:19.232025 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66b176-9b75-40b3-87d9-ee3a3db32f40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:19.239280 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-e7ba917f-d3c1-43f2-9560-fbe67c6c99a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:19.239280 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:19.239280 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:19.239280 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:19.239280 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:19.239280 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:19.239280 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:19.239280 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:19.239280 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:19.239280 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:19.239280 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:19.239280 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:19.239280 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:08:19.239280 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:08:19.239280 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:08:19.241098 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:08:19.241098 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:19.241098 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:19.241098 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:19.241098 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:19.241098 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:19.241098 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:19.241098 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:19.241098 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:19.241098 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:19.241098 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:19.241098 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:19.241098 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:19.241098 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:19.241098 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:19.241098 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:19.241098 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:19.242059 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:08:19.242059 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:08:19.242059 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:19.242059 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:19.248503 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 418/838] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:19.249584 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba917f-d3c1-43f2-9560-fbe67c6c99a8 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:19.251342 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:19.265893 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-0b66b176-9b75-40b3-87d9-ee3a3db32f40 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:19.267830 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-0b66b176-9b75-40b3-87d9-ee3a3db32f40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:19.356846 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 421/839] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:19 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:08:19.375361 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ba917f-d3c1-43f2-9560-fbe67c6c99a8 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:19.375361 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:19.384878 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66b176-9b75-40b3-87d9-ee3a3db32f40 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:19.405584 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ed0c1-2a9f-40ef-8ed8-91c3976a691d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:19.406208 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ed0c1-2a9f-40ef-8ed8-91c3976a691d None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:19.406491 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ed0c1-2a9f-40ef-8ed8-91c3976a691d None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:19.406768 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6ed0c1-2a9f-40ef-8ed8-91c3976a691d None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:19.407469 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6ed0c1-2a9f-40ef-8ed8-91c3976a691d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:19.407777 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6ed0c1-2a9f-40ef-8ed8-91c3976a691d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:19.409185 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6ed0c1-2a9f-40ef-8ed8-91c3976a691d None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:19.422781 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 419/840] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:08:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:19.428678 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ed0c1-2a9f-40ef-8ed8-91c3976a691d None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:19.501908 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66b176-9b75-40b3-87d9-ee3a3db32f40 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:19.539791 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72356941-8473-4f3e-ba9b-04ea7b514c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:19.540605 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72356941-8473-4f3e-ba9b-04ea7b514c62 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:19.540804 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72356941-8473-4f3e-ba9b-04ea7b514c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:19.541134 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72356941-8473-4f3e-ba9b-04ea7b514c62 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:19.541773 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72356941-8473-4f3e-ba9b-04ea7b514c62 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:19.543148 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72356941-8473-4f3e-ba9b-04ea7b514c62 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:19.545878 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:19.549235 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6ed0c1-2a9f-40ef-8ed8-91c3976a691d None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:19.552920 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-72356941-8473-4f3e-ba9b-04ea7b514c62 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 02:08:19.552920 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:19.552920 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:08:19.552920 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:08:19.552920 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:08:19.552920 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:08:19.552920 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:08:19.552920 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:08:19.552920 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 02:08:19.552920 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:19.552920 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:08:19.552920 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:19.552920 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:19.552920 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:19.552920 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:19.552920 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:19.552920 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:19.553900 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:19.553900 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:19.553900 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:19.553900 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:19.553900 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:19.553900 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:19.553900 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:08:19.553900 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:08:19.553900 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:08:19.553900 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:08:19.553900 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:19.553900 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:19.553900 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:19.553900 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:19.553900 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:19.553900 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:19.554756 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:19.554756 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:19.554756 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:19.554756 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:19.554756 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:19.554756 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:19.554756 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:19.554756 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:19.554756 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:19.554756 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:19.554756 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:08:19.554756 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:08:19.554756 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 02:08:19.554756 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:19.554756 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 422/841] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Aug 5 02:08:19 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:08:19.561924 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72356941-8473-4f3e-ba9b-04ea7b514c62 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:19.590288 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ebf5c-a2f4-4966-b285-5a0d93c7a0a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:19.591272 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ebf5c-a2f4-4966-b285-5a0d93c7a0a0 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:19.591779 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ebf5c-a2f4-4966-b285-5a0d93c7a0a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:19.592252 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5ebf5c-a2f4-4966-b285-5a0d93c7a0a0 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:19.601598 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5ebf5c-a2f4-4966-b285-5a0d93c7a0a0 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:19.603325 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5ebf5c-a2f4-4966-b285-5a0d93c7a0a0 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:19.615982 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-2b5ebf5c-a2f4-4966-b285-5a0d93c7a0a0 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 05 02:08:19.615982 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:19.615982 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:19.615982 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:19.615982 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:19.615982 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:19.615982 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:19.615982 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:19.615982 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:19.615982 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:19.615982 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:19.615982 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:19.615982 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:08:19.615982 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:08:19.615982 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:08:19.615982 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:08:19.616959 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:19.616959 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:19.616959 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:08:19.616959 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:08:19.616959 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:08:19.616959 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:08:19.616959 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:19.616959 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:19.616959 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:19.616959 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:19.616959 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:19.616959 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:19.616959 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:19.616959 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:19.616959 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:19.616959 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:19.616959 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:19.616959 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:19.617896 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:19.617896 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:19.617896 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:08:19.617896 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:08:19.617896 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:08:19.617896 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:08:19.617896 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:08:19.617896 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:08:19.617896 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 05 02:08:19.617896 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:19.624565 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 420/842] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Aug 5 02:08:19 2022] GET /identity/v3/users/swift => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:08:19.626258 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ebf5c-a2f4-4966-b285-5a0d93c7a0a0 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:19.649836 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:19.676062 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72356941-8473-4f3e-ba9b-04ea7b514c62 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:19.714763 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da340aa-9d01-4a75-9023-d83c5da5885e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:19.715496 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da340aa-9d01-4a75-9023-d83c5da5885e None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:19.715786 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da340aa-9d01-4a75-9023-d83c5da5885e None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:19.716067 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da340aa-9d01-4a75-9023-d83c5da5885e None admin] PATH_INFO: `/v3/services` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:19.717091 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da340aa-9d01-4a75-9023-d83c5da5885e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:19.717220 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da340aa-9d01-4a75-9023-d83c5da5885e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:19.718590 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da340aa-9d01-4a75-9023-d83c5da5885e None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:19.728157 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 423/843] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Aug 5 02:08:19 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:19.731013 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da340aa-9d01-4a75-9023-d83c5da5885e None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:19.741848 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5ebf5c-a2f4-4966-b285-5a0d93c7a0a0 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:19.788253 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf4799-032a-4985-a6b7-736993f4fca0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:19.788916 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf4799-032a-4985-a6b7-736993f4fca0 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:19.789801 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf4799-032a-4985-a6b7-736993f4fca0 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:19.790083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bf4799-032a-4985-a6b7-736993f4fca0 None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:19.791175 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf4799-032a-4985-a6b7-736993f4fca0 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:19.791482 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf4799-032a-4985-a6b7-736993f4fca0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:19.793955 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bf4799-032a-4985-a6b7-736993f4fca0 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:19.799581 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:19.819179 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 421/844] 10.222.0.15 () {56 vars in 1135 bytes} [Fri Aug 5 02:08:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:19.824415 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf4799-032a-4985-a6b7-736993f4fca0 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:19.852910 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da340aa-9d01-4a75-9023-d83c5da5885e None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:19.891304 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a464e-613b-452c-ac15-add2149a9f3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:19.891852 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a464e-613b-452c-ac15-add2149a9f3a None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:19.892131 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a464e-613b-452c-ac15-add2149a9f3a None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:19.892437 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85a464e-613b-452c-ac15-add2149a9f3a None admin] PATH_INFO: `/v3/services` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:19.893118 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85a464e-613b-452c-ac15-add2149a9f3a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:19.893419 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85a464e-613b-452c-ac15-add2149a9f3a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:19.895339 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85a464e-613b-452c-ac15-add2149a9f3a None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:19.904411 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 424/845] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Aug 5 02:08:19 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:19.931968 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:19.959052 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bf4799-032a-4985-a6b7-736993f4fca0 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:19.998465 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c305e73-1420-4ccc-8e36-5d152a54aab0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:19.999882 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c305e73-1420-4ccc-8e36-5d152a54aab0 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:20.000317 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c305e73-1420-4ccc-8e36-5d152a54aab0 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:20.000780 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c305e73-1420-4ccc-8e36-5d152a54aab0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:20.081388 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c305e73-1420-4ccc-8e36-5d152a54aab0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:20.082838 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c305e73-1420-4ccc-8e36-5d152a54aab0 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:20.172880 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:20.185084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 422/846] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:08:19 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 02:08:20.190739 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a464e-613b-452c-ac15-add2149a9f3a None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:20.301068 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85a464e-613b-452c-ac15-add2149a9f3a None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:20.328374 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:20.337698 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fdbbba-9b32-4cd7-b43e-3010e6ecbb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:20.338346 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fdbbba-9b32-4cd7-b43e-3010e6ecbb1b None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:20.338683 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fdbbba-9b32-4cd7-b43e-3010e6ecbb1b None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:20.338962 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24fdbbba-9b32-4cd7-b43e-3010e6ecbb1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:20.352144 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fdbbba-9b32-4cd7-b43e-3010e6ecbb1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:20.353625 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24fdbbba-9b32-4cd7-b43e-3010e6ecbb1b None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:20.370487 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-24fdbbba-9b32-4cd7-b43e-3010e6ecbb1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:20.370487 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:20.370487 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:20.370487 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:20.370487 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:20.370487 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:20.370487 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:20.370487 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:20.370487 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:20.370487 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:20.370487 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:20.370487 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:20.370487 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:08:20.370487 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:08:20.370487 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:08:20.371448 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:08:20.371448 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:20.371448 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:20.371448 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:20.371448 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:20.371448 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:20.371448 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:20.371448 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:20.371448 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:20.371448 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:20.371448 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:20.371448 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:20.371448 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:20.371448 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:20.371448 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:20.371448 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:20.371448 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:20.372395 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:08:20.372395 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:08:20.372395 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:20.372395 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:20.372395 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 425/847] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:20.377362 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c305e73-1420-4ccc-8e36-5d152a54aab0 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:20.483983 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c305e73-1420-4ccc-8e36-5d152a54aab0 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:20.519406 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e274684-5086-4a8c-b94f-1419f69b73eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:20.520102 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e274684-5086-4a8c-b94f-1419f69b73eb None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:20.520414 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e274684-5086-4a8c-b94f-1419f69b73eb None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:20.521248 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e274684-5086-4a8c-b94f-1419f69b73eb None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:20.522217 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e274684-5086-4a8c-b94f-1419f69b73eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:20.522522 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e274684-5086-4a8c-b94f-1419f69b73eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:20.523871 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e274684-5086-4a8c-b94f-1419f69b73eb None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:20.535841 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 423/848] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:08:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:20.543529 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fdbbba-9b32-4cd7-b43e-3010e6ecbb1b None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:20.650082 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24fdbbba-9b32-4cd7-b43e-3010e6ecbb1b None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:20.689187 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbae57a-f08d-4a79-8dcb-f7174462b494 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:20.689828 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbae57a-f08d-4a79-8dcb-f7174462b494 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:20.690109 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbae57a-f08d-4a79-8dcb-f7174462b494 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:20.690385 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbae57a-f08d-4a79-8dcb-f7174462b494 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:20.698547 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbae57a-f08d-4a79-8dcb-f7174462b494 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:20.699995 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbae57a-f08d-4a79-8dcb-f7174462b494 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:20.712519 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-cdbae57a-f08d-4a79-8dcb-f7174462b494 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:08:20.712519 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:20.712519 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:20.712519 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:20.712519 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:20.712519 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:20.712519 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:20.712519 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:20.712519 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:20.712519 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:20.712519 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:20.712519 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:20.712519 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:08:20.712519 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:08:20.712519 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:08:20.713453 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:08:20.713453 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:20.713453 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:20.713453 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:20.713453 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:20.713453 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:20.713453 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:20.713453 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:20.713453 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:20.713453 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:20.713453 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:20.713453 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:20.713453 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:20.713453 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:20.713453 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:20.713453 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:20.713453 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:20.714349 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:08:20.714349 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:08:20.714349 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:08:20.714349 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:08:20.714349 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:08:20.714349 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:08:20.714349 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:08:20.714349 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:20.714349 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 426/849] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:08:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:20.719850 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e274684-5086-4a8c-b94f-1419f69b73eb None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:20.764774 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:20.830938 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e274684-5086-4a8c-b94f-1419f69b73eb None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:20.869565 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf65441-654f-4da2-b3c5-dda6604117e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:20.870191 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf65441-654f-4da2-b3c5-dda6604117e7 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:20.870471 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf65441-654f-4da2-b3c5-dda6604117e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:20.870742 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf65441-654f-4da2-b3c5-dda6604117e7 None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:20.871491 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf65441-654f-4da2-b3c5-dda6604117e7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:20.871802 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf65441-654f-4da2-b3c5-dda6604117e7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:20.873295 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf65441-654f-4da2-b3c5-dda6604117e7 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:20.885919 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 424/850] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Aug 5 02:08:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:20.892077 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbae57a-f08d-4a79-8dcb-f7174462b494 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:20.937851 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:20.995952 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387b696-0d9a-4667-baac-d6c827437ee9 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:20.996270 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387b696-0d9a-4667-baac-d6c827437ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:20.997717 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2387b696-0d9a-4667-baac-d6c827437ee9 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:20.998904 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 425/851] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:08:21.003621 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e4d7d-94c3-4169-9d0d-c86a053ad3c8 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:21.003907 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e4d7d-94c3-4169-9d0d-c86a053ad3c8 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:21.004184 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48e4d7d-94c3-4169-9d0d-c86a053ad3c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:21.007449 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbae57a-f08d-4a79-8dcb-f7174462b494 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:21.023738 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-a48e4d7d-94c3-4169-9d0d-c86a053ad3c8 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:21.024948 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-a48e4d7d-94c3-4169-9d0d-c86a053ad3c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:21.046613 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d804f02-0a80-482d-8381-6713701f26c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:21.047601 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d804f02-0a80-482d-8381-6713701f26c6 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:21.047955 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d804f02-0a80-482d-8381-6713701f26c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:21.048301 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d804f02-0a80-482d-8381-6713701f26c6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:21.049211 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d804f02-0a80-482d-8381-6713701f26c6 None admin] RBAC: Adding query filter params (role.id=e1b75d5eea2a43b2b1b14cf0515350fa, scope.project.id=95d88dece7184bf1842c4f8d275d52cd, user.id=f03233b0ee3540cdb5105f6603cfdff5) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:21.049589 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d804f02-0a80-482d-8381-6713701f26c6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:21.051095 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d804f02-0a80-482d-8381-6713701f26c6 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:21.058745 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 427/852] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:08:20 2022] GET /identity/v3/role_assignments?user.id=f03233b0ee3540cdb5105f6603cfdff5&scope.project.id=95d88dece7184bf1842c4f8d275d52cd&role.id=e1b75d5eea2a43b2b1b14cf0515350fa => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:21.116245 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 426/853] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:21 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 02:08:21.139363 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d804f02-0a80-482d-8381-6713701f26c6 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:21.257462 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d804f02-0a80-482d-8381-6713701f26c6 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:21.260766 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:21.296022 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb3e163-74e3-4fcc-aabd-b0737a8a1e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:21.296616 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3e163-74e3-4fcc-aabd-b0737a8a1e35 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:21.296898 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3e163-74e3-4fcc-aabd-b0737a8a1e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:21.297170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb3e163-74e3-4fcc-aabd-b0737a8a1e35 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:21.297800 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb3e163-74e3-4fcc-aabd-b0737a8a1e35 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:21.299163 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb3e163-74e3-4fcc-aabd-b0737a8a1e35 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:21.309222 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-abb3e163-74e3-4fcc-aabd-b0737a8a1e35 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 02:08:21.309222 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:21.309222 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:08:21.309222 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:08:21.309222 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:08:21.309222 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:08:21.309222 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:08:21.309222 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:08:21.309222 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 02:08:21.309222 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:21.309222 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:08:21.309222 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:21.309222 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:21.309222 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:21.309222 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:21.309222 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:21.310170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:21.310170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:21.310170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:21.310170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:21.310170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:21.310170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:21.310170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:21.310170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:08:21.310170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:08:21.310170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:08:21.310170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:08:21.310170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:21.310170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:21.310170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:21.310170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:21.310170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:21.311021 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:21.311021 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:21.311021 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:21.311021 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:21.311021 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:21.311021 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:21.311021 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:21.311021 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:21.311021 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:21.311021 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:21.311021 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:21.311021 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:08:21.311021 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:08:21.311021 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 02:08:21.311021 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:21.314794 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 428/854] 10.222.0.15 () {56 vars in 1132 bytes} [Fri Aug 5 02:08:21 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:21.316741 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e4d7d-94c3-4169-9d0d-c86a053ad3c8 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:21.321323 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb7a69-ae6c-4a59-9c98-a06b6298334a None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:21.321608 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb7a69-ae6c-4a59-9c98-a06b6298334a None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:21.321885 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fb7a69-ae6c-4a59-9c98-a06b6298334a None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:21.323438 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 429/855] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:08:21.328203 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd68ef-c73b-45c3-aeb8-abdecb8a3e1a None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:21.328514 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd68ef-c73b-45c3-aeb8-abdecb8a3e1a None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:21.328787 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47fd68ef-c73b-45c3-aeb8-abdecb8a3e1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:21.347366 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-47fd68ef-c73b-45c3-aeb8-abdecb8a3e1a None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:21.348600 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-47fd68ef-c73b-45c3-aeb8-abdecb8a3e1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:21.353538 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:21.432406 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 430/856] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:21 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 02:08:21.444709 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48e4d7d-94c3-4169-9d0d-c86a053ad3c8 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:21.455649 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd68ef-c73b-45c3-aeb8-abdecb8a3e1a None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:21.484527 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7f040-78e1-4b96-a384-b8a67212de71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:21.485606 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7f040-78e1-4b96-a384-b8a67212de71 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:21.486113 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7f040-78e1-4b96-a384-b8a67212de71 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:21.486715 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ab7f040-78e1-4b96-a384-b8a67212de71 None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:21.487686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab7f040-78e1-4b96-a384-b8a67212de71 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:21.488185 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab7f040-78e1-4b96-a384-b8a67212de71 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:21.489841 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ab7f040-78e1-4b96-a384-b8a67212de71 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:21.499916 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 427/857] 10.222.0.15 () {56 vars in 1126 bytes} [Fri Aug 5 02:08:21 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:21.501077 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7f040-78e1-4b96-a384-b8a67212de71 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:21.556727 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:21.560446 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47fd68ef-c73b-45c3-aeb8-abdecb8a3e1a None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:21.598408 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d226e2-9eda-42f4-950e-8d843860eadc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:21.599406 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d226e2-9eda-42f4-950e-8d843860eadc None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:21.599666 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d226e2-9eda-42f4-950e-8d843860eadc None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:21.599937 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d226e2-9eda-42f4-950e-8d843860eadc None admin] PATH_INFO: `/v3/roles/service` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:21.604861 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:21.611554 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d226e2-9eda-42f4-950e-8d843860eadc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:08:21.615836 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ab7f040-78e1-4b96-a384-b8a67212de71 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:21.619044 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-06d226e2-9eda-42f4-950e-8d843860eadc None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:08:21.619044 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:21.619044 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:21.619044 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:21.619044 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:21.619044 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:21.619044 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:21.619044 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:21.619044 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:21.619044 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:21.619044 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:21.619044 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:21.619044 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:08:21.619044 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:08:21.619044 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:08:21.619044 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:08:21.625116 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:08:21.625116 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:08:21.625116 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:08:21.625116 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:08:21.625116 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:21.625116 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:21.625116 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:21.625116 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:21.625116 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:21.625116 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:21.625116 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:21.625116 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:21.625116 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:21.625116 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:21.625116 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:21.625116 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:21.625982 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:21.625982 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:21.625982 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:21.625982 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:21.625982 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:08:21.625982 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:08:21.625982 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:08:21.625982 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:08:21.625982 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:08:21.625982 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:08:21.625982 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:08:21.625982 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:21.625982 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 431/858] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Aug 5 02:08:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:08:21.625982 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d226e2-9eda-42f4-950e-8d843860eadc None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:21.661214 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb17955-9286-4e1c-ad20-8fc066795c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:21.661949 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb17955-9286-4e1c-ad20-8fc066795c2b None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:21.662223 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb17955-9286-4e1c-ad20-8fc066795c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:21.662497 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb17955-9286-4e1c-ad20-8fc066795c2b None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:21.663180 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb17955-9286-4e1c-ad20-8fc066795c2b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:21.663709 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb17955-9286-4e1c-ad20-8fc066795c2b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:21.665698 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acb17955-9286-4e1c-ad20-8fc066795c2b None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:21.676363 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 428/859] 10.222.0.15 () {56 vars in 1126 bytes} [Fri Aug 5 02:08:21 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:21.750209 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d226e2-9eda-42f4-950e-8d843860eadc None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:21.788963 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd6094-53ff-4163-bb70-9e9f92200ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:21.789599 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd6094-53ff-4163-bb70-9e9f92200ce2 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:21.789891 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd6094-53ff-4163-bb70-9e9f92200ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:21.790192 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cd6094-53ff-4163-bb70-9e9f92200ce2 None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:21.790879 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd6094-53ff-4163-bb70-9e9f92200ce2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:21.791176 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd6094-53ff-4163-bb70-9e9f92200ce2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:21.792598 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cd6094-53ff-4163-bb70-9e9f92200ce2 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:21.803378 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 432/860] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Aug 5 02:08:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:21.809491 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb17955-9286-4e1c-ad20-8fc066795c2b None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:21.919507 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb17955-9286-4e1c-ad20-8fc066795c2b None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:21.955141 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516139b5-f760-4045-a75e-0b4e154fe66d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:21.956151 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516139b5-f760-4045-a75e-0b4e154fe66d None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:21.956695 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516139b5-f760-4045-a75e-0b4e154fe66d None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:21.957175 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516139b5-f760-4045-a75e-0b4e154fe66d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:21.967959 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516139b5-f760-4045-a75e-0b4e154fe66d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:21.969650 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516139b5-f760-4045-a75e-0b4e154fe66d None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:21.985881 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-516139b5-f760-4045-a75e-0b4e154fe66d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:21.985881 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:21.985881 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:21.985881 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:21.985881 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:21.985881 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:21.985881 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:21.985881 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:21.985881 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:21.985881 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:21.985881 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:21.985881 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:21.985881 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:08:21.985881 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:08:21.985881 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:08:21.986787 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:08:21.986787 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:21.986787 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:21.986787 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:21.986787 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:21.986787 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:21.986787 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:21.986787 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:21.986787 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:21.986787 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:21.986787 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:21.986787 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:21.986787 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:21.986787 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:21.986787 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:21.986787 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:21.986787 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:21.987682 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:08:21.987682 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:08:21.987682 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:21.987682 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:21.990163 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 429/861] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:21.995955 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd6094-53ff-4163-bb70-9e9f92200ce2 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:22.023504 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:22.047308 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7009dd-b66a-4ef8-87f3-538ede1763f8 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:22.047825 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7009dd-b66a-4ef8-87f3-538ede1763f8 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:22.047825 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7009dd-b66a-4ef8-87f3-538ede1763f8 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:22.049442 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 430/862] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:08:22.058210 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f1bdd-932f-4074-b836-3eab7f7aa7cc None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:22.058740 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f1bdd-932f-4074-b836-3eab7f7aa7cc None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:22.059253 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0f1bdd-932f-4074-b836-3eab7f7aa7cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:22.084119 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-3d0f1bdd-932f-4074-b836-3eab7f7aa7cc None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:22.085395 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-3d0f1bdd-932f-4074-b836-3eab7f7aa7cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:22.088629 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:22.116485 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cd6094-53ff-4163-bb70-9e9f92200ce2 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:22.155457 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6d707-281c-4cb8-831e-55b2a066bad0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:22.156528 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6d707-281c-4cb8-831e-55b2a066bad0 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:22.157019 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6d707-281c-4cb8-831e-55b2a066bad0 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:22.157513 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c6d707-281c-4cb8-831e-55b2a066bad0 None admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:22.158525 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6d707-281c-4cb8-831e-55b2a066bad0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:22.159163 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6d707-281c-4cb8-831e-55b2a066bad0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:22.160820 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c6d707-281c-4cb8-831e-55b2a066bad0 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:22.170592 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 431/863] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:22 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:08:22.175788 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 433/864] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:22.181284 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f1bdd-932f-4074-b836-3eab7f7aa7cc None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:22.194751 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6d707-281c-4cb8-831e-55b2a066bad0 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:22.295981 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:22.312313 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0f1bdd-932f-4074-b836-3eab7f7aa7cc None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:22.322455 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c6d707-281c-4cb8-831e-55b2a066bad0 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:22.363868 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9025577b-6569-4ae7-ae36-8c4f2a956f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:22.365532 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876c9ff-c194-4c21-9e19-5c6b88354825 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:22.365943 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025577b-6569-4ae7-ae36-8c4f2a956f93 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:22.366140 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876c9ff-c194-4c21-9e19-5c6b88354825 None admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:22.366422 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876c9ff-c194-4c21-9e19-5c6b88354825 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:22.366697 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1876c9ff-c194-4c21-9e19-5c6b88354825 None admin] PATH_INFO: `/v3/services` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:22.367035 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025577b-6569-4ae7-ae36-8c4f2a956f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:22.367404 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1876c9ff-c194-4c21-9e19-5c6b88354825 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:22.367755 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9025577b-6569-4ae7-ae36-8c4f2a956f93 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:22.368980 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1876c9ff-c194-4c21-9e19-5c6b88354825 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:22.379529 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9025577b-6569-4ae7-ae36-8c4f2a956f93 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:22.381572 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9025577b-6569-4ae7-ae36-8c4f2a956f93 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:22.384010 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:22.394853 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 434/865] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Aug 5 02:08:22 2022] POST /identity/v3/services => generated 251 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:08:22.402962 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-9025577b-6569-4ae7-ae36-8c4f2a956f93 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 02:08:22.402962 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:22.402962 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:22.402962 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:22.402962 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:22.402962 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:22.402962 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:22.402962 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:22.402962 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:22.402962 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:22.402962 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:22.402962 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:22.402962 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:08:22.402962 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:08:22.402962 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:08:22.402962 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:08:22.404791 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:22.404791 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:22.404791 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:08:22.404791 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:08:22.404791 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:08:22.404791 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:08:22.404791 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:22.404791 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:22.404791 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:22.404791 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:22.404791 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:22.404791 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:22.404791 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:22.404791 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:22.404791 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:22.404791 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:22.404791 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:22.404791 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:22.406003 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:22.406003 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:22.406003 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:08:22.406003 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:08:22.406003 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:08:22.406003 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:08:22.406003 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:08:22.406003 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:08:22.406003 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 02:08:22.406003 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:22.406003 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 432/866] 10.222.0.15 () {56 vars in 1117 bytes} [Fri Aug 5 02:08:22 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:22.409712 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876c9ff-c194-4c21-9e19-5c6b88354825 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:22.532834 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1876c9ff-c194-4c21-9e19-5c6b88354825 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:22.570219 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510f0b0-3cf1-49ed-9b58-3a2dfae70e53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:22.570847 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510f0b0-3cf1-49ed-9b58-3a2dfae70e53 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:22.571105 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510f0b0-3cf1-49ed-9b58-3a2dfae70e53 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:22.571377 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510f0b0-3cf1-49ed-9b58-3a2dfae70e53 None admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:22.572173 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510f0b0-3cf1-49ed-9b58-3a2dfae70e53 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:22.572512 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510f0b0-3cf1-49ed-9b58-3a2dfae70e53 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:22.573967 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510f0b0-3cf1-49ed-9b58-3a2dfae70e53 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:22.581209 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:22.594880 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 435/867] 10.222.0.15 () {56 vars in 1149 bytes} [Fri Aug 5 02:08:22 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:22.601268 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9025577b-6569-4ae7-ae36-8c4f2a956f93 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:22.707062 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9025577b-6569-4ae7-ae36-8c4f2a956f93 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:22.744121 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38147592-9964-46ae-a964-fc0ac9bab5da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:22.745019 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38147592-9964-46ae-a964-fc0ac9bab5da None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:22.745479 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38147592-9964-46ae-a964-fc0ac9bab5da None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:22.745904 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38147592-9964-46ae-a964-fc0ac9bab5da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:22.815311 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:22.820946 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38147592-9964-46ae-a964-fc0ac9bab5da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:22.823018 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38147592-9964-46ae-a964-fc0ac9bab5da None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:22.937305 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 433/868] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:08:22 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 02:08:22.943130 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510f0b0-3cf1-49ed-9b58-3a2dfae70e53 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:23.046597 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510f0b0-3cf1-49ed-9b58-3a2dfae70e53 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:23.080614 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f834d417-af02-47a5-80d1-a487ac40072a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:23.081245 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834d417-af02-47a5-80d1-a487ac40072a None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:23.081523 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834d417-af02-47a5-80d1-a487ac40072a None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:23.081791 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f834d417-af02-47a5-80d1-a487ac40072a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:23.092656 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f834d417-af02-47a5-80d1-a487ac40072a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:23.094190 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f834d417-af02-47a5-80d1-a487ac40072a None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:23.109365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-f834d417-af02-47a5-80d1-a487ac40072a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:23.109365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:23.109365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:23.109365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:23.109365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:23.109365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:23.109365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:23.109365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:23.109365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:23.109365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:23.109365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:23.109365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:23.109365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:08:23.109365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:08:23.109365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:08:23.110308 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:08:23.110308 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:23.110308 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:23.110308 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:23.110308 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:23.110308 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:23.110308 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:23.110308 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:23.110308 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:23.110308 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:23.110308 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:23.110308 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:23.110308 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:23.110308 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:23.110308 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:23.110308 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:23.110308 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:23.111228 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:08:23.111228 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:08:23.111228 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:23.111228 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:23.111228 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 436/869] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:23.117131 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38147592-9964-46ae-a964-fc0ac9bab5da None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:23.213519 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedbadc-7b65-4885-b5ca-63f84376e899 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:23.214152 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedbadc-7b65-4885-b5ca-63f84376e899 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:23.214630 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddedbadc-7b65-4885-b5ca-63f84376e899 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:23.216461 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 437/870] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:08:23.220464 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:23.222308 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b54e1-2470-4b91-babf-0f9f70ea8f7c None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:23.222784 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b54e1-2470-4b91-babf-0f9f70ea8f7c None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:23.223228 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99b54e1-2470-4b91-babf-0f9f70ea8f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:23.224022 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38147592-9964-46ae-a964-fc0ac9bab5da None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:23.244705 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-a99b54e1-2470-4b91-babf-0f9f70ea8f7c None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:23.246340 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-a99b54e1-2470-4b91-babf-0f9f70ea8f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:23.261244 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91cfbf3-53b8-40d8-bc03-dd7a77a96a55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:23.261910 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cfbf3-53b8-40d8-bc03-dd7a77a96a55 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:23.262537 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cfbf3-53b8-40d8-bc03-dd7a77a96a55 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:23.262829 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91cfbf3-53b8-40d8-bc03-dd7a77a96a55 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:23.263526 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91cfbf3-53b8-40d8-bc03-dd7a77a96a55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:23.263827 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91cfbf3-53b8-40d8-bc03-dd7a77a96a55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:23.265506 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91cfbf3-53b8-40d8-bc03-dd7a77a96a55 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:23.280795 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 434/871] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:23.287813 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91cfbf3-53b8-40d8-bc03-dd7a77a96a55 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:23.303260 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:23.340346 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 438/872] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:23 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:08:23.357453 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b54e1-2470-4b91-babf-0f9f70ea8f7c None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:23.412142 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91cfbf3-53b8-40d8-bc03-dd7a77a96a55 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:23.451069 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8b80f-4477-48da-bf67-03c4747e2fa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:23.452207 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8b80f-4477-48da-bf67-03c4747e2fa3 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:23.452757 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8b80f-4477-48da-bf67-03c4747e2fa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:23.453228 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8b80f-4477-48da-bf67-03c4747e2fa3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:23.462348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b8b80f-4477-48da-bf67-03c4747e2fa3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:23.464064 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76b8b80f-4477-48da-bf67-03c4747e2fa3 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:23.478689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-76b8b80f-4477-48da-bf67-03c4747e2fa3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:08:23.478689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:23.478689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:23.478689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:23.478689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:23.478689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:23.478689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:23.478689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:23.478689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:23.478689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:23.478689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:23.478689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:23.478689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:08:23.478689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:08:23.478689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:08:23.479649 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:08:23.479649 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:23.479649 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:23.479649 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:23.479649 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:23.479649 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:23.479649 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:23.479649 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:23.479649 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:23.479649 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:23.479649 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:23.479649 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:23.479649 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:23.479649 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:23.479649 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:23.479649 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:23.479649 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:23.480976 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:08:23.480976 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:08:23.480976 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:08:23.480976 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:08:23.480976 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:08:23.480976 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:08:23.480976 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:08:23.480976 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:23.481399 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99b54e1-2470-4b91-babf-0f9f70ea8f7c None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:23.483474 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 435/873] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:08:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:23.490703 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8b80f-4477-48da-bf67-03c4747e2fa3 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:23.516014 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:23.527254 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd35b88-18f2-4d8c-8361-d65eb98d7384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:23.528344 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd35b88-18f2-4d8c-8361-d65eb98d7384 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:23.528832 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd35b88-18f2-4d8c-8361-d65eb98d7384 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:23.529332 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd35b88-18f2-4d8c-8361-d65eb98d7384 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:23.530267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd35b88-18f2-4d8c-8361-d65eb98d7384 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:23.531883 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cd35b88-18f2-4d8c-8361-d65eb98d7384 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:23.543230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-3cd35b88-18f2-4d8c-8361-d65eb98d7384 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 02:08:23.543230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:23.543230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:08:23.543230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:08:23.543230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:08:23.543230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:08:23.543230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:08:23.543230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:08:23.543230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 02:08:23.543230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:23.543230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:08:23.543230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:23.543230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:23.543230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:23.543230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:23.543230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:23.543230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:23.544364 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:23.544364 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:23.544364 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:23.544364 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:23.544364 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:23.544364 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:23.544364 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:08:23.544364 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:08:23.544364 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:08:23.544364 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:08:23.544364 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:23.544364 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:23.544364 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:23.544364 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:23.544364 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:23.544364 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:23.545226 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:23.545226 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:23.545226 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:23.545226 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:23.545226 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:23.545226 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:23.545226 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:23.545226 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:23.545226 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:23.545226 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:23.545226 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:08:23.545226 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:08:23.545226 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 02:08:23.545226 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:23.554572 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 439/874] 10.222.0.15 () {56 vars in 1126 bytes} [Fri Aug 5 02:08:23 2022] GET /identity/v3/services/object-store => generated 93 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:08:23.555764 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd35b88-18f2-4d8c-8361-d65eb98d7384 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:23.606247 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:23.618453 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8b80f-4477-48da-bf67-03c4747e2fa3 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:23.659778 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231daea5-2836-4b9f-b963-72b763a2cf51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:23.660426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231daea5-2836-4b9f-b963-72b763a2cf51 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:23.660708 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231daea5-2836-4b9f-b963-72b763a2cf51 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:23.661519 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231daea5-2836-4b9f-b963-72b763a2cf51 None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:23.662265 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231daea5-2836-4b9f-b963-72b763a2cf51 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:23.662572 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231daea5-2836-4b9f-b963-72b763a2cf51 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:23.663993 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231daea5-2836-4b9f-b963-72b763a2cf51 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:23.679518 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 436/875] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Aug 5 02:08:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:23.685091 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231daea5-2836-4b9f-b963-72b763a2cf51 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:23.686466 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd35b88-18f2-4d8c-8361-d65eb98d7384 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:23.728751 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1769c1-3992-4d6f-b204-7b101829c75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:23.729372 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1769c1-3992-4d6f-b204-7b101829c75d None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:23.729656 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1769c1-3992-4d6f-b204-7b101829c75d None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:23.729931 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da1769c1-3992-4d6f-b204-7b101829c75d None admin] PATH_INFO: `/v3/services` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:23.730607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1769c1-3992-4d6f-b204-7b101829c75d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:23.730907 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1769c1-3992-4d6f-b204-7b101829c75d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:23.732711 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da1769c1-3992-4d6f-b204-7b101829c75d None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:23.738667 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 440/876] 10.222.0.15 () {56 vars in 1122 bytes} [Fri Aug 5 02:08:23 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:23.745562 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1769c1-3992-4d6f-b204-7b101829c75d None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:23.782178 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:23.811743 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231daea5-2836-4b9f-b963-72b763a2cf51 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:23.860583 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e50315e-49f8-42c5-a931-b9143c7284ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:23.861197 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50315e-49f8-42c5-a931-b9143c7284ea None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:23.861569 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50315e-49f8-42c5-a931-b9143c7284ea None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:23.861807 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e50315e-49f8-42c5-a931-b9143c7284ea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:23.862648 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e50315e-49f8-42c5-a931-b9143c7284ea None admin] RBAC: Adding query filter params (role.id=876fd0d181d74df4bbc73b2db1c42fbe, scope.project.id=95d88dece7184bf1842c4f8d275d52cd, user.id=36970f0778384576b599cd7217b5084d) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:23.863004 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e50315e-49f8-42c5-a931-b9143c7284ea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:23.864998 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e50315e-49f8-42c5-a931-b9143c7284ea None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:23.870715 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da1769c1-3992-4d6f-b204-7b101829c75d None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:23.870855 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 437/877] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:08:23 2022] GET /identity/v3/role_assignments?user.id=36970f0778384576b599cd7217b5084d&scope.project.id=95d88dece7184bf1842c4f8d275d52cd&role.id=876fd0d181d74df4bbc73b2db1c42fbe => generated 608 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:23.872070 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb794f6-11d7-4650-a74b-a42bb8b718ae None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:23.872380 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb794f6-11d7-4650-a74b-a42bb8b718ae None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:23.872662 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb794f6-11d7-4650-a74b-a42bb8b718ae None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:23.873981 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 438/878] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:08:23.879046 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:23.880358 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c2b8c-215c-465a-8a39-99d5c43a8859 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:23.880862 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c2b8c-215c-465a-8a39-99d5c43a8859 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:23.880862 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1c2b8c-215c-465a-8a39-99d5c43a8859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:23.901453 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-1f1c2b8c-215c-465a-8a39-99d5c43a8859 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:23.902670 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-1f1c2b8c-215c-465a-8a39-99d5c43a8859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:23.928860 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaaab1b-d780-4ad8-af1a-b2a6b095b737 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:23.929898 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaaab1b-d780-4ad8-af1a-b2a6b095b737 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:23.930742 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaaab1b-d780-4ad8-af1a-b2a6b095b737 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:23.931794 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaaab1b-d780-4ad8-af1a-b2a6b095b737 None admin] PATH_INFO: `/v3/services` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:23.933117 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaaab1b-d780-4ad8-af1a-b2a6b095b737 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:23.933643 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaaab1b-d780-4ad8-af1a-b2a6b095b737 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:23.936235 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaaab1b-d780-4ad8-af1a-b2a6b095b737 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:23.949111 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 441/879] 10.222.0.15 () {56 vars in 1122 bytes} [Fri Aug 5 02:08:23 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:23.996542 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 439/880] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:23 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:08:24.013247 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaaab1b-d780-4ad8-af1a-b2a6b095b737 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:24.142877 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaaab1b-d780-4ad8-af1a-b2a6b095b737 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:24.186002 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7b492e-a53d-4359-b071-bd9164a2e59e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:24.186625 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b492e-a53d-4359-b071-bd9164a2e59e None admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:24.186901 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b492e-a53d-4359-b071-bd9164a2e59e None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:24.187172 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7b492e-a53d-4359-b071-bd9164a2e59e None admin] PATH_INFO: `/v3/services` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:24.187855 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7b492e-a53d-4359-b071-bd9164a2e59e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:24.189254 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7b492e-a53d-4359-b071-bd9164a2e59e None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:24.206947 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 442/881] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Aug 5 02:08:24 2022] POST /identity/v3/services => generated 269 bytes in 194 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:08:24.532095 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbfa232-3fc6-407a-9e55-d126001f6d4f None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:24.532095 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbfa232-3fc6-407a-9e55-d126001f6d4f None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:24.532095 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbfa232-3fc6-407a-9e55-d126001f6d4f None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:24.532095 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 440/882] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:08:24.534967 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e8e05-b140-450e-80ef-9c3a2b61241e None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:24.535253 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e8e05-b140-450e-80ef-9c3a2b61241e None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:24.535523 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9e8e05-b140-450e-80ef-9c3a2b61241e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:24.555406 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-3d9e8e05-b140-450e-80ef-9c3a2b61241e None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:24.556671 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-3d9e8e05-b140-450e-80ef-9c3a2b61241e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:24.581221 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:24.638449 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 443/883] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:24 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:08:24.660655 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbfa232-3fc6-407a-9e55-d126001f6d4f None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:24.737775 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:24.770486 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbfa232-3fc6-407a-9e55-d126001f6d4f None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:24.805937 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0acfa81-2d85-4bd8-a7d2-9ed7f5d7fb1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:24.806509 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acfa81-2d85-4bd8-a7d2-9ed7f5d7fb1b None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:24.806792 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acfa81-2d85-4bd8-a7d2-9ed7f5d7fb1b None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:24.807067 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0acfa81-2d85-4bd8-a7d2-9ed7f5d7fb1b None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:24.807700 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0acfa81-2d85-4bd8-a7d2-9ed7f5d7fb1b None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:24.809084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0acfa81-2d85-4bd8-a7d2-9ed7f5d7fb1b None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:24.818950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-e0acfa81-2d85-4bd8-a7d2-9ed7f5d7fb1b None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 02:08:24.818950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:24.818950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:08:24.818950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:08:24.818950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:08:24.818950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:08:24.818950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:08:24.818950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:08:24.818950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 02:08:24.818950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:24.818950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:08:24.818950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:24.818950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:24.818950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:24.818950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:24.818950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:24.818950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:24.820071 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:24.820071 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:24.820071 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:24.820071 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:24.820071 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:24.820071 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:24.820071 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:08:24.820071 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:08:24.820071 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:08:24.820071 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:08:24.820071 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:24.820071 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:24.820071 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:24.820071 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:24.820071 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:24.820071 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:24.821361 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:24.821361 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:24.821361 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:24.821361 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:24.821361 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:24.821361 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:24.821361 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:24.821361 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:24.821361 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:24.821361 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:24.821361 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:08:24.821361 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:08:24.821361 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 02:08:24.821361 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:24.821361 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 441/884] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Aug 5 02:08:24 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:24.825958 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e8e05-b140-450e-80ef-9c3a2b61241e None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:24.929590 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9e8e05-b140-450e-80ef-9c3a2b61241e None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:24.966942 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d796d-1d83-4569-b51a-92b3d3dde1af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:24.967930 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d796d-1d83-4569-b51a-92b3d3dde1af None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:24.968438 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d796d-1d83-4569-b51a-92b3d3dde1af None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:24.968909 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e7d796d-1d83-4569-b51a-92b3d3dde1af None admin] PATH_INFO: `/v3/services` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:24.969777 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d796d-1d83-4569-b51a-92b3d3dde1af None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:24.970528 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d796d-1d83-4569-b51a-92b3d3dde1af None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:24.972105 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e7d796d-1d83-4569-b51a-92b3d3dde1af None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:24.977698 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 444/885] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Aug 5 02:08:24 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:24.983098 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0acfa81-2d85-4bd8-a7d2-9ed7f5d7fb1b None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:25.092686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0acfa81-2d85-4bd8-a7d2-9ed7f5d7fb1b None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:25.128098 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494f94c-75d7-4388-84d3-27004dcca7d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:25.128745 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494f94c-75d7-4388-84d3-27004dcca7d9 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:25.129026 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494f94c-75d7-4388-84d3-27004dcca7d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:25.129299 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2494f94c-75d7-4388-84d3-27004dcca7d9 None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:25.130012 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2494f94c-75d7-4388-84d3-27004dcca7d9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:25.130492 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2494f94c-75d7-4388-84d3-27004dcca7d9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:25.131853 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2494f94c-75d7-4388-84d3-27004dcca7d9 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:25.134012 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:25.137556 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 442/886] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Aug 5 02:08:24 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:25.143065 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d796d-1d83-4569-b51a-92b3d3dde1af None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:25.163284 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:25.252917 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e7d796d-1d83-4569-b51a-92b3d3dde1af None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:25.290454 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b72890a1-8dc4-4921-9d7b-93bcd7704453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:25.291392 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72890a1-8dc4-4921-9d7b-93bcd7704453 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:25.291848 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72890a1-8dc4-4921-9d7b-93bcd7704453 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:25.292294 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72890a1-8dc4-4921-9d7b-93bcd7704453 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:25.293272 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72890a1-8dc4-4921-9d7b-93bcd7704453 None admin] RBAC: Adding query filter params (interface=public, service_id=7b399ba30277439993d95565fcc97a3e, region_id=RegionOne) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:25.293746 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72890a1-8dc4-4921-9d7b-93bcd7704453 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:25.295268 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b72890a1-8dc4-4921-9d7b-93bcd7704453 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:25.300993 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 445/887] 10.222.0.15 () {56 vars in 1251 bytes} [Fri Aug 5 02:08:25 2022] GET /identity/v3/endpoints?service_id=7b399ba30277439993d95565fcc97a3e&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:25.312369 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494f94c-75d7-4388-84d3-27004dcca7d9 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:25.413993 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2494f94c-75d7-4388-84d3-27004dcca7d9 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:25.451660 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061e66a2-7ab0-4d39-9804-7bfc45c736f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:25.452286 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e66a2-7ab0-4d39-9804-7bfc45c736f1 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:25.452601 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e66a2-7ab0-4d39-9804-7bfc45c736f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:25.452879 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061e66a2-7ab0-4d39-9804-7bfc45c736f1 None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:25.453538 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e66a2-7ab0-4d39-9804-7bfc45c736f1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:25.454898 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061e66a2-7ab0-4d39-9804-7bfc45c736f1 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:25.461813 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 443/888] 10.222.0.15 () {56 vars in 1087 bytes} [Fri Aug 5 02:08:25 2022] GET /identity/v3/services => generated 1268 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:08:26.114443 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3832d-8b77-4e67-92f4-6d2a8a38877e None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:26.115524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3832d-8b77-4e67-92f4-6d2a8a38877e None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:26.116026 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be3832d-8b77-4e67-92f4-6d2a8a38877e None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:26.117870 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 446/889] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:26 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:08:26.123285 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86886ed1-a1a9-4f30-b8ce-f44c7ad54e8c None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:26.124112 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86886ed1-a1a9-4f30-b8ce-f44c7ad54e8c None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:26.124649 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86886ed1-a1a9-4f30-b8ce-f44c7ad54e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:26.128751 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1870ae-2a83-4d41-8508-7f93c2db2aa8 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:26.129254 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1870ae-2a83-4d41-8508-7f93c2db2aa8 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:26.130342 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1870ae-2a83-4d41-8508-7f93c2db2aa8 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:26.132069 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 447/890] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:08:26.138384 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a4637-bcd8-4dc8-bd53-933d51d3155c None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:26.138663 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a4637-bcd8-4dc8-bd53-933d51d3155c None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:26.138934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9a4637-bcd8-4dc8-bd53-933d51d3155c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:26.147067 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-86886ed1-a1a9-4f30-b8ce-f44c7ad54e8c None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:26.148572 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-86886ed1-a1a9-4f30-b8ce-f44c7ad54e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:26.157674 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-3b9a4637-bcd8-4dc8-bd53-933d51d3155c None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:26.158836 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-3b9a4637-bcd8-4dc8-bd53-933d51d3155c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:26.226467 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:26.229796 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 444/891] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:26 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:08:26.230755 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 448/892] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:26 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 02:08:26.253313 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86886ed1-a1a9-4f30-b8ce-f44c7ad54e8c None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:26.258360 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a4637-bcd8-4dc8-bd53-933d51d3155c None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:26.273428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:26.361763 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86886ed1-a1a9-4f30-b8ce-f44c7ad54e8c None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:26.367128 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b9a4637-bcd8-4dc8-bd53-933d51d3155c None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:26.398087 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c702f5e-5943-4e50-901a-aa158444b877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:26.398725 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c702f5e-5943-4e50-901a-aa158444b877 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:26.399007 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c702f5e-5943-4e50-901a-aa158444b877 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:26.399285 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c702f5e-5943-4e50-901a-aa158444b877 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:26.404535 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5abb2091-8899-4531-a34c-e35d451aa9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:26.405141 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb2091-8899-4531-a34c-e35d451aa9b4 None admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:26.405420 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb2091-8899-4531-a34c-e35d451aa9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:26.405691 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5abb2091-8899-4531-a34c-e35d451aa9b4 None admin] PATH_INFO: `/v3/services` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:26.406370 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb2091-8899-4531-a34c-e35d451aa9b4 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:26.407725 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5abb2091-8899-4531-a34c-e35d451aa9b4 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:26.411589 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c702f5e-5943-4e50-901a-aa158444b877 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:08:26.416871 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-1c702f5e-5943-4e50-901a-aa158444b877 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 02:08:26.416871 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:26.416871 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:26.416871 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:26.416871 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:26.416871 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:26.416871 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:26.416871 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:26.416871 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:26.416871 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:26.416871 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:26.416871 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:26.416871 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:08:26.416871 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:08:26.416871 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:08:26.416871 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:08:26.417856 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:08:26.417856 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:08:26.417856 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:08:26.417856 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:08:26.417856 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:26.417856 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:26.417856 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:26.417856 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:26.417856 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:26.417856 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:26.417856 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:26.417856 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:26.417856 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:26.417856 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:26.417856 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:26.417856 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:26.418983 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:26.418983 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:26.418983 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:26.418983 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:26.418983 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:08:26.418983 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:08:26.418983 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:08:26.418983 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:08:26.418983 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:08:26.418983 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:08:26.418983 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 02:08:26.418983 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:26.418983 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 445/893] 10.222.0.15 () {56 vars in 1120 bytes} [Fri Aug 5 02:08:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:26.419969 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f556d-ac02-4c2b-b36e-51bd326614b7 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:26.419969 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f556d-ac02-4c2b-b36e-51bd326614b7 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:26.419969 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70f556d-ac02-4c2b-b36e-51bd326614b7 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:26.421135 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 446/894] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:26 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:08:26.425451 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f556d-ac02-4c2b-b36e-51bd326614b7 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:26.428736 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 449/895] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Aug 5 02:08:26 2022] POST /identity/v3/services => generated 241 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:08:26.430134 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50cff6-926c-48ea-a6c4-e433a8151c47 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:26.430481 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50cff6-926c-48ea-a6c4-e433a8151c47 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:26.430817 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b50cff6-926c-48ea-a6c4-e433a8151c47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:26.451594 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-2b50cff6-926c-48ea-a6c4-e433a8151c47 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:26.452984 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-2b50cff6-926c-48ea-a6c4-e433a8151c47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:26.497683 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:26.560111 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:26.561581 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70f556d-ac02-4c2b-b36e-51bd326614b7 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:26.575949 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 450/896] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:26 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:08:26.594487 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50cff6-926c-48ea-a6c4-e433a8151c47 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:26.607164 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1470c66-7e70-4891-a465-593ccdca4675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:26.608362 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1470c66-7e70-4891-a465-593ccdca4675 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:26.608362 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1470c66-7e70-4891-a465-593ccdca4675 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:26.608362 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1470c66-7e70-4891-a465-593ccdca4675 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:26.609089 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1470c66-7e70-4891-a465-593ccdca4675 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:26.609397 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1470c66-7e70-4891-a465-593ccdca4675 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:26.611130 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1470c66-7e70-4891-a465-593ccdca4675 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:26.622844 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 447/897] 10.222.0.15 () {56 vars in 1115 bytes} [Fri Aug 5 02:08:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:26.628123 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1470c66-7e70-4891-a465-593ccdca4675 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:26.735595 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b50cff6-926c-48ea-a6c4-e433a8151c47 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:26.748719 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1470c66-7e70-4891-a465-593ccdca4675 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:26.763783 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:26.783439 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65182b-33cd-4443-847a-80bcd13de167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:26.784486 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65182b-33cd-4443-847a-80bcd13de167 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:26.784977 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65182b-33cd-4443-847a-80bcd13de167 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:26.785501 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df65182b-33cd-4443-847a-80bcd13de167 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:26.786894 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65182b-33cd-4443-847a-80bcd13de167 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:26.788520 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df65182b-33cd-4443-847a-80bcd13de167 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:26.792760 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50375e-5401-4556-ac7a-18a47c9d5f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:26.793413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50375e-5401-4556-ac7a-18a47c9d5f67 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:26.793697 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50375e-5401-4556-ac7a-18a47c9d5f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:26.793975 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50375e-5401-4556-ac7a-18a47c9d5f67 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:26.800132 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-df65182b-33cd-4443-847a-80bcd13de167 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 02:08:26.800132 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:26.800132 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:08:26.800132 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:08:26.800132 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:08:26.800132 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:08:26.800132 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:08:26.800132 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:08:26.800132 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 02:08:26.800132 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:26.800132 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:08:26.800132 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:26.800132 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:26.800132 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:26.800132 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:26.800132 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:26.801096 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:26.801096 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:26.801096 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:26.801096 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:26.801096 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:26.801096 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:26.801096 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:26.801096 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:08:26.801096 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:08:26.801096 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:08:26.801096 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:08:26.801096 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:26.801096 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:26.801096 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:26.801096 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:26.801096 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:26.802717 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:26.802717 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:26.802717 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:26.802717 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:26.802717 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:26.802717 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:26.802717 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:26.802717 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:26.802717 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:26.802717 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:26.802717 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:26.802717 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:08:26.802717 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:08:26.802717 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 02:08:26.802717 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:26.810141 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e50375e-5401-4556-ac7a-18a47c9d5f67 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:26.810141 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e50375e-5401-4556-ac7a-18a47c9d5f67 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:26.810487 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 451/898] 10.222.0.15 () {56 vars in 1132 bytes} [Fri Aug 5 02:08:26 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:26.811876 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65182b-33cd-4443-847a-80bcd13de167 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:26.823426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-5e50375e-5401-4556-ac7a-18a47c9d5f67 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:26.823426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:26.823426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:26.823426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:26.823426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:26.823426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:26.823426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:26.823426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:26.823426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:26.823426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:26.823426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:26.823426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:26.823426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:08:26.823426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:08:26.823426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:08:26.824438 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:08:26.824438 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:26.824438 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:26.824438 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:26.824438 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:26.824438 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:26.824438 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:26.824438 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:26.824438 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:26.824438 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:26.824438 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:26.824438 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:26.824438 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:26.824438 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:26.824438 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:26.824438 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:26.824438 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:26.825383 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:08:26.825383 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:08:26.825383 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:26.825383 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:26.825383 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 448/899] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:08:26.833309 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50375e-5401-4556-ac7a-18a47c9d5f67 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:26.882245 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:26.923736 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df65182b-33cd-4443-847a-80bcd13de167 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:26.950513 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50375e-5401-4556-ac7a-18a47c9d5f67 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:26.961432 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f2076-5f9e-4da5-8dcf-ca6dcc569546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:26.962377 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f2076-5f9e-4da5-8dcf-ca6dcc569546 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:26.962864 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f2076-5f9e-4da5-8dcf-ca6dcc569546 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:26.963343 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f2076-5f9e-4da5-8dcf-ca6dcc569546 None admin] PATH_INFO: `/v3/services` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:26.964222 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f2076-5f9e-4da5-8dcf-ca6dcc569546 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:26.964792 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f2076-5f9e-4da5-8dcf-ca6dcc569546 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:26.966528 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604f2076-5f9e-4da5-8dcf-ca6dcc569546 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:26.976600 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 452/900] 10.222.0.15 () {56 vars in 1126 bytes} [Fri Aug 5 02:08:26 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:26.978659 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f2076-5f9e-4da5-8dcf-ca6dcc569546 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:26.988468 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ed30d-f33a-43de-9640-dfe42e2a268b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:26.989627 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ed30d-f33a-43de-9640-dfe42e2a268b None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:26.989927 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ed30d-f33a-43de-9640-dfe42e2a268b None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:26.990295 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-637ed30d-f33a-43de-9640-dfe42e2a268b None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:26.991005 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637ed30d-f33a-43de-9640-dfe42e2a268b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:26.991310 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637ed30d-f33a-43de-9640-dfe42e2a268b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:26.992835 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-637ed30d-f33a-43de-9640-dfe42e2a268b None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:27.007297 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 449/901] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:08:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:27.012532 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ed30d-f33a-43de-9640-dfe42e2a268b None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:27.072775 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:27.087740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604f2076-5f9e-4da5-8dcf-ca6dcc569546 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:27.115430 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:27.125827 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96147721-d95b-46a0-aa26-db6727830058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:27.126774 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96147721-d95b-46a0-aa26-db6727830058 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:27.127281 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96147721-d95b-46a0-aa26-db6727830058 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:27.127771 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96147721-d95b-46a0-aa26-db6727830058 None admin] PATH_INFO: `/v3/services` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:27.128806 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96147721-d95b-46a0-aa26-db6727830058 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:27.129369 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96147721-d95b-46a0-aa26-db6727830058 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:27.131696 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96147721-d95b-46a0-aa26-db6727830058 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:27.141599 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-637ed30d-f33a-43de-9640-dfe42e2a268b None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:27.142524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 453/902] 10.222.0.15 () {56 vars in 1126 bytes} [Fri Aug 5 02:08:26 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:27.143603 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96147721-d95b-46a0-aa26-db6727830058 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:27.178010 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3c70c-4eca-45e8-867d-a09e7712df69 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:27.178615 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3c70c-4eca-45e8-867d-a09e7712df69 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:27.178900 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3c70c-4eca-45e8-867d-a09e7712df69 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:27.179179 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a3c70c-4eca-45e8-867d-a09e7712df69 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:27.187293 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a3c70c-4eca-45e8-867d-a09e7712df69 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:27.188775 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a3c70c-4eca-45e8-867d-a09e7712df69 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:27.202622 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-49a3c70c-4eca-45e8-867d-a09e7712df69 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 02:08:27.202622 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:27.202622 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:27.202622 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:27.202622 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:27.202622 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:27.202622 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:27.202622 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:27.202622 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:27.202622 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:27.202622 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:27.202622 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:27.202622 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:08:27.202622 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:08:27.202622 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:08:27.202622 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:08:27.203613 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:27.203613 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:27.203613 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:08:27.203613 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:08:27.203613 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:08:27.203613 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:08:27.203613 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:27.203613 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:27.203613 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:27.203613 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:27.203613 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:27.203613 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:27.203613 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:27.203613 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:27.203613 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:27.203613 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:27.203613 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:27.203613 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:27.204603 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:27.204603 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:27.204603 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:08:27.204603 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:08:27.204603 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:08:27.204603 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:08:27.204603 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:08:27.204603 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:08:27.204603 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 02:08:27.204603 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:27.204603 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 450/903] 10.222.0.15 () {56 vars in 1117 bytes} [Fri Aug 5 02:08:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:27.209434 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3c70c-4eca-45e8-867d-a09e7712df69 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:27.266108 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96147721-d95b-46a0-aa26-db6727830058 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:27.316686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:27.319461 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c9a96-367e-4393-8a67-5760a32a48ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:27.320087 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c9a96-367e-4393-8a67-5760a32a48ad None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:27.320390 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c9a96-367e-4393-8a67-5760a32a48ad None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:27.320667 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c9a96-367e-4393-8a67-5760a32a48ad None admin] PATH_INFO: `/v3/endpoints` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:27.321434 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c9a96-367e-4393-8a67-5760a32a48ad None admin] RBAC: Adding query filter params (interface=public, service_id=19a55f842fac4ab5915f4caeb5cdc6a8, region_id=RegionOne) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:27.321754 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c9a96-367e-4393-8a67-5760a32a48ad None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:27.323122 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c9a96-367e-4393-8a67-5760a32a48ad None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:27.335770 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 454/904] 10.222.0.15 () {56 vars in 1251 bytes} [Fri Aug 5 02:08:27 2022] GET /identity/v3/endpoints?service_id=19a55f842fac4ab5915f4caeb5cdc6a8&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:27.336798 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c9a96-367e-4393-8a67-5760a32a48ad None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:27.341551 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a3c70c-4eca-45e8-867d-a09e7712df69 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:27.386941 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4dd07-9494-4974-9ca2-871a8163fc47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:27.388514 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4dd07-9494-4974-9ca2-871a8163fc47 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:27.389015 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4dd07-9494-4974-9ca2-871a8163fc47 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:27.389498 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d4dd07-9494-4974-9ca2-871a8163fc47 None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:27.390974 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d4dd07-9494-4974-9ca2-871a8163fc47 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:27.391939 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d4dd07-9494-4974-9ca2-871a8163fc47 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:27.394155 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d4dd07-9494-4974-9ca2-871a8163fc47 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:27.405949 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:27.420489 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 451/905] 10.222.0.15 () {56 vars in 1149 bytes} [Fri Aug 5 02:08:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:27.426866 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4dd07-9494-4974-9ca2-871a8163fc47 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:27.466090 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c9a96-367e-4393-8a67-5760a32a48ad None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:27.505490 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bd8ccc-e472-4ccf-823d-33d03a878b7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:27.506463 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd8ccc-e472-4ccf-823d-33d03a878b7e None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:27.506956 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd8ccc-e472-4ccf-823d-33d03a878b7e None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:27.507557 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bd8ccc-e472-4ccf-823d-33d03a878b7e None admin] PATH_INFO: `/v3/services` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:27.508476 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd8ccc-e472-4ccf-823d-33d03a878b7e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:27.510151 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83bd8ccc-e472-4ccf-823d-33d03a878b7e None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:27.525029 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 455/906] 10.222.0.15 () {56 vars in 1087 bytes} [Fri Aug 5 02:08:27 2022] GET /identity/v3/services => generated 1497 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:08:27.533898 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d4dd07-9494-4974-9ca2-871a8163fc47 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:27.543388 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50068883-3e85-4904-85e3-225a17d641e9 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:27.543739 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50068883-3e85-4904-85e3-225a17d641e9 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:27.544025 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50068883-3e85-4904-85e3-225a17d641e9 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:27.545758 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 456/907] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:08:27.551835 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c775d5-8b5d-4876-b6e5-73ea35aa153f None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:27.552263 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c775d5-8b5d-4876-b6e5-73ea35aa153f None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:27.552473 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c775d5-8b5d-4876-b6e5-73ea35aa153f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:27.571238 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-c2c775d5-8b5d-4876-b6e5-73ea35aa153f None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:27.572494 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-c2c775d5-8b5d-4876-b6e5-73ea35aa153f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:27.574352 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6f87a-dfa1-412e-b819-8f7b46802977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:27.574992 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6f87a-dfa1-412e-b819-8f7b46802977 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:27.575268 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6f87a-dfa1-412e-b819-8f7b46802977 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:27.575542 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d6f87a-dfa1-412e-b819-8f7b46802977 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:27.590966 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:27.652759 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6f87a-dfa1-412e-b819-8f7b46802977 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:27.654143 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d6f87a-dfa1-412e-b819-8f7b46802977 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:27.663035 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 457/908] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:27 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 02:08:27.682409 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c775d5-8b5d-4876-b6e5-73ea35aa153f None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:27.746025 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:27.784527 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 452/909] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:08:27 2022] GET /identity/v3/auth/tokens => generated 1474 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 02:08:27.792279 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6f87a-dfa1-412e-b819-8f7b46802977 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:27.820454 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c775d5-8b5d-4876-b6e5-73ea35aa153f None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:27.845833 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:27.858091 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f6808-531a-41bf-90e5-8a08d66ebf6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:27.858734 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f6808-531a-41bf-90e5-8a08d66ebf6c None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:27.859080 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f6808-531a-41bf-90e5-8a08d66ebf6c None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:27.859278 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f6808-531a-41bf-90e5-8a08d66ebf6c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:27.859907 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f6808-531a-41bf-90e5-8a08d66ebf6c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:27.861407 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-558f6808-531a-41bf-90e5-8a08d66ebf6c None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:27.871711 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-558f6808-531a-41bf-90e5-8a08d66ebf6c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 02:08:27.871711 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:27.871711 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:08:27.871711 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:08:27.871711 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:08:27.871711 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:08:27.871711 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:08:27.871711 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:08:27.871711 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 02:08:27.871711 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:27.871711 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:08:27.871711 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:27.871711 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:27.871711 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:27.871711 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:27.871711 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:27.871711 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:27.872754 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:27.872754 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:27.872754 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:27.872754 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:27.872754 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:27.872754 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:27.872754 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:08:27.872754 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:08:27.872754 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:08:27.872754 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:08:27.872754 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:27.872754 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:27.872754 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:27.872754 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:27.872754 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:27.872754 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:27.873601 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:27.873601 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:27.873601 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:27.873601 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:27.873601 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:27.873601 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:27.873601 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:27.873601 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:27.873601 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:27.873601 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:27.873601 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:08:27.873601 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:08:27.873601 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 05 02:08:27.873601 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:27.878123 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 458/910] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Aug 5 02:08:27 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:08:27.878992 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f6808-531a-41bf-90e5-8a08d66ebf6c None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:27.912913 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d6f87a-dfa1-412e-b819-8f7b46802977 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:27.949532 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79943951-9aa3-4303-bbff-7b59e1699436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:27.950573 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79943951-9aa3-4303-bbff-7b59e1699436 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:27.951059 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79943951-9aa3-4303-bbff-7b59e1699436 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:27.951535 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79943951-9aa3-4303-bbff-7b59e1699436 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:27.962481 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79943951-9aa3-4303-bbff-7b59e1699436 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:27.964186 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79943951-9aa3-4303-bbff-7b59e1699436 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:27.980641 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-79943951-9aa3-4303-bbff-7b59e1699436 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:27.980641 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:27.980641 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:27.980641 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:27.980641 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:27.980641 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:27.980641 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:27.980641 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:27.980641 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:27.980641 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:27.980641 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:27.980641 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:27.980641 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:08:27.980641 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:08:27.980641 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:08:27.981578 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:08:27.981578 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:27.981578 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:27.981578 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:27.981578 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:27.981578 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:27.981578 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:27.981578 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:27.981578 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:27.981578 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:27.981578 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:27.981578 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:27.981578 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:27.981578 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:27.981578 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:27.981578 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:27.981578 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:27.982619 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:08:27.982619 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:08:27.982619 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:27.982619 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:27.989413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 453/911] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:27.990402 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f6808-531a-41bf-90e5-8a08d66ebf6c None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:27.990839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79943951-9aa3-4303-bbff-7b59e1699436 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:28.005267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:28.029633 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab097f69-96c0-4721-8045-b942dd56bc65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:28.030287 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab097f69-96c0-4721-8045-b942dd56bc65 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:28.030571 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab097f69-96c0-4721-8045-b942dd56bc65 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:28.030849 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab097f69-96c0-4721-8045-b942dd56bc65 None admin] PATH_INFO: `/v3/services` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:28.031535 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab097f69-96c0-4721-8045-b942dd56bc65 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:28.031840 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab097f69-96c0-4721-8045-b942dd56bc65 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:28.033248 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab097f69-96c0-4721-8045-b942dd56bc65 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:28.044546 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 459/912] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Aug 5 02:08:27 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:28.045463 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab097f69-96c0-4721-8045-b942dd56bc65 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:28.095477 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:28.103006 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79943951-9aa3-4303-bbff-7b59e1699436 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:28.139477 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7f4c7-8729-4a3d-8114-3c133ec021b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:28.140238 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7f4c7-8729-4a3d-8114-3c133ec021b8 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:28.140619 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7f4c7-8729-4a3d-8114-3c133ec021b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:28.140968 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b7f4c7-8729-4a3d-8114-3c133ec021b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:28.141803 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b7f4c7-8729-4a3d-8114-3c133ec021b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:28.142354 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b7f4c7-8729-4a3d-8114-3c133ec021b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:28.143722 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b7f4c7-8729-4a3d-8114-3c133ec021b8 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:28.159801 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab097f69-96c0-4721-8045-b942dd56bc65 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:28.161213 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 454/913] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:08:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:28.162672 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7f4c7-8729-4a3d-8114-3c133ec021b8 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:28.199025 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df920467-d162-46fa-8345-8dedc412a82a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:28.199652 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df920467-d162-46fa-8345-8dedc412a82a None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:28.199935 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df920467-d162-46fa-8345-8dedc412a82a None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:28.200212 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df920467-d162-46fa-8345-8dedc412a82a None admin] PATH_INFO: `/v3/services` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:28.200929 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df920467-d162-46fa-8345-8dedc412a82a None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:28.201231 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df920467-d162-46fa-8345-8dedc412a82a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:28.202608 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df920467-d162-46fa-8345-8dedc412a82a None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:28.212981 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 460/914] 10.222.0.15 () {56 vars in 1114 bytes} [Fri Aug 5 02:08:28 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:28.213953 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df920467-d162-46fa-8345-8dedc412a82a None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:28.261970 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:28.268173 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b7f4c7-8729-4a3d-8114-3c133ec021b8 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:28.306036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c93aa-9b45-4445-96e8-f80d1d7d1233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:28.306686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c93aa-9b45-4445-96e8-f80d1d7d1233 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:28.306968 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c93aa-9b45-4445-96e8-f80d1d7d1233 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:28.307248 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99c93aa-9b45-4445-96e8-f80d1d7d1233 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:28.314383 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c93aa-9b45-4445-96e8-f80d1d7d1233 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:28.315820 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99c93aa-9b45-4445-96e8-f80d1d7d1233 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:28.327989 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-b99c93aa-9b45-4445-96e8-f80d1d7d1233 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:08:28.327989 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:28.327989 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:28.327989 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:28.327989 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:28.327989 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:28.327989 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:28.327989 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:28.327989 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:28.327989 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:28.327989 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:28.327989 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:28.327989 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:08:28.327989 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:08:28.327989 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:08:28.330083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:08:28.330083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:28.330083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:28.330083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:28.330083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:28.330083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:28.330083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:28.330083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:28.330083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:28.330083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:28.330083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:28.330083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:28.330083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:28.330083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:28.330083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:28.330083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:28.330083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:28.332189 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:08:28.332189 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:08:28.332189 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:08:28.332189 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:08:28.332189 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:08:28.332189 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:08:28.332189 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:08:28.332189 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:28.333840 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 455/915] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:08:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:08:28.337892 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c93aa-9b45-4445-96e8-f80d1d7d1233 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:28.340871 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df920467-d162-46fa-8345-8dedc412a82a None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:28.356109 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:28.382718 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aeb4f8-b004-4ef1-bdcd-c26ac3705443 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:28.383680 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aeb4f8-b004-4ef1-bdcd-c26ac3705443 None admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:28.384138 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aeb4f8-b004-4ef1-bdcd-c26ac3705443 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:28.384598 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aeb4f8-b004-4ef1-bdcd-c26ac3705443 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:28.385563 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aeb4f8-b004-4ef1-bdcd-c26ac3705443 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:28.387070 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99aeb4f8-b004-4ef1-bdcd-c26ac3705443 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:28.421114 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 461/916] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:08:28 2022] POST /identity/v3/endpoints => generated 346 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:08:28.452656 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99c93aa-9b45-4445-96e8-f80d1d7d1233 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:28.498041 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef0567-83a1-4509-888d-d354ca823d2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:28.498668 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef0567-83a1-4509-888d-d354ca823d2f None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:28.498951 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef0567-83a1-4509-888d-d354ca823d2f None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:28.499239 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef0567-83a1-4509-888d-d354ca823d2f None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:28.499995 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef0567-83a1-4509-888d-d354ca823d2f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:28.500303 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef0567-83a1-4509-888d-d354ca823d2f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:28.502067 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5ef0567-83a1-4509-888d-d354ca823d2f None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:28.517351 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 456/917] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Aug 5 02:08:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:28.523715 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aeb4f8-b004-4ef1-bdcd-c26ac3705443 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:28.627704 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e44ae-89a5-427e-9818-11cb8e5fc0e4 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:28.628035 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e44ae-89a5-427e-9818-11cb8e5fc0e4 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:28.628256 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6e44ae-89a5-427e-9818-11cb8e5fc0e4 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:28.634102 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 457/918] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:08:28.635747 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270d50a-2df5-43dc-96b7-5573e84226bc None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:28.636092 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270d50a-2df5-43dc-96b7-5573e84226bc None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:28.636469 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b270d50a-2df5-43dc-96b7-5573e84226bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:28.640517 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:28.647919 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aeb4f8-b004-4ef1-bdcd-c26ac3705443 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:28.657150 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-b270d50a-2df5-43dc-96b7-5573e84226bc None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:28.658917 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-b270d50a-2df5-43dc-96b7-5573e84226bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:28.698315 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195428d-226e-4b91-b23e-0bc74102de4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:28.699241 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195428d-226e-4b91-b23e-0bc74102de4f None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:28.699697 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195428d-226e-4b91-b23e-0bc74102de4f None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:28.700145 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d195428d-226e-4b91-b23e-0bc74102de4f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:28.701153 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d195428d-226e-4b91-b23e-0bc74102de4f None admin] RBAC: Adding query filter params (role.id=27e54d7ab8954b0bbd5f964610e01cea, scope.project.id=95d88dece7184bf1842c4f8d275d52cd, user.id=36970f0778384576b599cd7217b5084d) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:28.701646 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d195428d-226e-4b91-b23e-0bc74102de4f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:28.703758 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d195428d-226e-4b91-b23e-0bc74102de4f None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:28.712174 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 462/919] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:08:28 2022] GET /identity/v3/role_assignments?user.id=36970f0778384576b599cd7217b5084d&scope.project.id=95d88dece7184bf1842c4f8d275d52cd&role.id=27e54d7ab8954b0bbd5f964610e01cea => generated 259 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:28.738948 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 458/920] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 02:08:28.740509 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:28.763573 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195428d-226e-4b91-b23e-0bc74102de4f None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:28.876600 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d195428d-226e-4b91-b23e-0bc74102de4f None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:28.911753 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d82ea-01ce-47af-b0db-b80ce161f660 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:28.912411 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d82ea-01ce-47af-b0db-b80ce161f660 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:28.912691 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d82ea-01ce-47af-b0db-b80ce161f660 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:28.912960 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d8d82ea-01ce-47af-b0db-b80ce161f660 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:28.913579 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d82ea-01ce-47af-b0db-b80ce161f660 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:28.914936 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d8d82ea-01ce-47af-b0db-b80ce161f660 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:28.924018 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-6d8d82ea-01ce-47af-b0db-b80ce161f660 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 02:08:28.924018 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:28.924018 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:08:28.924018 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:08:28.924018 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:08:28.924018 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:08:28.924018 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:08:28.924018 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:08:28.924018 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 02:08:28.924018 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:28.924018 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:08:28.924018 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:28.924018 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:28.924018 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:28.924018 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:28.924018 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:28.924018 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:28.925259 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:28.925259 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:28.925259 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:28.925259 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:28.925259 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:28.925259 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:28.925259 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:08:28.925259 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:08:28.925259 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:08:28.925259 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:08:28.925259 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:28.925259 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:28.925259 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:28.925259 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:28.925259 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:28.925259 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:28.926913 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:28.926913 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:28.926913 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:28.926913 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:28.926913 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:28.926913 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:28.926913 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:28.926913 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:28.926913 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:28.926913 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:28.926913 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:08:28.926913 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:08:28.926913 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 02:08:28.926913 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:28.930798 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 463/921] 10.222.0.15 () {56 vars in 1126 bytes} [Fri Aug 5 02:08:28 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:28.932127 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270d50a-2df5-43dc-96b7-5573e84226bc None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:29.038687 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b270d50a-2df5-43dc-96b7-5573e84226bc None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:29.074594 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe07b6-07ec-412a-b577-6c9b8058d625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:29.075215 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe07b6-07ec-412a-b577-6c9b8058d625 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:29.075487 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe07b6-07ec-412a-b577-6c9b8058d625 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:29.075755 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fe07b6-07ec-412a-b577-6c9b8058d625 None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:29.076512 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe07b6-07ec-412a-b577-6c9b8058d625 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:29.076812 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe07b6-07ec-412a-b577-6c9b8058d625 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:29.078164 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fe07b6-07ec-412a-b577-6c9b8058d625 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:29.084181 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 459/922] 10.222.0.15 () {56 vars in 1122 bytes} [Fri Aug 5 02:08:28 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:29.089760 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d82ea-01ce-47af-b0db-b80ce161f660 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:29.120118 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:29.200252 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d8d82ea-01ce-47af-b0db-b80ce161f660 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:29.240688 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c97aa5-2abf-4217-9938-e0fd270843e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:29.241887 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c97aa5-2abf-4217-9938-e0fd270843e5 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:29.242386 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c97aa5-2abf-4217-9938-e0fd270843e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:29.242874 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9c97aa5-2abf-4217-9938-e0fd270843e5 None admin] PATH_INFO: `/v3/services` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:29.243780 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c97aa5-2abf-4217-9938-e0fd270843e5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:29.244298 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c97aa5-2abf-4217-9938-e0fd270843e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:29.245928 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9c97aa5-2abf-4217-9938-e0fd270843e5 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:29.251846 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 464/923] 10.222.0.15 () {56 vars in 1122 bytes} [Fri Aug 5 02:08:29 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:29.257962 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe07b6-07ec-412a-b577-6c9b8058d625 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:29.323853 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:29.368640 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fe07b6-07ec-412a-b577-6c9b8058d625 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:29.403126 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69a63948-e61d-449a-aaf7-229b65843a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:29.403747 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a63948-e61d-449a-aaf7-229b65843a0a None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:29.404025 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a63948-e61d-449a-aaf7-229b65843a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:29.404296 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69a63948-e61d-449a-aaf7-229b65843a0a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:29.405081 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a63948-e61d-449a-aaf7-229b65843a0a None admin] RBAC: Adding query filter params (interface=public, service_id=2274e5f9f7e14c8681be2b48ac28b00e, region_id=RegionOne) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:29.405386 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a63948-e61d-449a-aaf7-229b65843a0a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:29.406732 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69a63948-e61d-449a-aaf7-229b65843a0a None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:29.412579 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 460/924] 10.222.0.15 () {56 vars in 1251 bytes} [Fri Aug 5 02:08:29 2022] GET /identity/v3/endpoints?service_id=2274e5f9f7e14c8681be2b48ac28b00e&interface=public®ion_id=RegionOne => generated 194 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:29.418018 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c97aa5-2abf-4217-9938-e0fd270843e5 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:29.512907 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:29.526983 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9c97aa5-2abf-4217-9938-e0fd270843e5 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:29.566536 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d2c4139-17e1-411f-80a1-5c2f0ce1239d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:29.568112 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c4139-17e1-411f-80a1-5c2f0ce1239d None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:29.568653 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c4139-17e1-411f-80a1-5c2f0ce1239d None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:29.569133 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d2c4139-17e1-411f-80a1-5c2f0ce1239d None admin] PATH_INFO: `/v3/services` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:29.570000 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c4139-17e1-411f-80a1-5c2f0ce1239d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:29.571582 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d2c4139-17e1-411f-80a1-5c2f0ce1239d None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:29.578365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 465/925] 10.222.0.15 () {56 vars in 1087 bytes} [Fri Aug 5 02:08:29 2022] GET /identity/v3/services => generated 1497 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:08:29.650834 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fc5c5-d140-4839-9893-0df4f5e11186 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:29.651163 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fc5c5-d140-4839-9893-0df4f5e11186 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:29.651393 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fc5c5-d140-4839-9893-0df4f5e11186 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:29.653099 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 461/926] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:08:29.658663 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78293bc-fcb5-4084-8f79-18d63cb3454b None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:29.658956 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78293bc-fcb5-4084-8f79-18d63cb3454b None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:29.659231 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78293bc-fcb5-4084-8f79-18d63cb3454b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:29.679511 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-d78293bc-fcb5-4084-8f79-18d63cb3454b None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:29.680800 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-d78293bc-fcb5-4084-8f79-18d63cb3454b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:29.757651 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 466/927] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:08:29.780765 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4fc5c5-d140-4839-9893-0df4f5e11186 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:29.888154 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4fc5c5-d140-4839-9893-0df4f5e11186 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:29.915564 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:29.923305 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb423910-1ce2-4086-9d5d-95d4ba799132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:29.923950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb423910-1ce2-4086-9d5d-95d4ba799132 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:29.924226 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb423910-1ce2-4086-9d5d-95d4ba799132 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:29.924527 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb423910-1ce2-4086-9d5d-95d4ba799132 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:29.925152 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb423910-1ce2-4086-9d5d-95d4ba799132 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:29.927272 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb423910-1ce2-4086-9d5d-95d4ba799132 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:29.937285 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-cb423910-1ce2-4086-9d5d-95d4ba799132 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 02:08:29.937285 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:29.937285 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:08:29.937285 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:08:29.937285 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:08:29.937285 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:08:29.937285 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:08:29.937285 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:08:29.937285 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 02:08:29.937285 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:29.937285 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:08:29.937285 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:29.937285 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:29.937285 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:29.937285 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:29.937285 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:29.938306 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:29.938306 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:29.938306 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:29.938306 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:29.938306 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:29.938306 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:29.938306 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:29.938306 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:08:29.938306 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:08:29.938306 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:08:29.938306 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:08:29.938306 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:29.938306 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:29.938306 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:29.938306 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:29.938306 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:29.939745 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:29.939745 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:29.939745 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:29.939745 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:29.939745 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:29.939745 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:29.939745 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:29.939745 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:29.939745 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:29.939745 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:29.939745 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:29.939745 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:08:29.939745 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:08:29.939745 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 05 02:08:29.939745 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:29.939745 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 462/928] 10.222.0.15 () {56 vars in 1132 bytes} [Fri Aug 5 02:08:29 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:29.944351 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78293bc-fcb5-4084-8f79-18d63cb3454b None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:30.031388 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:30.054809 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78293bc-fcb5-4084-8f79-18d63cb3454b None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:30.092186 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956f3e1-03be-40f7-9213-751fe7c5d187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:30.093260 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956f3e1-03be-40f7-9213-751fe7c5d187 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:30.093748 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956f3e1-03be-40f7-9213-751fe7c5d187 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:30.094222 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c956f3e1-03be-40f7-9213-751fe7c5d187 None admin] PATH_INFO: `/v3/services` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:30.095348 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956f3e1-03be-40f7-9213-751fe7c5d187 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:30.095866 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956f3e1-03be-40f7-9213-751fe7c5d187 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:30.097462 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c956f3e1-03be-40f7-9213-751fe7c5d187 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:30.103394 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 467/929] 10.222.0.15 () {56 vars in 1126 bytes} [Fri Aug 5 02:08:29 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:30.108784 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb423910-1ce2-4086-9d5d-95d4ba799132 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:30.212681 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb423910-1ce2-4086-9d5d-95d4ba799132 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:30.250583 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7868c1f9-e642-4512-be32-2d793150bf44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:30.251213 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868c1f9-e642-4512-be32-2d793150bf44 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:30.251491 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868c1f9-e642-4512-be32-2d793150bf44 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:30.251765 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7868c1f9-e642-4512-be32-2d793150bf44 None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:30.252542 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7868c1f9-e642-4512-be32-2d793150bf44 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:30.252841 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7868c1f9-e642-4512-be32-2d793150bf44 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:30.254742 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7868c1f9-e642-4512-be32-2d793150bf44 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:30.260157 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 463/930] 10.222.0.15 () {56 vars in 1126 bytes} [Fri Aug 5 02:08:30 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:30.265651 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956f3e1-03be-40f7-9213-751fe7c5d187 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:30.372623 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c956f3e1-03be-40f7-9213-751fe7c5d187 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:30.408583 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299fd00a-f337-420d-ad68-6c4b108abf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:30.409205 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fd00a-f337-420d-ad68-6c4b108abf97 None admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:30.409483 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fd00a-f337-420d-ad68-6c4b108abf97 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:30.409750 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299fd00a-f337-420d-ad68-6c4b108abf97 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:30.410509 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299fd00a-f337-420d-ad68-6c4b108abf97 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:30.411997 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299fd00a-f337-420d-ad68-6c4b108abf97 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:30.434699 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 468/931] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:08:30 2022] POST /identity/v3/endpoints => generated 347 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:08:30.652865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656330f-353e-450a-b26a-c7d338dccd30 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:30.653215 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656330f-353e-450a-b26a-c7d338dccd30 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:30.653326 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7656330f-353e-450a-b26a-c7d338dccd30 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:30.654909 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 464/932] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:08:30.660099 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab1533-54b7-49b4-8368-3b500a848171 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:30.660522 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab1533-54b7-49b4-8368-3b500a848171 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:30.660896 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab1533-54b7-49b4-8368-3b500a848171 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:30.667265 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:30.680071 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-52ab1533-54b7-49b4-8368-3b500a848171 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:30.681329 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-52ab1533-54b7-49b4-8368-3b500a848171 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:30.757915 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 469/933] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:08:30.780869 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656330f-353e-450a-b26a-c7d338dccd30 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:30.844096 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:30.891049 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7656330f-353e-450a-b26a-c7d338dccd30 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:30.925790 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb30b0-28df-4b4f-866c-762dadf8b8a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:30.927067 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb30b0-28df-4b4f-866c-762dadf8b8a9 None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:30.927343 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb30b0-28df-4b4f-866c-762dadf8b8a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:30.927609 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bb30b0-28df-4b4f-866c-762dadf8b8a9 None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:30.928356 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb30b0-28df-4b4f-866c-762dadf8b8a9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:30.929777 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bb30b0-28df-4b4f-866c-762dadf8b8a9 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:30.932408 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: WARNING keystone.server.flask.common [None req-c0bb30b0-28df-4b4f-866c-762dadf8b8a9 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 05 02:08:30.940194 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929757d-d1ee-4551-b1bf-cc3dcca86202 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:30.940497 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929757d-d1ee-4551-b1bf-cc3dcca86202 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:30.940766 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1929757d-d1ee-4551-b1bf-cc3dcca86202 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:30.942962 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 470/934] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:08:30.949718 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e81e0-04d3-4865-9074-1b9be0625f73 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:30.950127 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e81e0-04d3-4865-9074-1b9be0625f73 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:30.950494 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875e81e0-04d3-4865-9074-1b9be0625f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:30.956874 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.sql.core [None req-c0bb30b0-28df-4b4f-866c-762dadf8b8a9 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 05 02:08:30.956874 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 05 02:08:30.956874 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [parameters: {'id': 'bbe301b27a3d4ca48a84356f03f19dbb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 05 02:08:30.956874 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80443) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 05 02:08:30.970682 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-875e81e0-04d3-4865-9074-1b9be0625f73 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:30.972028 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-875e81e0-04d3-4865-9074-1b9be0625f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:30.974828 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-c0bb30b0-28df-4b4f-866c-762dadf8b8a9 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bbe301b27a3d4ca48a84356f03f19dbb.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bbe301b27a3d4ca48a84356f03f19dbb. Aug 05 02:08:30.974828 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:30.974828 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 05 02:08:30.974828 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 05 02:08:30.974828 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 05 02:08:30.974828 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 05 02:08:30.974828 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 05 02:08:30.974828 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application result = self._query(query) Aug 05 02:08:30.974828 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 05 02:08:30.974828 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application conn.query(q) Aug 05 02:08:30.974828 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 05 02:08:30.974828 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 05 02:08:30.974828 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 05 02:08:30.975804 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application result.read() Aug 05 02:08:30.975804 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 05 02:08:30.975804 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 05 02:08:30.975804 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 05 02:08:30.975804 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 05 02:08:30.975804 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 05 02:08:30.975804 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 05 02:08:30.975804 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 05 02:08:30.975804 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 05 02:08:30.975804 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 05 02:08:30.975804 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:30.975804 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 05 02:08:30.975804 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:30.975804 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:30.975804 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 05 02:08:30.975804 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 05 02:08:30.975804 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 05 02:08:30.975804 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 05 02:08:30.976971 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 05 02:08:30.976971 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application next(self.gen) Aug 05 02:08:30.976971 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 05 02:08:30.976971 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application yield resource Aug 05 02:08:30.976971 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 05 02:08:30.976971 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application next(self.gen) Aug 05 02:08:30.976971 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 05 02:08:30.976971 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self.session.rollback() Aug 05 02:08:30.976971 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 05 02:08:30.976971 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self.force_reraise() Aug 05 02:08:30.976971 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 05 02:08:30.976971 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise self.value Aug 05 02:08:30.976971 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 05 02:08:30.976971 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 05 02:08:30.976971 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 05 02:08:30.976971 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application session.commit() Aug 05 02:08:30.976971 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 05 02:08:30.977937 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 05 02:08:30.977937 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 05 02:08:30.977937 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._prepare_impl() Aug 05 02:08:30.977937 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 05 02:08:30.977937 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self.session.flush() Aug 05 02:08:30.977937 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 05 02:08:30.977937 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._flush(objects) Aug 05 02:08:30.977937 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 05 02:08:30.977937 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 05 02:08:30.977937 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 05 02:08:30.977937 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application compat.raise_( Aug 05 02:08:30.977937 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 05 02:08:30.977937 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception Aug 05 02:08:30.977937 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 05 02:08:30.977937 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application flush_context.execute() Aug 05 02:08:30.977937 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 05 02:08:30.977937 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rec.execute(self) Aug 05 02:08:30.978902 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 05 02:08:30.978902 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 05 02:08:30.978902 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 05 02:08:30.978902 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 05 02:08:30.978902 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 05 02:08:30.978902 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 05 02:08:30.978902 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 05 02:08:30.978902 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 05 02:08:30.978902 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 05 02:08:30.978902 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 05 02:08:30.978902 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 05 02:08:30.978902 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 05 02:08:30.978902 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 05 02:08:30.978902 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 05 02:08:30.978902 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 05 02:08:30.979688 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 05 02:08:30.979688 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 05 02:08:30.979688 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception Aug 05 02:08:30.979688 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 05 02:08:30.979688 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 05 02:08:30.979688 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 05 02:08:30.979688 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 05 02:08:30.979688 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 05 02:08:30.979688 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application result = self._query(query) Aug 05 02:08:30.979688 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 05 02:08:30.979688 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application conn.query(q) Aug 05 02:08:30.979688 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 05 02:08:30.979688 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 05 02:08:30.979688 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 05 02:08:30.979688 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application result.read() Aug 05 02:08:30.979688 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 05 02:08:30.979688 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 05 02:08:30.980617 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 05 02:08:30.980617 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 05 02:08:30.980617 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 05 02:08:30.980617 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 05 02:08:30.980617 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 05 02:08:30.980617 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 05 02:08:30.980617 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 05 02:08:30.980617 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 05 02:08:30.980617 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [parameters: {'id': 'bbe301b27a3d4ca48a84356f03f19dbb', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 05 02:08:30.980617 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 05 02:08:30.980617 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:30.980617 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:08:30.980617 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:30.980617 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:30.980617 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 05 02:08:30.981476 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 05 02:08:30.981476 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 05 02:08:30.981476 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 05 02:08:30.981476 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 05 02:08:30.981476 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:30.981476 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:08:30.981476 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:30.981476 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:30.981476 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:30.981476 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:30.981476 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:30.981476 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:30.981476 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:30.981476 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:30.981476 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:30.981476 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:30.981476 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:30.982579 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:30.982579 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 05 02:08:30.982579 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 05 02:08:30.982579 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:30.982579 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:30.982579 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 05 02:08:30.982579 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 05 02:08:30.982579 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bbe301b27a3d4ca48a84356f03f19dbb. Aug 05 02:08:30.982579 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:30.982579 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 465/935] 10.222.0.15 () {60 vars in 1140 bytes} [Fri Aug 5 02:08:30 2022] POST /identity/v3/projects => generated 262 bytes in 196 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:30.988398 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb30b0-28df-4b4f-866c-762dadf8b8a9 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:31.068430 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 471/936] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:08:31.086573 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e81e0-04d3-4865-9074-1b9be0625f73 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:31.115017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bb30b0-28df-4b4f-866c-762dadf8b8a9 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:31.138141 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:31.158003 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:31.171852 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c19c62-b2b6-4641-ad1c-f833bf195790 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:31.173105 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c19c62-b2b6-4641-ad1c-f833bf195790 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:31.173592 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c19c62-b2b6-4641-ad1c-f833bf195790 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:31.174945 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c19c62-b2b6-4641-ad1c-f833bf195790 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:31.184705 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c19c62-b2b6-4641-ad1c-f833bf195790 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:31.187115 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c19c62-b2b6-4641-ad1c-f833bf195790 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:31.204217 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-40c19c62-b2b6-4641-ad1c-f833bf195790 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:08:31.204217 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:31.204217 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:31.204217 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:31.204217 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:31.204217 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:31.204217 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:31.204217 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:31.204217 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:31.204217 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:31.204217 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:31.204217 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:31.204217 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:08:31.204217 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:08:31.204217 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:08:31.205201 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:08:31.205201 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:31.205201 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:31.205201 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:31.205201 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:31.205201 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:31.205201 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:31.205201 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:31.205201 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:31.205201 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:31.205201 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:31.205201 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:31.205201 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:31.205201 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:31.205201 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:31.205201 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:31.205201 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:31.206106 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:08:31.206106 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:08:31.206106 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:08:31.206106 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:08:31.206106 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:08:31.206106 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:08:31.206106 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:08:31.206106 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:31.209625 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 466/937] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:08:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:31.214921 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875e81e0-04d3-4865-9074-1b9be0625f73 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:31.215437 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c19c62-b2b6-4641-ad1c-f833bf195790 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:31.257612 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638bd0db-cc7b-47fb-bdc8-a4bd90f0ef16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:31.258739 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638bd0db-cc7b-47fb-bdc8-a4bd90f0ef16 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:31.259222 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638bd0db-cc7b-47fb-bdc8-a4bd90f0ef16 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:31.259695 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-638bd0db-cc7b-47fb-bdc8-a4bd90f0ef16 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:31.272211 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-638bd0db-cc7b-47fb-bdc8-a4bd90f0ef16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:08:31.278450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-638bd0db-cc7b-47fb-bdc8-a4bd90f0ef16 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 02:08:31.278450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:31.278450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:31.278450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:31.278450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:31.278450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:31.278450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:31.278450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:31.278450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:31.278450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:31.278450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:31.278450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:31.278450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:08:31.278450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:08:31.278450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:08:31.278450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:08:31.279402 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:08:31.279402 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:08:31.279402 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:08:31.279402 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:08:31.279402 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:31.279402 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:31.279402 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:31.279402 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:31.279402 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:31.279402 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:31.279402 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:31.279402 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:31.279402 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:31.279402 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:31.279402 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:31.279402 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:31.280244 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:31.280244 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:31.280244 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:31.280244 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:31.280244 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:08:31.280244 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:08:31.280244 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:08:31.280244 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:08:31.280244 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:08:31.280244 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:08:31.280244 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 02:08:31.280244 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:31.287819 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 472/938] 10.222.0.15 () {56 vars in 1120 bytes} [Fri Aug 5 02:08:31 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:08:31.289136 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638bd0db-cc7b-47fb-bdc8-a4bd90f0ef16 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:31.320284 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c19c62-b2b6-4641-ad1c-f833bf195790 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:31.357431 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01ac5c-19d5-4cde-9361-4131beae6f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:31.358045 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01ac5c-19d5-4cde-9361-4131beae6f4d None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:31.358321 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01ac5c-19d5-4cde-9361-4131beae6f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:31.358838 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf01ac5c-19d5-4cde-9361-4131beae6f4d None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:31.359301 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01ac5c-19d5-4cde-9361-4131beae6f4d None admin] RBAC: Adding query filter params (name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:31.359598 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01ac5c-19d5-4cde-9361-4131beae6f4d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:31.361031 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf01ac5c-19d5-4cde-9361-4131beae6f4d None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:31.388633 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 467/939] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Aug 5 02:08:31 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:31.406160 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-638bd0db-cc7b-47fb-bdc8-a4bd90f0ef16 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:31.428596 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:31.450837 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854338b6-b4b1-4f90-8868-48761a5f2918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:31.451840 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854338b6-b4b1-4f90-8868-48761a5f2918 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:31.452348 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854338b6-b4b1-4f90-8868-48761a5f2918 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:31.452847 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-854338b6-b4b1-4f90-8868-48761a5f2918 None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:31.453906 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854338b6-b4b1-4f90-8868-48761a5f2918 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:31.454419 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854338b6-b4b1-4f90-8868-48761a5f2918 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:31.456171 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-854338b6-b4b1-4f90-8868-48761a5f2918 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:31.466924 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 473/940] 10.222.0.15 () {56 vars in 1115 bytes} [Fri Aug 5 02:08:31 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:31.473455 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01ac5c-19d5-4cde-9361-4131beae6f4d None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:31.510264 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:31.590974 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf01ac5c-19d5-4cde-9361-4131beae6f4d None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:31.629744 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc608dd-bac7-48c3-8d9a-87bfc9831052 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:31.630764 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc608dd-bac7-48c3-8d9a-87bfc9831052 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:31.631248 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc608dd-bac7-48c3-8d9a-87bfc9831052 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:31.631736 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc608dd-bac7-48c3-8d9a-87bfc9831052 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:31.645735 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc608dd-bac7-48c3-8d9a-87bfc9831052 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:31.647536 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc608dd-bac7-48c3-8d9a-87bfc9831052 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:31.663183 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-0bc608dd-bac7-48c3-8d9a-87bfc9831052 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:31.663183 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:31.663183 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:31.663183 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:31.663183 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:31.663183 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:31.663183 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:31.663183 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:31.663183 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:31.663183 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:31.663183 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:31.663183 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:31.663183 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:08:31.663183 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:08:31.663183 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:08:31.664130 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:08:31.664130 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:31.664130 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:31.664130 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:31.664130 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:31.664130 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:31.664130 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:31.664130 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:31.664130 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:31.664130 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:31.664130 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:31.664130 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:31.664130 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:31.664130 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:31.664130 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:31.664130 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:31.664130 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:31.665054 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:08:31.665054 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:08:31.665054 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:31.665054 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:31.667282 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 468/941] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:31.673188 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854338b6-b4b1-4f90-8868-48761a5f2918 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:31.755142 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e934a-c638-437b-8bd6-04ae31db32b1 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:31.755639 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e934a-c638-437b-8bd6-04ae31db32b1 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:31.756024 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e934a-c638-437b-8bd6-04ae31db32b1 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:31.757668 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 469/942] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:08:31.762459 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90f58c-ef48-4e85-b4e6-722f2e749801 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:31.763064 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90f58c-ef48-4e85-b4e6-722f2e749801 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:31.763222 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd90f58c-ef48-4e85-b4e6-722f2e749801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:31.782466 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-bd90f58c-ef48-4e85-b4e6-722f2e749801 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:31.783846 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-bd90f58c-ef48-4e85-b4e6-722f2e749801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:31.789219 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-854338b6-b4b1-4f90-8868-48761a5f2918 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:31.825181 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceab90f-b0d0-4257-95a7-5d58b94196e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:31.826087 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceab90f-b0d0-4257-95a7-5d58b94196e7 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:31.826560 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceab90f-b0d0-4257-95a7-5d58b94196e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:31.827006 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dceab90f-b0d0-4257-95a7-5d58b94196e7 None admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:31.827872 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceab90f-b0d0-4257-95a7-5d58b94196e7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:31.828384 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceab90f-b0d0-4257-95a7-5d58b94196e7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:31.829935 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dceab90f-b0d0-4257-95a7-5d58b94196e7 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:31.845933 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 474/943] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:08:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:31.852234 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceab90f-b0d0-4257-95a7-5d58b94196e7 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:31.872431 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 470/944] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:31 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 02:08:31.889924 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd90f58c-ef48-4e85-b4e6-722f2e749801 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:31.908566 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:31.914587 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:31.981319 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dceab90f-b0d0-4257-95a7-5d58b94196e7 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:32.007678 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd90f58c-ef48-4e85-b4e6-722f2e749801 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:32.018150 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251e0fe-1e16-4e58-b00e-b0f76f3e5878 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:32.018756 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251e0fe-1e16-4e58-b00e-b0f76f3e5878 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:32.019151 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251e0fe-1e16-4e58-b00e-b0f76f3e5878 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:32.019518 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251e0fe-1e16-4e58-b00e-b0f76f3e5878 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:32.027438 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251e0fe-1e16-4e58-b00e-b0f76f3e5878 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:32.028949 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251e0fe-1e16-4e58-b00e-b0f76f3e5878 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:32.041574 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-3251e0fe-1e16-4e58-b00e-b0f76f3e5878 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 02:08:32.041574 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:32.041574 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:32.041574 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:32.041574 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:32.041574 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:32.041574 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:32.041574 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:32.041574 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:32.041574 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:32.041574 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:32.041574 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:32.041574 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:08:32.041574 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:08:32.041574 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:08:32.041574 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:08:32.042691 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:32.042691 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:32.042691 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:08:32.042691 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:08:32.042691 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:08:32.042691 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:08:32.042691 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:32.042691 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:32.042691 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:32.042691 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:32.042691 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:32.042691 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:32.042691 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:32.042691 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:32.042691 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:32.042691 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:32.042691 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:32.042691 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:32.048896 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:32.048896 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:32.048896 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:08:32.048896 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:08:32.048896 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:08:32.048896 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:08:32.048896 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:08:32.048896 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:08:32.048896 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 02:08:32.048896 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:32.048896 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 475/945] 10.222.0.15 () {56 vars in 1117 bytes} [Fri Aug 5 02:08:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:32.049537 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251e0fe-1e16-4e58-b00e-b0f76f3e5878 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:32.055165 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8a2b6-87cf-43bc-a4d5-1bebd3b75b41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:32.055820 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8a2b6-87cf-43bc-a4d5-1bebd3b75b41 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:32.056098 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8a2b6-87cf-43bc-a4d5-1bebd3b75b41 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:32.056475 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c8a2b6-87cf-43bc-a4d5-1bebd3b75b41 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:32.057131 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c8a2b6-87cf-43bc-a4d5-1bebd3b75b41 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:32.058478 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c8a2b6-87cf-43bc-a4d5-1bebd3b75b41 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:32.070891 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-92c8a2b6-87cf-43bc-a4d5-1bebd3b75b41 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 02:08:32.070891 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:32.070891 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:08:32.070891 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:08:32.070891 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:08:32.070891 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:08:32.070891 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:08:32.070891 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:08:32.070891 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 02:08:32.070891 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:32.070891 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:08:32.070891 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:32.070891 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:32.070891 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:32.070891 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:32.070891 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:32.070891 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:32.071930 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:32.071930 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:32.071930 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:32.071930 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:32.071930 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:32.071930 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:32.071930 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:08:32.071930 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:08:32.071930 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:08:32.071930 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:08:32.071930 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:32.071930 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:32.071930 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:32.071930 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:32.071930 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:32.071930 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:32.072803 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:32.072803 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:32.072803 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:32.072803 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:32.072803 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:32.072803 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:32.072803 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:32.072803 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:32.072803 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:32.072803 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:32.072803 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:08:32.072803 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:08:32.072803 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 02:08:32.072803 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:32.076406 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 471/946] 10.222.0.15 () {56 vars in 1126 bytes} [Fri Aug 5 02:08:31 2022] GET /identity/v3/services/object-store => generated 93 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:32.078899 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8a2b6-87cf-43bc-a4d5-1bebd3b75b41 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:32.173186 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:32.181804 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:32.187291 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251e0fe-1e16-4e58-b00e-b0f76f3e5878 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:32.196458 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c8a2b6-87cf-43bc-a4d5-1bebd3b75b41 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:32.232113 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c8484-1e7f-4786-961e-8eb9a779b918 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:32.232354 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60afdda4-7538-4de6-a98e-c9388fbad99c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:32.232885 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60afdda4-7538-4de6-a98e-c9388fbad99c None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:32.233165 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60afdda4-7538-4de6-a98e-c9388fbad99c None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:32.233439 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60afdda4-7538-4de6-a98e-c9388fbad99c None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:32.233908 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c8484-1e7f-4786-961e-8eb9a779b918 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:32.234124 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60afdda4-7538-4de6-a98e-c9388fbad99c None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:32.234428 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60afdda4-7538-4de6-a98e-c9388fbad99c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:32.234815 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c8484-1e7f-4786-961e-8eb9a779b918 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:32.235296 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2c8484-1e7f-4786-961e-8eb9a779b918 None admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:32.235780 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60afdda4-7538-4de6-a98e-c9388fbad99c None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:32.236532 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c8484-1e7f-4786-961e-8eb9a779b918 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:32.237135 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c8484-1e7f-4786-961e-8eb9a779b918 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:32.239671 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2c8484-1e7f-4786-961e-8eb9a779b918 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:32.245857 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 472/947] 10.222.0.15 () {56 vars in 1122 bytes} [Fri Aug 5 02:08:32 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:32.248047 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60afdda4-7538-4de6-a98e-c9388fbad99c None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:32.266281 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 476/948] 10.222.0.15 () {56 vars in 1149 bytes} [Fri Aug 5 02:08:32 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:32.272085 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c8484-1e7f-4786-961e-8eb9a779b918 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:32.356002 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60afdda4-7538-4de6-a98e-c9388fbad99c None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:32.390433 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04effac9-66d1-4a64-b4a8-96cfee8488be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:32.391062 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04effac9-66d1-4a64-b4a8-96cfee8488be None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:32.391253 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2c8484-1e7f-4786-961e-8eb9a779b918 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:32.391702 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04effac9-66d1-4a64-b4a8-96cfee8488be None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:32.391702 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04effac9-66d1-4a64-b4a8-96cfee8488be None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:32.392259 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04effac9-66d1-4a64-b4a8-96cfee8488be None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:32.392605 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04effac9-66d1-4a64-b4a8-96cfee8488be None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:32.393977 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04effac9-66d1-4a64-b4a8-96cfee8488be None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:32.404099 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 473/949] 10.222.0.15 () {56 vars in 1122 bytes} [Fri Aug 5 02:08:32 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:32.407282 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04effac9-66d1-4a64-b4a8-96cfee8488be None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:32.417398 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:32.443831 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb78aa-cd8f-4129-ab06-4afff4d0c7e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:32.444941 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb78aa-cd8f-4129-ab06-4afff4d0c7e3 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:32.445435 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb78aa-cd8f-4129-ab06-4afff4d0c7e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:32.446082 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59eb78aa-cd8f-4129-ab06-4afff4d0c7e3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:32.460778 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb78aa-cd8f-4129-ab06-4afff4d0c7e3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:32.463314 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59eb78aa-cd8f-4129-ab06-4afff4d0c7e3 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:32.484933 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-59eb78aa-cd8f-4129-ab06-4afff4d0c7e3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:32.484933 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:32.484933 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:32.484933 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:32.484933 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:32.484933 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:32.484933 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:32.484933 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:32.484933 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:32.484933 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:32.484933 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:32.484933 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:32.484933 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:08:32.484933 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:08:32.484933 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:08:32.485870 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:08:32.485870 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:32.485870 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:32.485870 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:32.485870 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:32.485870 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:32.485870 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:32.485870 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:32.485870 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:32.485870 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:32.485870 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:32.485870 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:32.485870 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:32.485870 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:32.485870 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:32.485870 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:32.485870 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:32.486765 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:08:32.486765 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:08:32.486765 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:32.486765 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:32.490242 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 477/950] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:08:32.499675 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb78aa-cd8f-4129-ab06-4afff4d0c7e3 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:32.513391 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:32.528067 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04effac9-66d1-4a64-b4a8-96cfee8488be None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:32.566022 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd676eab-1418-4207-a66f-b9e64b2b9475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:32.567291 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd676eab-1418-4207-a66f-b9e64b2b9475 None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:32.567706 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd676eab-1418-4207-a66f-b9e64b2b9475 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:32.567983 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd676eab-1418-4207-a66f-b9e64b2b9475 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:32.568725 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd676eab-1418-4207-a66f-b9e64b2b9475 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:32.570097 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd676eab-1418-4207-a66f-b9e64b2b9475 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:32.600004 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 474/951] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:08:32 2022] POST /identity/v3/endpoints => generated 349 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:08:32.600004 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b98b2f-3b3a-4f6d-8159-23eb9b2ba93b None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:32.600004 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b98b2f-3b3a-4f6d-8159-23eb9b2ba93b None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:32.600004 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b98b2f-3b3a-4f6d-8159-23eb9b2ba93b None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:32.600004 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 475/952] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:08:32.601964 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a95d4-b94c-439d-bcd2-b5bd18110d38 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:32.602256 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a95d4-b94c-439d-bcd2-b5bd18110d38 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:32.602536 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2a95d4-b94c-439d-bcd2-b5bd18110d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:32.623289 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-3a2a95d4-b94c-439d-bcd2-b5bd18110d38 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:32.624546 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-3a2a95d4-b94c-439d-bcd2-b5bd18110d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:32.631160 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59eb78aa-cd8f-4129-ab06-4afff4d0c7e3 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:32.685442 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0fa91-0b85-477d-9cfa-eb63247cf94a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:32.686082 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0fa91-0b85-477d-9cfa-eb63247cf94a None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:32.686366 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0fa91-0b85-477d-9cfa-eb63247cf94a None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:32.686687 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f0fa91-0b85-477d-9cfa-eb63247cf94a None admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:32.687455 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0fa91-0b85-477d-9cfa-eb63247cf94a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:32.687810 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0fa91-0b85-477d-9cfa-eb63247cf94a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:32.689292 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f0fa91-0b85-477d-9cfa-eb63247cf94a None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:32.702731 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:32.704090 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 478/953] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:08:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:32.712107 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0fa91-0b85-477d-9cfa-eb63247cf94a None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:32.725886 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 476/954] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:08:32.742759 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a95d4-b94c-439d-bcd2-b5bd18110d38 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:32.798559 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:32.856605 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f0fa91-0b85-477d-9cfa-eb63247cf94a None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:32.860803 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2a95d4-b94c-439d-bcd2-b5bd18110d38 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:32.900001 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4332440-c0fa-45b2-b237-d712b0340456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:32.900675 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4332440-c0fa-45b2-b237-d712b0340456 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:32.900962 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4332440-c0fa-45b2-b237-d712b0340456 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:32.901239 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4332440-c0fa-45b2-b237-d712b0340456 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:32.901871 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4332440-c0fa-45b2-b237-d712b0340456 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:32.903457 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4332440-c0fa-45b2-b237-d712b0340456 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:32.906789 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299de80-2bb1-4d2f-96ca-70616782c8fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:32.907803 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299de80-2bb1-4d2f-96ca-70616782c8fa None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:32.908175 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299de80-2bb1-4d2f-96ca-70616782c8fa None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:32.908571 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f299de80-2bb1-4d2f-96ca-70616782c8fa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:32.913192 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-a4332440-c0fa-45b2-b237-d712b0340456 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 02:08:32.913192 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:32.913192 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:08:32.913192 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:08:32.913192 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:08:32.913192 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:08:32.913192 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:08:32.913192 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:08:32.913192 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 02:08:32.913192 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:32.913192 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:08:32.913192 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:32.913192 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:32.913192 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:32.913192 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:32.913192 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:32.913192 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:32.914518 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:32.914518 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:32.914518 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:32.914518 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:32.914518 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:32.914518 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:32.914518 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:08:32.914518 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:08:32.914518 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:08:32.914518 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:08:32.914518 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:32.914518 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:32.914518 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:32.914518 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:32.914518 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:32.914518 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:32.915631 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:32.915631 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:32.915631 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:32.915631 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:32.915631 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:32.915631 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:32.915631 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:32.915631 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:32.915631 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:32.915631 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:32.915631 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:08:32.915631 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:08:32.915631 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 02:08:32.915631 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:32.915631 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 477/955] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:08:32 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:32.917082 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299de80-2bb1-4d2f-96ca-70616782c8fa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:32.918583 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f299de80-2bb1-4d2f-96ca-70616782c8fa None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:32.923336 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4332440-c0fa-45b2-b237-d712b0340456 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:32.933385 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-f299de80-2bb1-4d2f-96ca-70616782c8fa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:08:32.933385 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:32.933385 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:32.933385 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:32.933385 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:32.933385 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:32.933385 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:32.933385 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:32.933385 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:32.933385 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:32.933385 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:32.933385 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:32.933385 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:08:32.933385 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:08:32.933385 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:08:32.934424 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:08:32.934424 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:32.934424 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:32.934424 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:32.934424 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:32.934424 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:32.934424 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:32.934424 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:32.934424 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:32.934424 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:32.934424 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:32.934424 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:32.934424 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:32.934424 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:32.934424 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:32.934424 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:32.934424 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:32.935336 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:08:32.935336 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:08:32.935336 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:08:32.935336 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:08:32.935336 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:08:32.935336 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:08:32.935336 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:08:32.935336 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:32.935336 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 479/956] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:08:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:32.940121 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299de80-2bb1-4d2f-96ca-70616782c8fa None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:33.004195 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:33.051857 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4332440-c0fa-45b2-b237-d712b0340456 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:33.067109 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f299de80-2bb1-4d2f-96ca-70616782c8fa None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:33.088209 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb71b0-2ab9-4ec8-9e7d-211e0b5cc32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:33.088877 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb71b0-2ab9-4ec8-9e7d-211e0b5cc32c None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:33.089161 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb71b0-2ab9-4ec8-9e7d-211e0b5cc32c None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:33.089439 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddb71b0-2ab9-4ec8-9e7d-211e0b5cc32c None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:33.090124 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb71b0-2ab9-4ec8-9e7d-211e0b5cc32c None admin] RBAC: Adding query filter params (name=compute) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:33.090429 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb71b0-2ab9-4ec8-9e7d-211e0b5cc32c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:33.091795 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddb71b0-2ab9-4ec8-9e7d-211e0b5cc32c None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:33.101450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:33.102529 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 478/957] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Aug 5 02:08:32 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:33.103840 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb71b0-2ab9-4ec8-9e7d-211e0b5cc32c None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:33.113135 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e027ce02-5488-46f1-8370-ae88e135e7d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:33.115030 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027ce02-5488-46f1-8370-ae88e135e7d4 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:33.115526 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027ce02-5488-46f1-8370-ae88e135e7d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:33.115992 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e027ce02-5488-46f1-8370-ae88e135e7d4 None admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:33.117344 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e027ce02-5488-46f1-8370-ae88e135e7d4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:33.117861 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e027ce02-5488-46f1-8370-ae88e135e7d4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:33.120045 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e027ce02-5488-46f1-8370-ae88e135e7d4 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:33.137357 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 480/958] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Aug 5 02:08:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:33.142762 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e027ce02-5488-46f1-8370-ae88e135e7d4 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:33.226032 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddb71b0-2ab9-4ec8-9e7d-211e0b5cc32c None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:33.248889 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:33.249179 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e027ce02-5488-46f1-8370-ae88e135e7d4 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:33.265553 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e0eb7-0e1d-4b69-ac86-5ff7a8dc8dd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:33.266273 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e0eb7-0e1d-4b69-ac86-5ff7a8dc8dd0 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:33.266562 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e0eb7-0e1d-4b69-ac86-5ff7a8dc8dd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:33.266839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e0eb7-0e1d-4b69-ac86-5ff7a8dc8dd0 None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:33.267520 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e0eb7-0e1d-4b69-ac86-5ff7a8dc8dd0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:33.267824 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e0eb7-0e1d-4b69-ac86-5ff7a8dc8dd0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:33.269302 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e0eb7-0e1d-4b69-ac86-5ff7a8dc8dd0 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:33.279511 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 479/959] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Aug 5 02:08:33 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:33.283366 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6e108bd-29a6-4398-8d76-cf4cba789933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:33.284060 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e108bd-29a6-4398-8d76-cf4cba789933 None admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:33.284350 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e108bd-29a6-4398-8d76-cf4cba789933 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:33.284644 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6e108bd-29a6-4398-8d76-cf4cba789933 None admin] PATH_INFO: `/v3/projects/95d88dece7184bf1842c4f8d275d52cd/users/36970f0778384576b599cd7217b5084d/roles/27e54d7ab8954b0bbd5f964610e01cea` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:33.287500 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e108bd-29a6-4398-8d76-cf4cba789933 None admin] RBAC: Authorizing `identity:create_grant(project_id=95d88dece7184bf1842c4f8d275d52cd, user_id=36970f0778384576b599cd7217b5084d, role_id=27e54d7ab8954b0bbd5f964610e01cea)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:33.289021 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6e108bd-29a6-4398-8d76-cf4cba789933 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:33.307040 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 481/960] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Aug 5 02:08:33 2022] PUT /identity/v3/projects/95d88dece7184bf1842c4f8d275d52cd/users/36970f0778384576b599cd7217b5084d/roles/27e54d7ab8954b0bbd5f964610e01cea => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:08:33.537522 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391428e-58f7-4a48-b75f-28bfdef319f6 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:33.538076 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391428e-58f7-4a48-b75f-28bfdef319f6 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:33.538076 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f391428e-58f7-4a48-b75f-28bfdef319f6 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:33.539759 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 480/961] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:08:33.545030 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4f221-44c3-4fdd-be32-03b514e6067d None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:33.545446 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4f221-44c3-4fdd-be32-03b514e6067d None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:33.545553 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a4f221-44c3-4fdd-be32-03b514e6067d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:33.563734 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-31a4f221-44c3-4fdd-be32-03b514e6067d None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:33.564886 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-31a4f221-44c3-4fdd-be32-03b514e6067d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:33.613115 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:33.640029 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 482/962] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 02:08:33.664642 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391428e-58f7-4a48-b75f-28bfdef319f6 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:33.774656 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f391428e-58f7-4a48-b75f-28bfdef319f6 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:33.811298 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a7de8-4636-4bcf-86f9-4f6e23242dd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:33.811919 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a7de8-4636-4bcf-86f9-4f6e23242dd7 None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:33.812199 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a7de8-4636-4bcf-86f9-4f6e23242dd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:33.812526 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e73a7de8-4636-4bcf-86f9-4f6e23242dd7 None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:33.813219 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a7de8-4636-4bcf-86f9-4f6e23242dd7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:33.814690 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e73a7de8-4636-4bcf-86f9-4f6e23242dd7 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:33.835638 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.sql.core [None req-e73a7de8-4636-4bcf-86f9-4f6e23242dd7 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 05 02:08:33.835638 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 05 02:08:33.835638 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [parameters: {'user_id': 'd59128c3df99467fa9993e1de58fc8a6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 05 02:08:33.835638 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80443) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 05 02:08:33.843959 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-e73a7de8-4636-4bcf-86f9-4f6e23242dd7 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 05 02:08:33.843959 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:33.843959 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 05 02:08:33.843959 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 05 02:08:33.843959 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 05 02:08:33.843959 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 05 02:08:33.843959 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 05 02:08:33.843959 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application result = self._query(query) Aug 05 02:08:33.843959 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 05 02:08:33.843959 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application conn.query(q) Aug 05 02:08:33.843959 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 05 02:08:33.843959 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 05 02:08:33.843959 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 05 02:08:33.843959 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application result.read() Aug 05 02:08:33.843959 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 05 02:08:33.845142 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 05 02:08:33.845142 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 05 02:08:33.845142 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 05 02:08:33.845142 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 05 02:08:33.845142 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 05 02:08:33.845142 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 05 02:08:33.845142 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 05 02:08:33.845142 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 05 02:08:33.845142 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:33.845142 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 05 02:08:33.845142 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:33.845142 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:33.845142 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 05 02:08:33.845142 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 05 02:08:33.845142 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 05 02:08:33.845142 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 05 02:08:33.845142 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 05 02:08:33.845142 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application next(self.gen) Aug 05 02:08:33.846094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 05 02:08:33.846094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application yield resource Aug 05 02:08:33.846094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 05 02:08:33.846094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application next(self.gen) Aug 05 02:08:33.846094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 05 02:08:33.846094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self.session.rollback() Aug 05 02:08:33.846094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 05 02:08:33.846094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self.force_reraise() Aug 05 02:08:33.846094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 05 02:08:33.846094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise self.value Aug 05 02:08:33.846094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 05 02:08:33.846094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 05 02:08:33.846094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 05 02:08:33.846094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application session.commit() Aug 05 02:08:33.846094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 05 02:08:33.846094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 05 02:08:33.846094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 05 02:08:33.847013 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._prepare_impl() Aug 05 02:08:33.847013 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 05 02:08:33.847013 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self.session.flush() Aug 05 02:08:33.847013 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 05 02:08:33.847013 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._flush(objects) Aug 05 02:08:33.847013 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 05 02:08:33.847013 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 05 02:08:33.847013 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 05 02:08:33.847013 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application compat.raise_( Aug 05 02:08:33.847013 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 05 02:08:33.847013 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception Aug 05 02:08:33.847013 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 05 02:08:33.847013 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application flush_context.execute() Aug 05 02:08:33.847013 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 05 02:08:33.847013 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rec.execute(self) Aug 05 02:08:33.847013 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 05 02:08:33.847013 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 05 02:08:33.849017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 05 02:08:33.849017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 05 02:08:33.849017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 05 02:08:33.849017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 05 02:08:33.849017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Aug 05 02:08:33.849017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 05 02:08:33.849017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Aug 05 02:08:33.849017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 05 02:08:33.849017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Aug 05 02:08:33.849017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 05 02:08:33.849017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Aug 05 02:08:33.849017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 05 02:08:33.849017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Aug 05 02:08:33.849017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 05 02:08:33.849017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 05 02:08:33.849017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception Aug 05 02:08:33.851100 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Aug 05 02:08:33.851100 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 05 02:08:33.851100 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 05 02:08:33.851100 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 05 02:08:33.851100 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 05 02:08:33.851100 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application result = self._query(query) Aug 05 02:08:33.851100 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 05 02:08:33.851100 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application conn.query(q) Aug 05 02:08:33.851100 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 05 02:08:33.851100 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 05 02:08:33.851100 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 05 02:08:33.851100 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application result.read() Aug 05 02:08:33.851100 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 05 02:08:33.851100 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 05 02:08:33.851100 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 05 02:08:33.851100 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 05 02:08:33.853149 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 05 02:08:33.853149 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 05 02:08:33.853149 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 05 02:08:33.853149 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 05 02:08:33.853149 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 05 02:08:33.853149 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 05 02:08:33.853149 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [parameters: {'user_id': 'd59128c3df99467fa9993e1de58fc8a6', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 05 02:08:33.853149 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 05 02:08:33.853149 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:33.853149 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:08:33.853149 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:33.853149 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:33.853149 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:33.853149 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:33.853149 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:33.855067 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:33.855067 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:33.855067 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:33.855067 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:33.855067 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:33.855067 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:33.855067 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:33.855067 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 05 02:08:33.855067 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 05 02:08:33.855067 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:33.855067 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:33.855067 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:08:33.855067 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:08:33.855067 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:08:33.855067 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:08:33.855067 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 05 02:08:33.855067 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 05 02:08:33.857379 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 05 02:08:33.857379 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 05 02:08:33.857379 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 05 02:08:33.857379 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 05 02:08:33.857379 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 05 02:08:33.857379 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:33.857379 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 481/963] 10.222.0.15 () {60 vars in 1131 bytes} [Fri Aug 5 02:08:33 2022] POST /identity/v3/users => generated 160 bytes in 182 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:33.858289 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4f221-44c3-4fdd-be32-03b514e6067d None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:33.963690 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a4f221-44c3-4fdd-be32-03b514e6067d None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:33.999632 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b308cad-32c6-460e-bb14-1bf90087660d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:34.000269 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b308cad-32c6-460e-bb14-1bf90087660d None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:34.000575 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b308cad-32c6-460e-bb14-1bf90087660d None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:34.000847 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b308cad-32c6-460e-bb14-1bf90087660d None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:34.008766 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b308cad-32c6-460e-bb14-1bf90087660d None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:34.010190 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b308cad-32c6-460e-bb14-1bf90087660d None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:34.022269 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-2b308cad-32c6-460e-bb14-1bf90087660d None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 02:08:34.022269 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:34.022269 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:34.022269 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:34.022269 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:34.022269 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:34.022269 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:34.022269 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:34.022269 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:34.022269 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:34.022269 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:34.022269 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:34.022269 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:08:34.022269 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:08:34.022269 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:08:34.022269 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:08:34.024161 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:34.024161 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:34.024161 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:08:34.024161 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:08:34.024161 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:08:34.024161 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:08:34.024161 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:34.024161 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:34.024161 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:34.024161 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:34.024161 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:34.024161 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:34.024161 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:34.024161 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:34.024161 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:34.024161 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:34.024161 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:34.024161 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:34.025455 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:34.025455 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:34.025455 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:08:34.025455 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:08:34.025455 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:08:34.025455 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:08:34.025455 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:08:34.025455 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:08:34.025455 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 05 02:08:34.025455 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:34.025455 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 483/964] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:08:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:34.029530 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a7de8-4636-4bcf-86f9-4f6e23242dd7 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:34.080940 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:34.137668 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e73a7de8-4636-4bcf-86f9-4f6e23242dd7 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:34.171667 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb1d91b-7942-4100-bb91-56d5a23df201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:34.172287 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1d91b-7942-4100-bb91-56d5a23df201 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:34.172593 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1d91b-7942-4100-bb91-56d5a23df201 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:34.172865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb1d91b-7942-4100-bb91-56d5a23df201 None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:34.173692 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb1d91b-7942-4100-bb91-56d5a23df201 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:34.173996 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb1d91b-7942-4100-bb91-56d5a23df201 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:34.175597 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb1d91b-7942-4100-bb91-56d5a23df201 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:34.215090 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 482/965] 10.222.0.15 () {56 vars in 1101 bytes} [Fri Aug 5 02:08:34 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:34.758781 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6adca-8b90-457f-81ad-aaab1957d548 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:34.759325 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6adca-8b90-457f-81ad-aaab1957d548 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:34.759325 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb6adca-8b90-457f-81ad-aaab1957d548 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:34.760742 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 484/966] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:08:34.765902 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e283c-d7b9-49d1-920c-8dd9efcff6d7 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:34.766282 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e283c-d7b9-49d1-920c-8dd9efcff6d7 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:34.766455 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062e283c-d7b9-49d1-920c-8dd9efcff6d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:34.784476 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-062e283c-d7b9-49d1-920c-8dd9efcff6d7 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:34.786622 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-062e283c-d7b9-49d1-920c-8dd9efcff6d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:34.857710 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 483/967] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:34 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:08:34.880596 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6adca-8b90-457f-81ad-aaab1957d548 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:34.917453 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:34.991908 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb6adca-8b90-457f-81ad-aaab1957d548 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:35.027480 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4ce71-1779-4cb2-8cb6-fbca6c01f415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:35.028036 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4ce71-1779-4cb2-8cb6-fbca6c01f415 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:35.028312 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4ce71-1779-4cb2-8cb6-fbca6c01f415 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:35.028609 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a4ce71-1779-4cb2-8cb6-fbca6c01f415 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:35.029240 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a4ce71-1779-4cb2-8cb6-fbca6c01f415 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:35.030592 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a4ce71-1779-4cb2-8cb6-fbca6c01f415 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:35.040273 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-21a4ce71-1779-4cb2-8cb6-fbca6c01f415 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 02:08:35.040273 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:35.040273 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:08:35.040273 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:08:35.040273 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:08:35.040273 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:08:35.040273 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:08:35.040273 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:08:35.040273 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 02:08:35.040273 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:35.040273 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:08:35.040273 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:35.040273 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:35.040273 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:35.040273 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:35.040273 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:35.040273 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:35.041320 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:35.041320 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:35.041320 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:35.041320 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:35.041320 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:35.041320 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:35.041320 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:08:35.041320 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:08:35.041320 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:08:35.041320 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:08:35.041320 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:35.041320 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:35.041320 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:35.041320 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:35.041320 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:35.041320 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:35.042170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:35.042170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:35.042170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:35.042170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:35.042170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:35.042170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:35.042170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:35.042170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:35.042170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:35.042170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:35.042170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:08:35.042170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:08:35.042170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 02:08:35.042170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:35.044382 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 485/968] 10.222.0.15 () {56 vars in 1126 bytes} [Fri Aug 5 02:08:34 2022] GET /identity/v3/services/object-store => generated 93 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:35.047385 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e283c-d7b9-49d1-920c-8dd9efcff6d7 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:35.081654 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:35.149041 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062e283c-d7b9-49d1-920c-8dd9efcff6d7 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:35.183181 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcd5da-36ae-4649-b8a6-21b032cfc99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:35.183800 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcd5da-36ae-4649-b8a6-21b032cfc99a None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:35.184079 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcd5da-36ae-4649-b8a6-21b032cfc99a None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:35.184367 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcd5da-36ae-4649-b8a6-21b032cfc99a None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:35.185050 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fcd5da-36ae-4649-b8a6-21b032cfc99a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:35.185350 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fcd5da-36ae-4649-b8a6-21b032cfc99a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:35.186694 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fcd5da-36ae-4649-b8a6-21b032cfc99a None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:35.191829 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 484/969] 10.222.0.15 () {56 vars in 1122 bytes} [Fri Aug 5 02:08:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:35.197447 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4ce71-1779-4cb2-8cb6-fbca6c01f415 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:35.298452 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:35.301993 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a4ce71-1779-4cb2-8cb6-fbca6c01f415 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:35.336656 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad3e5c4c-27d7-4d1c-915b-1a2d66dc46c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:35.337278 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e5c4c-27d7-4d1c-915b-1a2d66dc46c4 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:35.337553 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e5c4c-27d7-4d1c-915b-1a2d66dc46c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:35.337818 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad3e5c4c-27d7-4d1c-915b-1a2d66dc46c4 None admin] PATH_INFO: `/v3/services` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:35.338486 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e5c4c-27d7-4d1c-915b-1a2d66dc46c4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:35.338782 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e5c4c-27d7-4d1c-915b-1a2d66dc46c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:35.340131 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad3e5c4c-27d7-4d1c-915b-1a2d66dc46c4 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:35.350709 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 486/970] 10.222.0.15 () {56 vars in 1122 bytes} [Fri Aug 5 02:08:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:35.351975 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcd5da-36ae-4649-b8a6-21b032cfc99a None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:35.390283 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec81ac-11e5-4b31-bd8c-fbfa81e45212 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:35.390608 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec81ac-11e5-4b31-bd8c-fbfa81e45212 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:35.390878 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1ec81ac-11e5-4b31-bd8c-fbfa81e45212 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:35.392382 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 487/971] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:08:35.397761 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08786500-d428-487b-8ab7-e45a1b5f41f4 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:35.398034 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08786500-d428-487b-8ab7-e45a1b5f41f4 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:35.398357 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08786500-d428-487b-8ab7-e45a1b5f41f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:35.417239 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-08786500-d428-487b-8ab7-e45a1b5f41f4 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:35.418418 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-08786500-d428-487b-8ab7-e45a1b5f41f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:35.450487 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:35.454468 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcd5da-36ae-4649-b8a6-21b032cfc99a None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:35.485000 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 488/972] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 02:08:35.486275 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106ec96-f83a-4115-9f9a-d821840e95fc None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:35.486558 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106ec96-f83a-4115-9f9a-d821840e95fc None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:35.486829 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f106ec96-f83a-4115-9f9a-d821840e95fc None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:35.488076 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 489/973] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:08:35.489899 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845925ba-a735-4b6c-8d7e-1aeebe735a3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:35.490516 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845925ba-a735-4b6c-8d7e-1aeebe735a3b None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:35.490794 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845925ba-a735-4b6c-8d7e-1aeebe735a3b None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:35.491062 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845925ba-a735-4b6c-8d7e-1aeebe735a3b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:35.491821 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845925ba-a735-4b6c-8d7e-1aeebe735a3b None admin] RBAC: Adding query filter params (interface=admin, service_id=2274e5f9f7e14c8681be2b48ac28b00e, region_id=RegionOne) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:35.492123 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845925ba-a735-4b6c-8d7e-1aeebe735a3b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:35.493495 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-845925ba-a735-4b6c-8d7e-1aeebe735a3b None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:35.493624 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fa59d-c85e-4580-af87-a961e00df064 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:35.493825 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fa59d-c85e-4580-af87-a961e00df064 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:35.494100 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2fa59d-c85e-4580-af87-a961e00df064 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:35.503386 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 485/974] 10.222.0.15 () {56 vars in 1249 bytes} [Fri Aug 5 02:08:35 2022] GET /identity/v3/endpoints?service_id=2274e5f9f7e14c8681be2b48ac28b00e&interface=admin®ion_id=RegionOne => generated 193 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:35.505119 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845925ba-a735-4b6c-8d7e-1aeebe735a3b None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:35.512925 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-dd2fa59d-c85e-4580-af87-a961e00df064 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:35.514123 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-dd2fa59d-c85e-4580-af87-a961e00df064 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:35.579337 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 490/975] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:35 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 02:08:35.581307 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2fa59d-c85e-4580-af87-a961e00df064 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:35.604257 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845925ba-a735-4b6c-8d7e-1aeebe735a3b None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:35.607096 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:35.639205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9730966-35a5-4d0c-9f6d-c3341945cdef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:35.639822 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9730966-35a5-4d0c-9f6d-c3341945cdef None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:35.640103 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9730966-35a5-4d0c-9f6d-c3341945cdef None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:35.640408 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9730966-35a5-4d0c-9f6d-c3341945cdef None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:35.641069 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9730966-35a5-4d0c-9f6d-c3341945cdef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:35.642418 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9730966-35a5-4d0c-9f6d-c3341945cdef None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:35.648591 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 486/976] 10.222.0.15 () {56 vars in 1087 bytes} [Fri Aug 5 02:08:35 2022] GET /identity/v3/services => generated 1497 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:08:35.649361 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9730966-35a5-4d0c-9f6d-c3341945cdef None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:35.682128 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:35.688348 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd2fa59d-c85e-4580-af87-a961e00df064 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:35.727929 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914caf8-c7f4-4d04-898a-5e9357eb4900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:35.728714 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914caf8-c7f4-4d04-898a-5e9357eb4900 None admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:35.729001 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914caf8-c7f4-4d04-898a-5e9357eb4900 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:35.729282 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1914caf8-c7f4-4d04-898a-5e9357eb4900 None admin] PATH_INFO: `/v3/services` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:35.729991 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1914caf8-c7f4-4d04-898a-5e9357eb4900 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:35.731642 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1914caf8-c7f4-4d04-898a-5e9357eb4900 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:35.760355 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 491/977] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Aug 5 02:08:35 2022] POST /identity/v3/services => generated 242 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:08:35.777849 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9730966-35a5-4d0c-9f6d-c3341945cdef None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:35.834862 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03358900-59c5-4ab3-9b79-512fa673abdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:35.834862 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03358900-59c5-4ab3-9b79-512fa673abdc None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:35.834862 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03358900-59c5-4ab3-9b79-512fa673abdc None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:35.835108 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03358900-59c5-4ab3-9b79-512fa673abdc None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:35.847278 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03358900-59c5-4ab3-9b79-512fa673abdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:08:35.852634 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-03358900-59c5-4ab3-9b79-512fa673abdc None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 02:08:35.852634 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:35.852634 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:35.852634 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:35.852634 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:35.852634 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:35.852634 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:35.852634 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:35.852634 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:35.852634 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:35.852634 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:35.852634 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:35.852634 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:08:35.852634 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:08:35.852634 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:08:35.852634 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:08:35.853853 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:08:35.853853 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:08:35.853853 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:08:35.853853 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:08:35.853853 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:35.853853 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:35.853853 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:35.853853 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:35.853853 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:35.853853 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:35.853853 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:35.853853 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:35.853853 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:35.853853 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:35.853853 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:35.853853 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:35.854723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:35.854723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:35.854723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:35.854723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:35.854723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:08:35.854723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:08:35.854723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:08:35.854723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:08:35.854723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:08:35.854723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:08:35.854723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 02:08:35.854723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:35.854723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 487/978] 10.222.0.15 () {56 vars in 1120 bytes} [Fri Aug 5 02:08:35 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:35.860674 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914caf8-c7f4-4d04-898a-5e9357eb4900 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:35.955344 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:35.974058 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1914caf8-c7f4-4d04-898a-5e9357eb4900 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:36.009003 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19ea0a-b94b-4da9-91ab-9bcebe284e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:36.009619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19ea0a-b94b-4da9-91ab-9bcebe284e3c None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:36.009898 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19ea0a-b94b-4da9-91ab-9bcebe284e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:36.010170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe19ea0a-b94b-4da9-91ab-9bcebe284e3c None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:36.010879 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19ea0a-b94b-4da9-91ab-9bcebe284e3c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:36.011180 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19ea0a-b94b-4da9-91ab-9bcebe284e3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:36.012555 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe19ea0a-b94b-4da9-91ab-9bcebe284e3c None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:36.025787 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 492/979] 10.222.0.15 () {56 vars in 1115 bytes} [Fri Aug 5 02:08:35 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:36.028518 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03358900-59c5-4ab3-9b79-512fa673abdc None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:36.115412 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:36.134879 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03358900-59c5-4ab3-9b79-512fa673abdc None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:36.169975 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c306971-a68b-43cd-968f-fb31a1440c5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:36.170611 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c306971-a68b-43cd-968f-fb31a1440c5e None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:36.170885 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c306971-a68b-43cd-968f-fb31a1440c5e None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:36.171154 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c306971-a68b-43cd-968f-fb31a1440c5e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:36.181504 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c306971-a68b-43cd-968f-fb31a1440c5e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:36.182933 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c306971-a68b-43cd-968f-fb31a1440c5e None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:36.197976 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-1c306971-a68b-43cd-968f-fb31a1440c5e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:36.197976 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:36.197976 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:36.197976 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:36.197976 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:36.197976 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:36.197976 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:36.197976 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:36.197976 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:36.197976 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:36.197976 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:36.197976 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:36.197976 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:08:36.197976 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:08:36.197976 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:08:36.198953 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:08:36.198953 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:36.198953 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:36.198953 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:36.198953 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:36.198953 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:36.198953 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:36.198953 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:36.198953 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:36.198953 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:36.198953 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:36.198953 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:36.198953 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:36.198953 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:36.198953 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:36.198953 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:36.198953 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:36.204922 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:08:36.204922 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:08:36.204922 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:36.204922 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:36.204922 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 488/980] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:36.206674 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19ea0a-b94b-4da9-91ab-9bcebe284e3c None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:36.306689 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe19ea0a-b94b-4da9-91ab-9bcebe284e3c None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:36.340344 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ff6aa-c9b3-41ef-bb9b-64523b06535d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:36.340952 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ff6aa-c9b3-41ef-bb9b-64523b06535d None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:36.341228 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ff6aa-c9b3-41ef-bb9b-64523b06535d None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:36.341496 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6ff6aa-c9b3-41ef-bb9b-64523b06535d None admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:36.342174 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ff6aa-c9b3-41ef-bb9b-64523b06535d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:36.342550 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ff6aa-c9b3-41ef-bb9b-64523b06535d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:36.343907 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f6ff6aa-c9b3-41ef-bb9b-64523b06535d None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:36.355986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 493/981] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:36.361326 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c306971-a68b-43cd-968f-fb31a1440c5e None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:36.463385 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c306971-a68b-43cd-968f-fb31a1440c5e None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:36.498640 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9922e-fef0-4263-b768-521b7ca2ed41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:36.499280 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9922e-fef0-4263-b768-521b7ca2ed41 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:36.499580 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9922e-fef0-4263-b768-521b7ca2ed41 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:36.499850 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c9922e-fef0-4263-b768-521b7ca2ed41 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:36.501743 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:36.509407 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c9922e-fef0-4263-b768-521b7ca2ed41 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:36.510831 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c9922e-fef0-4263-b768-521b7ca2ed41 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:36.522046 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-44c9922e-fef0-4263-b768-521b7ca2ed41 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 02:08:36.522046 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:36.522046 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:36.522046 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:36.522046 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:36.522046 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:36.522046 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:36.522046 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:36.522046 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:36.522046 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:36.522046 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:36.522046 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:36.522046 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:08:36.522046 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:08:36.522046 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:08:36.522046 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:08:36.523018 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:36.523018 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:36.523018 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:08:36.523018 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:08:36.523018 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:08:36.523018 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:08:36.523018 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:36.523018 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:36.523018 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:36.523018 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:36.523018 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:36.523018 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:36.523018 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:36.523018 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:36.523018 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:36.523018 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:36.523018 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:36.523018 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:36.524555 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:36.524555 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:36.524555 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:08:36.524555 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:08:36.524555 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:08:36.524555 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:08:36.524555 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:08:36.524555 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:08:36.524555 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 05 02:08:36.524555 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:36.527966 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 489/982] 10.222.0.15 () {56 vars in 1117 bytes} [Fri Aug 5 02:08:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:08:36.528787 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ff6aa-c9b3-41ef-bb9b-64523b06535d None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:36.538678 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:36.630415 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6ff6aa-c9b3-41ef-bb9b-64523b06535d None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:36.663352 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42ebd6-8ad5-4681-b85d-327e990896c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:36.663962 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42ebd6-8ad5-4681-b85d-327e990896c9 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:36.664239 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42ebd6-8ad5-4681-b85d-327e990896c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:36.664541 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d42ebd6-8ad5-4681-b85d-327e990896c9 None admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:36.665316 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42ebd6-8ad5-4681-b85d-327e990896c9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:36.665619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42ebd6-8ad5-4681-b85d-327e990896c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:36.667020 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d42ebd6-8ad5-4681-b85d-327e990896c9 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:36.684169 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 494/983] 10.222.0.15 () {56 vars in 1149 bytes} [Fri Aug 5 02:08:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:36.689512 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9922e-fef0-4263-b768-521b7ca2ed41 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:36.788630 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c9922e-fef0-4263-b768-521b7ca2ed41 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:36.822635 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd36994-e3d6-4333-8e66-a855ad1699e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:36.823269 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd36994-e3d6-4333-8e66-a855ad1699e7 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:36.823546 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd36994-e3d6-4333-8e66-a855ad1699e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:36.823813 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd36994-e3d6-4333-8e66-a855ad1699e7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:36.890563 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:36.901156 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd36994-e3d6-4333-8e66-a855ad1699e7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:36.902623 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd36994-e3d6-4333-8e66-a855ad1699e7 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:37.002019 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 490/984] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:08:36 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 02:08:37.008033 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42ebd6-8ad5-4681-b85d-327e990896c9 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:37.069239 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:37.107893 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d42ebd6-8ad5-4681-b85d-327e990896c9 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:37.140897 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e4aa2-b3a0-4822-a4ca-0b82c5a7b3b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:37.141528 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e4aa2-b3a0-4822-a4ca-0b82c5a7b3b4 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:37.141805 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e4aa2-b3a0-4822-a4ca-0b82c5a7b3b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:37.142073 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7e4aa2-b3a0-4822-a4ca-0b82c5a7b3b4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:37.152399 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e4aa2-b3a0-4822-a4ca-0b82c5a7b3b4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:37.153820 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7e4aa2-b3a0-4822-a4ca-0b82c5a7b3b4 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:37.168748 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-2c7e4aa2-b3a0-4822-a4ca-0b82c5a7b3b4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:37.168748 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:37.168748 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:37.168748 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:37.168748 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:37.168748 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:37.168748 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:37.168748 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:37.168748 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:37.168748 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:37.168748 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:37.168748 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:37.168748 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:08:37.168748 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:08:37.168748 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:08:37.169747 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:08:37.169747 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:37.169747 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:37.169747 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:37.169747 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:37.169747 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:37.169747 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:37.169747 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:37.169747 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:37.169747 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:37.169747 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:37.169747 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:37.169747 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:37.169747 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:37.169747 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:37.169747 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:37.169747 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:37.170729 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:08:37.170729 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:08:37.170729 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:37.170729 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:37.170729 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 495/985] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:37.176904 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd36994-e3d6-4333-8e66-a855ad1699e7 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:37.270029 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:37.277781 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd36994-e3d6-4333-8e66-a855ad1699e7 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:37.312831 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343d280-8afe-4826-a829-4209d35fca35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:37.313443 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343d280-8afe-4826-a829-4209d35fca35 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:37.313719 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343d280-8afe-4826-a829-4209d35fca35 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:37.313987 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2343d280-8afe-4826-a829-4209d35fca35 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:37.314671 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343d280-8afe-4826-a829-4209d35fca35 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:37.314968 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343d280-8afe-4826-a829-4209d35fca35 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:37.316353 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2343d280-8afe-4826-a829-4209d35fca35 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:37.332638 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 491/986] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:08:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:37.334377 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e4aa2-b3a0-4822-a4ca-0b82c5a7b3b4 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:37.438764 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7e4aa2-b3a0-4822-a4ca-0b82c5a7b3b4 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:37.455542 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:37.474971 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629519ef-1e22-43e9-abb6-ff2e190813a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:37.475606 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629519ef-1e22-43e9-abb6-ff2e190813a8 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:37.475883 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629519ef-1e22-43e9-abb6-ff2e190813a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:37.476154 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629519ef-1e22-43e9-abb6-ff2e190813a8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:37.482815 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629519ef-1e22-43e9-abb6-ff2e190813a8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:37.484236 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629519ef-1e22-43e9-abb6-ff2e190813a8 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:37.496223 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-629519ef-1e22-43e9-abb6-ff2e190813a8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:08:37.496223 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:37.496223 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:37.496223 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:37.496223 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:37.496223 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:37.496223 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:37.496223 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:37.496223 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:37.496223 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:37.496223 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:37.496223 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:37.496223 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:08:37.496223 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:08:37.496223 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:08:37.497305 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:08:37.497305 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:37.497305 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:37.497305 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:37.497305 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:37.497305 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:37.497305 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:37.497305 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:37.497305 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:37.497305 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:37.497305 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:37.497305 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:37.497305 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:37.497305 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:37.497305 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:37.497305 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:37.497305 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:37.505282 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:08:37.505282 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:08:37.505282 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:08:37.505282 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:08:37.505282 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:08:37.505282 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:08:37.505282 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:08:37.505282 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:37.505282 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 496/987] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:08:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:37.506320 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343d280-8afe-4826-a829-4209d35fca35 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:37.606937 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2343d280-8afe-4826-a829-4209d35fca35 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:37.640564 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202cf5ba-dbe3-42a9-9e3d-d19199af9631 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:37.641181 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202cf5ba-dbe3-42a9-9e3d-d19199af9631 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:37.641458 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202cf5ba-dbe3-42a9-9e3d-d19199af9631 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:37.641731 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202cf5ba-dbe3-42a9-9e3d-d19199af9631 None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:37.642475 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202cf5ba-dbe3-42a9-9e3d-d19199af9631 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:37.642774 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202cf5ba-dbe3-42a9-9e3d-d19199af9631 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:37.644175 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202cf5ba-dbe3-42a9-9e3d-d19199af9631 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:37.661538 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 492/988] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Aug 5 02:08:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:37.663332 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629519ef-1e22-43e9-abb6-ff2e190813a8 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:37.761214 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2817ff0-c382-427d-a598-8963c187f731 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:37.761496 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2817ff0-c382-427d-a598-8963c187f731 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:37.761772 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2817ff0-c382-427d-a598-8963c187f731 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:37.763287 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 493/989] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:08:37.764168 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629519ef-1e22-43e9-abb6-ff2e190813a8 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:37.767958 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8444ab6-114b-462a-8f2d-c285b36d19d4 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:37.768239 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8444ab6-114b-462a-8f2d-c285b36d19d4 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:37.768617 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8444ab6-114b-462a-8f2d-c285b36d19d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:37.790342 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-e8444ab6-114b-462a-8f2d-c285b36d19d4 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:37.792723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-e8444ab6-114b-462a-8f2d-c285b36d19d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:37.800474 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc0256c-0a63-46c9-b6f7-92bcc0d958de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:37.801615 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0256c-0a63-46c9-b6f7-92bcc0d958de None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:37.801894 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0256c-0a63-46c9-b6f7-92bcc0d958de None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:37.802160 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc0256c-0a63-46c9-b6f7-92bcc0d958de None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:37.802944 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0256c-0a63-46c9-b6f7-92bcc0d958de None admin] RBAC: Adding query filter params (role.id=27e54d7ab8954b0bbd5f964610e01cea, scope.project.id=95d88dece7184bf1842c4f8d275d52cd, user.id=36970f0778384576b599cd7217b5084d) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:37.803247 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0256c-0a63-46c9-b6f7-92bcc0d958de None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:37.804689 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc0256c-0a63-46c9-b6f7-92bcc0d958de None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:37.805209 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:37.819088 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 497/990] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:08:37 2022] GET /identity/v3/role_assignments?user.id=36970f0778384576b599cd7217b5084d&scope.project.id=95d88dece7184bf1842c4f8d275d52cd&role.id=27e54d7ab8954b0bbd5f964610e01cea => generated 608 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:37.819088 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5258e65-123d-45ad-b4e3-2d6e2f50df8f None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:37.819088 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5258e65-123d-45ad-b4e3-2d6e2f50df8f None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:37.819088 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5258e65-123d-45ad-b4e3-2d6e2f50df8f None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:37.819088 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 498/991] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:08:37.824448 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b20ae7-bb29-4712-9149-699d9e930c62 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:37.824740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b20ae7-bb29-4712-9149-699d9e930c62 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:37.825021 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b20ae7-bb29-4712-9149-699d9e930c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:37.847573 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-63b20ae7-bb29-4712-9149-699d9e930c62 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:37.849109 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-63b20ae7-bb29-4712-9149-699d9e930c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:37.884156 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 494/992] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:37 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 02:08:37.895962 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:37.907213 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8444ab6-114b-462a-8f2d-c285b36d19d4 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:37.940504 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 499/993] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:37 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 02:08:37.962342 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b20ae7-bb29-4712-9149-699d9e930c62 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:38.021066 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8444ab6-114b-462a-8f2d-c285b36d19d4 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:38.057943 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c96f93-2d84-4266-8c0f-9e846040e4dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:38.058690 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c96f93-2d84-4266-8c0f-9e846040e4dc None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:38.059040 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c96f93-2d84-4266-8c0f-9e846040e4dc None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:38.059321 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c96f93-2d84-4266-8c0f-9e846040e4dc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:38.059950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c96f93-2d84-4266-8c0f-9e846040e4dc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:38.061342 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c96f93-2d84-4266-8c0f-9e846040e4dc None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:38.070775 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b20ae7-bb29-4712-9149-699d9e930c62 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:38.071250 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-32c96f93-2d84-4266-8c0f-9e846040e4dc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 02:08:38.071250 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:38.071250 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:08:38.071250 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:08:38.071250 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:08:38.071250 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:08:38.071250 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:08:38.071250 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:08:38.071250 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 02:08:38.071250 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:38.071250 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:08:38.071250 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:38.071250 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:38.071250 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:38.071250 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:38.071250 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:38.071250 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:38.072200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:38.072200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:38.072200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:38.072200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:38.072200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:38.072200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:38.072200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:08:38.072200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:08:38.072200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:08:38.072200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:08:38.072200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:38.072200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:38.072200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:38.072200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:38.072200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:38.072200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:38.073803 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:38.073803 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:38.073803 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:38.073803 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:38.073803 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:38.073803 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:38.073803 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:38.073803 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:38.073803 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:38.073803 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:38.073803 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:08:38.073803 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:08:38.073803 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 05 02:08:38.073803 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:38.073803 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 495/994] 10.222.0.15 () {56 vars in 1126 bytes} [Fri Aug 5 02:08:37 2022] GET /identity/v3/services/object-store => generated 93 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:08:38.078043 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c96f93-2d84-4266-8c0f-9e846040e4dc None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:38.090082 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:38.118210 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8268c-0f43-42ae-bc2a-6bae9c82816f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:38.118854 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8268c-0f43-42ae-bc2a-6bae9c82816f None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:38.119135 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8268c-0f43-42ae-bc2a-6bae9c82816f None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:38.119411 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ba8268c-0f43-42ae-bc2a-6bae9c82816f None admin] PATH_INFO: `/v3/services/compute` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:38.120038 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba8268c-0f43-42ae-bc2a-6bae9c82816f None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:38.121509 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ba8268c-0f43-42ae-bc2a-6bae9c82816f None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:38.131008 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-8ba8268c-0f43-42ae-bc2a-6bae9c82816f None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 02:08:38.131008 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:38.131008 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:08:38.131008 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:08:38.131008 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:08:38.131008 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:08:38.131008 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:08:38.131008 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:08:38.131008 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 02:08:38.131008 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:38.131008 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:08:38.131008 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:38.131008 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:38.131008 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:38.131008 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:38.131008 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:38.131008 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:38.132069 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:38.132069 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:38.132069 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:38.132069 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:38.132069 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:38.132069 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:38.132069 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:08:38.132069 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:08:38.132069 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:08:38.132069 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:08:38.132069 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:38.132069 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:38.132069 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:38.132069 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:38.132069 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:38.132069 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:38.133397 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:38.133397 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:38.133397 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:38.133397 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:38.133397 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:38.133397 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:38.133397 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:38.133397 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:38.133397 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:38.133397 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:38.133397 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:08:38.133397 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:08:38.133397 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 02:08:38.133397 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:38.133397 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 500/995] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:08:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:08:38.137952 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8268c-0f43-42ae-bc2a-6bae9c82816f None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:38.176696 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:38.189837 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c96f93-2d84-4266-8c0f-9e846040e4dc None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:38.226736 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689340fe-95c2-49cf-8cde-28955c5f81f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:38.227755 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689340fe-95c2-49cf-8cde-28955c5f81f2 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:38.228036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689340fe-95c2-49cf-8cde-28955c5f81f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:38.228312 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689340fe-95c2-49cf-8cde-28955c5f81f2 None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:38.229371 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689340fe-95c2-49cf-8cde-28955c5f81f2 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:38.229678 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689340fe-95c2-49cf-8cde-28955c5f81f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:38.231425 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689340fe-95c2-49cf-8cde-28955c5f81f2 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:38.236567 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 496/996] 10.222.0.15 () {56 vars in 1122 bytes} [Fri Aug 5 02:08:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:38.242548 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689340fe-95c2-49cf-8cde-28955c5f81f2 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:38.253251 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ba8268c-0f43-42ae-bc2a-6bae9c82816f None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:38.291187 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7377a4-c6c9-467a-b7e2-848a3c47bd31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:38.291918 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7377a4-c6c9-467a-b7e2-848a3c47bd31 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:38.292262 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7377a4-c6c9-467a-b7e2-848a3c47bd31 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:38.292627 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7377a4-c6c9-467a-b7e2-848a3c47bd31 None admin] PATH_INFO: `/v3/services` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:38.293370 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7377a4-c6c9-467a-b7e2-848a3c47bd31 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:38.293734 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7377a4-c6c9-467a-b7e2-848a3c47bd31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:38.295181 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7377a4-c6c9-467a-b7e2-848a3c47bd31 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:38.300105 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 501/997] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Aug 5 02:08:38 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:38.306369 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7377a4-c6c9-467a-b7e2-848a3c47bd31 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:38.320691 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:38.352115 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689340fe-95c2-49cf-8cde-28955c5f81f2 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:38.391917 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a5b71-e23a-49c8-81b1-69ec747007c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:38.392676 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a5b71-e23a-49c8-81b1-69ec747007c4 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:38.393052 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a5b71-e23a-49c8-81b1-69ec747007c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:38.393334 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5a5b71-e23a-49c8-81b1-69ec747007c4 None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:38.394139 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a5b71-e23a-49c8-81b1-69ec747007c4 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:38.394981 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a5b71-e23a-49c8-81b1-69ec747007c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:38.396354 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5a5b71-e23a-49c8-81b1-69ec747007c4 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:38.401400 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 497/998] 10.222.0.15 () {56 vars in 1122 bytes} [Fri Aug 5 02:08:38 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:38.407454 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a5b71-e23a-49c8-81b1-69ec747007c4 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:38.416374 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:38.420578 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7377a4-c6c9-467a-b7e2-848a3c47bd31 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:38.459932 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0a68f-8059-4739-8b9f-5942c52b812a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:38.460610 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0a68f-8059-4739-8b9f-5942c52b812a None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:38.460893 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0a68f-8059-4739-8b9f-5942c52b812a None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:38.461168 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c0a68f-8059-4739-8b9f-5942c52b812a None admin] PATH_INFO: `/v3/services` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:38.461969 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c0a68f-8059-4739-8b9f-5942c52b812a None admin] RBAC: Adding query filter params (type=compute) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:38.462274 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c0a68f-8059-4739-8b9f-5942c52b812a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:38.463697 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c0a68f-8059-4739-8b9f-5942c52b812a None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:38.475118 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 502/999] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Aug 5 02:08:38 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:38.476266 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0a68f-8059-4739-8b9f-5942c52b812a None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:38.512692 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5a5b71-e23a-49c8-81b1-69ec747007c4 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:38.547637 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c288b66-6604-47cb-a992-1c42b150884d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:38.548370 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c288b66-6604-47cb-a992-1c42b150884d None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:38.548722 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c288b66-6604-47cb-a992-1c42b150884d None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:38.549063 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c288b66-6604-47cb-a992-1c42b150884d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:38.549836 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c288b66-6604-47cb-a992-1c42b150884d None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:38.551808 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c288b66-6604-47cb-a992-1c42b150884d None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:38.557550 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:38.573006 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 498/1000] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:08:38 2022] POST /identity/v3/endpoints => generated 325 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:08:38.596895 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c0a68f-8059-4739-8b9f-5942c52b812a None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:38.645481 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55adcbab-eebe-4ec2-a9f1-1531ec342c92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:38.646362 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adcbab-eebe-4ec2-a9f1-1531ec342c92 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:38.646814 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adcbab-eebe-4ec2-a9f1-1531ec342c92 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:38.647249 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55adcbab-eebe-4ec2-a9f1-1531ec342c92 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:38.648178 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55adcbab-eebe-4ec2-a9f1-1531ec342c92 None admin] RBAC: Adding query filter params (interface=public, service_id=4ca252b1b71249e2a3be71d5e0cac975, region_id=RegionOne) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:38.648679 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55adcbab-eebe-4ec2-a9f1-1531ec342c92 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:38.650241 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55adcbab-eebe-4ec2-a9f1-1531ec342c92 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:38.656687 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 503/1001] 10.222.0.15 () {56 vars in 1251 bytes} [Fri Aug 5 02:08:38 2022] GET /identity/v3/endpoints?service_id=4ca252b1b71249e2a3be71d5e0cac975&interface=public®ion_id=RegionOne => generated 194 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:38.662754 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c288b66-6604-47cb-a992-1c42b150884d None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:38.774658 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c288b66-6604-47cb-a992-1c42b150884d None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:38.808854 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f89fd8ce-8c1f-41d8-be1c-617ec8d0e3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:38.809516 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89fd8ce-8c1f-41d8-be1c-617ec8d0e3e5 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:38.809746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89fd8ce-8c1f-41d8-be1c-617ec8d0e3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:38.810019 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f89fd8ce-8c1f-41d8-be1c-617ec8d0e3e5 None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:38.810672 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89fd8ce-8c1f-41d8-be1c-617ec8d0e3e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:38.812069 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f89fd8ce-8c1f-41d8-be1c-617ec8d0e3e5 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:38.818721 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 499/1002] 10.222.0.15 () {56 vars in 1087 bytes} [Fri Aug 5 02:08:38 2022] GET /identity/v3/services => generated 1727 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:08:39.905149 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317aa34c-5f23-4570-aba4-bf96671c9349 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:39.905673 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317aa34c-5f23-4570-aba4-bf96671c9349 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:39.905673 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-317aa34c-5f23-4570-aba4-bf96671c9349 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:39.907072 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 504/1003] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:08:39.913143 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1f25d-e211-4bc0-87e4-407d3e0eb08d None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:39.913549 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1f25d-e211-4bc0-87e4-407d3e0eb08d None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:39.913737 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e1f25d-e211-4bc0-87e4-407d3e0eb08d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:39.932398 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-71e1f25d-e211-4bc0-87e4-407d3e0eb08d None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:39.933577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-71e1f25d-e211-4bc0-87e4-407d3e0eb08d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:39.996128 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:40.012063 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 500/1004] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:39 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:08:40.038104 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317aa34c-5f23-4570-aba4-bf96671c9349 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:40.064195 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:40.156871 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-317aa34c-5f23-4570-aba4-bf96671c9349 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:40.191786 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13895d58-003b-499d-ba07-da73bc920f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:40.192392 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13895d58-003b-499d-ba07-da73bc920f3c None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:40.192681 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13895d58-003b-499d-ba07-da73bc920f3c None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:40.192957 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13895d58-003b-499d-ba07-da73bc920f3c None admin] PATH_INFO: `/v3/services/image` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:40.193579 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13895d58-003b-499d-ba07-da73bc920f3c None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:40.194948 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13895d58-003b-499d-ba07-da73bc920f3c None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:40.204023 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-13895d58-003b-499d-ba07-da73bc920f3c None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 02:08:40.204023 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:40.204023 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:08:40.204023 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:08:40.204023 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:08:40.204023 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:08:40.204023 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:08:40.204023 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:08:40.204023 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 02:08:40.204023 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:40.204023 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:08:40.204023 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:40.204023 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:40.204023 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:40.204023 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:40.204023 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:40.204023 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:40.205170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:40.205170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:40.205170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:40.205170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:40.205170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:40.205170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:40.205170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:08:40.205170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:08:40.205170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:08:40.205170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:08:40.205170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:40.205170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:40.205170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:40.205170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:40.205170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:40.205170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:40.206021 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:40.206021 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:40.206021 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:40.206021 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:40.206021 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:40.206021 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:40.206021 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:40.206021 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:40.206021 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:40.206021 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:40.206021 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:08:40.206021 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:08:40.206021 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 02:08:40.206021 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:40.206021 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 505/1005] 10.222.0.15 () {56 vars in 1105 bytes} [Fri Aug 5 02:08:40 2022] GET /identity/v3/services/image => generated 86 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:40.211624 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1f25d-e211-4bc0-87e4-407d3e0eb08d None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:40.315161 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e1f25d-e211-4bc0-87e4-407d3e0eb08d None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:40.350406 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d154c6-4869-4151-8ec0-984d544eea0e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:40.351034 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d154c6-4869-4151-8ec0-984d544eea0e None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:40.351318 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d154c6-4869-4151-8ec0-984d544eea0e None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:40.351596 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d154c6-4869-4151-8ec0-984d544eea0e None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:40.352286 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d154c6-4869-4151-8ec0-984d544eea0e None admin] RBAC: Adding query filter params (name=image) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:40.352623 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d154c6-4869-4151-8ec0-984d544eea0e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:40.353985 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d154c6-4869-4151-8ec0-984d544eea0e None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:40.364224 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 501/1006] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:40 2022] GET /identity/v3/services?name=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:40.365190 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13895d58-003b-499d-ba07-da73bc920f3c None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:40.453141 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:40.469212 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13895d58-003b-499d-ba07-da73bc920f3c None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:40.504264 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ebff2-2d20-4d9a-a8b8-7e9f54b7462d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:40.505065 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ebff2-2d20-4d9a-a8b8-7e9f54b7462d None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:40.505408 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ebff2-2d20-4d9a-a8b8-7e9f54b7462d None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:40.505716 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ebff2-2d20-4d9a-a8b8-7e9f54b7462d None admin] PATH_INFO: `/v3/services` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:40.506401 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59ebff2-2d20-4d9a-a8b8-7e9f54b7462d None admin] RBAC: Adding query filter params (type=image) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:40.506721 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59ebff2-2d20-4d9a-a8b8-7e9f54b7462d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:40.508171 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59ebff2-2d20-4d9a-a8b8-7e9f54b7462d None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:40.513121 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 506/1007] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:40 2022] GET /identity/v3/services?type=image => generated 122 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:40.669722 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0158f1-dbe1-481d-9b33-1b1438fa3bbc None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:40.670007 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0158f1-dbe1-481d-9b33-1b1438fa3bbc None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:40.670287 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0158f1-dbe1-481d-9b33-1b1438fa3bbc None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:40.671657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 502/1008] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:08:40.677608 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f432794-9606-455d-aec4-e69d5fe48285 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:40.677897 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f432794-9606-455d-aec4-e69d5fe48285 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:40.678173 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f432794-9606-455d-aec4-e69d5fe48285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:40.696554 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-7f432794-9606-455d-aec4-e69d5fe48285 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:40.697736 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-7f432794-9606-455d-aec4-e69d5fe48285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:40.766866 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 507/1009] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:40 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 02:08:40.789814 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0158f1-dbe1-481d-9b33-1b1438fa3bbc None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:40.853745 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:40.901188 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0158f1-dbe1-481d-9b33-1b1438fa3bbc None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:40.935676 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198180a9-e1ba-4bef-b453-22a67ab225e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:40.936310 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198180a9-e1ba-4bef-b453-22a67ab225e2 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:40.936664 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198180a9-e1ba-4bef-b453-22a67ab225e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:40.936942 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198180a9-e1ba-4bef-b453-22a67ab225e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:40.938080 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198180a9-e1ba-4bef-b453-22a67ab225e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:40.939474 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198180a9-e1ba-4bef-b453-22a67ab225e2 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:40.946689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 503/1010] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:40.948009 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f432794-9606-455d-aec4-e69d5fe48285 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:40.955415 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c146b5-7cdf-4889-901b-127a08381846 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:40.955699 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c146b5-7cdf-4889-901b-127a08381846 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:40.955971 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c146b5-7cdf-4889-901b-127a08381846 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:40.958480 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 504/1011] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:08:40.963339 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca78bbe-6261-4d59-928d-d34dd0fc3173 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:40.963645 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca78bbe-6261-4d59-928d-d34dd0fc3173 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:40.963901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca78bbe-6261-4d59-928d-d34dd0fc3173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:40.983733 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-7ca78bbe-6261-4d59-928d-d34dd0fc3173 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:40.985435 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-7ca78bbe-6261-4d59-928d-d34dd0fc3173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:41.034142 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:41.057103 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f432794-9606-455d-aec4-e69d5fe48285 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:41.063762 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 505/1012] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:40 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 02:08:41.086578 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca78bbe-6261-4d59-928d-d34dd0fc3173 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:41.092575 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ec9a7-0e6a-4ad5-84bf-0db0c9f49d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:41.093197 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ec9a7-0e6a-4ad5-84bf-0db0c9f49d7c None admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:41.093478 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ec9a7-0e6a-4ad5-84bf-0db0c9f49d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:41.093754 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-305ec9a7-0e6a-4ad5-84bf-0db0c9f49d7c None admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:41.094683 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ec9a7-0e6a-4ad5-84bf-0db0c9f49d7c None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:41.096126 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-305ec9a7-0e6a-4ad5-84bf-0db0c9f49d7c None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:41.124226 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 508/1013] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Aug 5 02:08:40 2022] POST /identity/v3/projects => generated 311 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:08:41.149458 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:41.205588 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca78bbe-6261-4d59-928d-d34dd0fc3173 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:41.242696 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b0885a-db7b-49a3-816b-938f4938bbec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:41.243358 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0885a-db7b-49a3-816b-938f4938bbec None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:41.243632 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0885a-db7b-49a3-816b-938f4938bbec None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:41.243898 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b0885a-db7b-49a3-816b-938f4938bbec None admin] PATH_INFO: `/v3/services/compute` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:41.244587 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b0885a-db7b-49a3-816b-938f4938bbec None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:41.245951 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b0885a-db7b-49a3-816b-938f4938bbec None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:41.256505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-c6b0885a-db7b-49a3-816b-938f4938bbec None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 02:08:41.256505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:41.256505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:08:41.256505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:08:41.256505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:08:41.256505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:08:41.256505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:08:41.256505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:08:41.256505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 02:08:41.256505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:41.256505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:08:41.256505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:41.256505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:41.256505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:41.256505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:41.256505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:41.256505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:41.257582 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:41.257582 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:41.257582 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:41.257582 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:41.257582 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:41.257582 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:41.257582 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:08:41.257582 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:08:41.257582 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:08:41.257582 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:08:41.257582 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:41.257582 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:41.257582 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:41.257582 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:41.257582 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:41.257582 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:41.263797 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:41.263797 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:41.263797 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:41.263797 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:41.263797 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:41.263797 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:41.263797 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:41.263797 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:41.263797 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:41.263797 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:41.263797 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:08:41.263797 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:08:41.263797 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 05 02:08:41.263797 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:41.263797 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 506/1014] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:08:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:08:41.266458 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ec9a7-0e6a-4ad5-84bf-0db0c9f49d7c None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:41.373986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-305ec9a7-0e6a-4ad5-84bf-0db0c9f49d7c None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:41.404937 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:41.411259 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa1fc95-9e5b-45b6-b9aa-20316014fae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:41.411959 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1fc95-9e5b-45b6-b9aa-20316014fae5 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:41.412578 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1fc95-9e5b-45b6-b9aa-20316014fae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:41.412862 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa1fc95-9e5b-45b6-b9aa-20316014fae5 None admin] PATH_INFO: `/v3/services` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:41.413855 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa1fc95-9e5b-45b6-b9aa-20316014fae5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:41.414405 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa1fc95-9e5b-45b6-b9aa-20316014fae5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:41.416254 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa1fc95-9e5b-45b6-b9aa-20316014fae5 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:41.425722 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 509/1015] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Aug 5 02:08:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:41.426987 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b0885a-db7b-49a3-816b-938f4938bbec None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:41.536338 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b0885a-db7b-49a3-816b-938f4938bbec None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:41.552931 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:41.571814 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0ee4e1-8c56-46be-afc7-e06e4d9132c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:41.572459 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ee4e1-8c56-46be-afc7-e06e4d9132c3 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:41.572741 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ee4e1-8c56-46be-afc7-e06e4d9132c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:41.573069 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0ee4e1-8c56-46be-afc7-e06e4d9132c3 None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:41.573749 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ee4e1-8c56-46be-afc7-e06e4d9132c3 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:41.574055 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ee4e1-8c56-46be-afc7-e06e4d9132c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:41.575394 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0ee4e1-8c56-46be-afc7-e06e4d9132c3 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:41.584358 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 507/1016] 10.222.0.15 () {56 vars in 1112 bytes} [Fri Aug 5 02:08:41 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:41.586581 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa1fc95-9e5b-45b6-b9aa-20316014fae5 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:41.700813 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa1fc95-9e5b-45b6-b9aa-20316014fae5 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:41.735575 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1681b2-9534-487c-abd3-d68cf65ba1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:41.736192 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1681b2-9534-487c-abd3-d68cf65ba1df None admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:41.736510 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1681b2-9534-487c-abd3-d68cf65ba1df None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:41.736784 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1681b2-9534-487c-abd3-d68cf65ba1df None admin] PATH_INFO: `/v3/endpoints` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:41.737498 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1681b2-9534-487c-abd3-d68cf65ba1df None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:41.739655 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1681b2-9534-487c-abd3-d68cf65ba1df None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:41.768359 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 510/1017] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:08:41 2022] POST /identity/v3/endpoints => generated 334 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:08:42.558776 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7365c3-04e7-4d18-91dc-45abec430567 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:42.559303 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7365c3-04e7-4d18-91dc-45abec430567 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:42.559303 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e7365c3-04e7-4d18-91dc-45abec430567 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:42.560835 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 508/1018] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:08:42.565679 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6de78-df17-4e18-a713-50b6daccaeaf None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:42.566205 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6de78-df17-4e18-a713-50b6daccaeaf None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:42.566537 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d6de78-df17-4e18-a713-50b6daccaeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:42.584863 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-c7d6de78-df17-4e18-a713-50b6daccaeaf None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:42.586042 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-c7d6de78-df17-4e18-a713-50b6daccaeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:42.636465 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:42.666061 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 511/1019] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:42 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:08:42.687951 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7365c3-04e7-4d18-91dc-45abec430567 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:42.789184 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e7365c3-04e7-4d18-91dc-45abec430567 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:42.822223 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b40093-9fc5-492d-9128-37055c0d3379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:42.822756 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b40093-9fc5-492d-9128-37055c0d3379 None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:42.823033 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b40093-9fc5-492d-9128-37055c0d3379 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:42.823300 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b40093-9fc5-492d-9128-37055c0d3379 None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:42.823999 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b40093-9fc5-492d-9128-37055c0d3379 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:42.825369 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46b40093-9fc5-492d-9128-37055c0d3379 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:42.851177 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 509/1020] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Aug 5 02:08:42 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:08:43.209108 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8fd8b-e2fe-4bb0-9651-269104a289cb None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:43.209487 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8fd8b-e2fe-4bb0-9651-269104a289cb None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:43.209697 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a8fd8b-e2fe-4bb0-9651-269104a289cb None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:43.211160 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 512/1021] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:08:43.216300 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9626a-35b2-4acf-ad94-892386e2cd95 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:43.216622 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9626a-35b2-4acf-ad94-892386e2cd95 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:43.216901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a9626a-35b2-4acf-ad94-892386e2cd95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:43.234873 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-04a9626a-35b2-4acf-ad94-892386e2cd95 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:43.236055 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-04a9626a-35b2-4acf-ad94-892386e2cd95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:43.271816 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:43.314571 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 510/1022] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:43 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:08:43.338737 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8fd8b-e2fe-4bb0-9651-269104a289cb None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:43.440604 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a8fd8b-e2fe-4bb0-9651-269104a289cb None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:43.474550 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfe6aa6-567c-45cb-80e2-8b768df31e70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:43.475106 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe6aa6-567c-45cb-80e2-8b768df31e70 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:43.475382 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe6aa6-567c-45cb-80e2-8b768df31e70 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:43.475653 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfe6aa6-567c-45cb-80e2-8b768df31e70 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:43.476810 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe6aa6-567c-45cb-80e2-8b768df31e70 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:43.478236 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfe6aa6-567c-45cb-80e2-8b768df31e70 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:43.479807 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 513/1023] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:43.485705 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9626a-35b2-4acf-ad94-892386e2cd95 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:43.585994 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a9626a-35b2-4acf-ad94-892386e2cd95 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:43.620184 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2abace4-4583-482c-9ee5-328b57257994 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:43.620829 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abace4-4583-482c-9ee5-328b57257994 None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:43.621165 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abace4-4583-482c-9ee5-328b57257994 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:43.621440 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2abace4-4583-482c-9ee5-328b57257994 None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:43.622126 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2abace4-4583-482c-9ee5-328b57257994 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:43.623532 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2abace4-4583-482c-9ee5-328b57257994 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:43.647722 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 511/1024] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Aug 5 02:08:43 2022] POST /identity/v3/users => generated 285 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:08:43.883270 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaaf938-a860-4707-a8fb-6b532da08278 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:43.883775 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaaf938-a860-4707-a8fb-6b532da08278 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:43.883874 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaaf938-a860-4707-a8fb-6b532da08278 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:43.885179 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 514/1025] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:08:43.890524 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a19a6b-b69e-4e07-83a3-aadd5c2edafb None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:43.890815 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a19a6b-b69e-4e07-83a3-aadd5c2edafb None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:43.891089 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a19a6b-b69e-4e07-83a3-aadd5c2edafb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:43.910601 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-33a19a6b-b69e-4e07-83a3-aadd5c2edafb None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:43.911801 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-33a19a6b-b69e-4e07-83a3-aadd5c2edafb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:43.929169 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:43.985690 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 512/1026] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:43 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:08:44.008619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaaf938-a860-4707-a8fb-6b532da08278 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:44.058740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:44.114517 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaaf938-a860-4707-a8fb-6b532da08278 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:44.148684 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61b329-058d-427d-9545-67593c6a72b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:44.149327 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61b329-058d-427d-9545-67593c6a72b6 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:44.149607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61b329-058d-427d-9545-67593c6a72b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:44.149877 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e61b329-058d-427d-9545-67593c6a72b6 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:44.160819 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e61b329-058d-427d-9545-67593c6a72b6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:08:44.165834 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-9e61b329-058d-427d-9545-67593c6a72b6 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 02:08:44.165834 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:44.165834 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:44.165834 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:44.165834 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:44.165834 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:44.165834 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:44.165834 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:44.165834 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:44.165834 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:44.165834 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:44.165834 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:44.165834 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:08:44.165834 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:08:44.165834 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:08:44.165834 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:08:44.168249 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:08:44.168249 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:08:44.168249 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:08:44.168249 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:08:44.168249 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:44.168249 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:44.168249 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:44.168249 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:44.168249 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:44.168249 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:44.168249 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:44.168249 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:44.168249 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:44.168249 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:44.168249 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:44.168249 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:44.169180 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:44.169180 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:44.169180 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:44.169180 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:44.169180 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:08:44.169180 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:08:44.169180 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:08:44.169180 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:08:44.169180 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:08:44.169180 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:08:44.169180 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 02:08:44.169180 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:44.169180 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 515/1027] 10.222.0.15 () {56 vars in 1120 bytes} [Fri Aug 5 02:08:44 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:44.173416 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a19a6b-b69e-4e07-83a3-aadd5c2edafb None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:44.273143 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a19a6b-b69e-4e07-83a3-aadd5c2edafb None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:44.308600 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e64c95-0756-4db4-84f4-baea4af7bd80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:44.309490 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e64c95-0756-4db4-84f4-baea4af7bd80 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:44.309977 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e64c95-0756-4db4-84f4-baea4af7bd80 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:44.310445 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98e64c95-0756-4db4-84f4-baea4af7bd80 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:44.311346 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e64c95-0756-4db4-84f4-baea4af7bd80 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:44.311847 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e64c95-0756-4db4-84f4-baea4af7bd80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:44.313409 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98e64c95-0756-4db4-84f4-baea4af7bd80 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:44.326669 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 513/1028] 10.222.0.15 () {56 vars in 1115 bytes} [Fri Aug 5 02:08:44 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:44.328231 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61b329-058d-427d-9545-67593c6a72b6 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:44.432206 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e61b329-058d-427d-9545-67593c6a72b6 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:44.439847 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:44.468792 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851af3b9-d1d2-4dba-9b72-b59cbe48f2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:44.469744 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851af3b9-d1d2-4dba-9b72-b59cbe48f2d5 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:44.470026 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851af3b9-d1d2-4dba-9b72-b59cbe48f2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:44.470304 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851af3b9-d1d2-4dba-9b72-b59cbe48f2d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:44.480970 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851af3b9-d1d2-4dba-9b72-b59cbe48f2d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:44.482414 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-851af3b9-d1d2-4dba-9b72-b59cbe48f2d5 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:44.497128 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-851af3b9-d1d2-4dba-9b72-b59cbe48f2d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:44.497128 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:44.497128 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:44.497128 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:44.497128 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:44.497128 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:44.497128 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:44.497128 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:44.497128 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:44.497128 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:44.497128 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:44.497128 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:44.497128 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:08:44.497128 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:08:44.497128 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:08:44.498048 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:08:44.498048 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:44.498048 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:44.498048 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:44.498048 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:44.498048 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:44.498048 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:44.498048 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:44.498048 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:44.498048 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:44.498048 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:44.498048 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:44.498048 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:44.498048 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:44.498048 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:44.498048 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:44.498048 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:44.498962 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:08:44.498962 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:08:44.498962 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:44.498962 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:44.500675 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 516/1029] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:44.504755 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e64c95-0756-4db4-84f4-baea4af7bd80 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:44.522701 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:44.610509 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98e64c95-0756-4db4-84f4-baea4af7bd80 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:44.645857 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6cdbcf-527a-4cc3-a3a1-6817f5e0d224 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:44.646788 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6cdbcf-527a-4cc3-a3a1-6817f5e0d224 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:44.647260 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6cdbcf-527a-4cc3-a3a1-6817f5e0d224 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:44.647712 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6cdbcf-527a-4cc3-a3a1-6817f5e0d224 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:44.648620 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6cdbcf-527a-4cc3-a3a1-6817f5e0d224 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:44.649115 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6cdbcf-527a-4cc3-a3a1-6817f5e0d224 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:44.650727 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6cdbcf-527a-4cc3-a3a1-6817f5e0d224 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:44.667213 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 514/1030] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:08:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:44.668916 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851af3b9-d1d2-4dba-9b72-b59cbe48f2d5 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:44.769797 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851af3b9-d1d2-4dba-9b72-b59cbe48f2d5 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:44.804976 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18121a96-3ad6-4ace-b7a4-ebcac184fb80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:44.805622 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18121a96-3ad6-4ace-b7a4-ebcac184fb80 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:44.805902 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18121a96-3ad6-4ace-b7a4-ebcac184fb80 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:44.806174 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18121a96-3ad6-4ace-b7a4-ebcac184fb80 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:44.814127 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18121a96-3ad6-4ace-b7a4-ebcac184fb80 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:44.815643 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18121a96-3ad6-4ace-b7a4-ebcac184fb80 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:44.830502 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-18121a96-3ad6-4ace-b7a4-ebcac184fb80 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 02:08:44.830502 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:44.830502 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:44.830502 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:44.830502 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:44.830502 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:44.830502 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:44.830502 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:44.830502 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:44.830502 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:44.830502 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:44.830502 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:44.830502 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:08:44.830502 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:08:44.830502 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:08:44.830502 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:08:44.831553 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:44.831553 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:44.831553 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:08:44.831553 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:08:44.831553 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:08:44.831553 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:08:44.831553 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:44.831553 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:44.831553 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:44.831553 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:44.831553 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:44.831553 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:44.831553 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:44.831553 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:44.831553 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:44.831553 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:44.831553 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:44.831553 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:44.832682 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:44.832682 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:44.832682 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:08:44.832682 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:08:44.832682 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:08:44.832682 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:08:44.832682 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:08:44.832682 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:08:44.832682 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 02:08:44.832682 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:44.832682 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 517/1031] 10.222.0.15 () {56 vars in 1093 bytes} [Fri Aug 5 02:08:44 2022] GET /identity/v3/users/nova => generated 82 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:44.836397 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6cdbcf-527a-4cc3-a3a1-6817f5e0d224 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:44.906356 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded3e24-a996-4e54-a7b2-cf9e5692025a None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:44.906918 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded3e24-a996-4e54-a7b2-cf9e5692025a None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:44.906918 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ded3e24-a996-4e54-a7b2-cf9e5692025a None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:44.908369 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 518/1032] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:08:44.913532 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30532fbb-572d-40ce-be55-dcb0d3cb9fc3 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:44.913813 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30532fbb-572d-40ce-be55-dcb0d3cb9fc3 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:44.914085 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30532fbb-572d-40ce-be55-dcb0d3cb9fc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:44.917539 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:44.933118 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-30532fbb-572d-40ce-be55-dcb0d3cb9fc3 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:44.934302 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-30532fbb-572d-40ce-be55-dcb0d3cb9fc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:44.944841 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6cdbcf-527a-4cc3-a3a1-6817f5e0d224 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:44.948186 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:44.986157 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91bcd02-767c-4a3e-b324-e1a43c213de2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:44.986776 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bcd02-767c-4a3e-b324-e1a43c213de2 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:44.987056 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bcd02-767c-4a3e-b324-e1a43c213de2 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:44.987336 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91bcd02-767c-4a3e-b324-e1a43c213de2 None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:44.988821 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91bcd02-767c-4a3e-b324-e1a43c213de2 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:44.989135 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91bcd02-767c-4a3e-b324-e1a43c213de2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:44.990575 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91bcd02-767c-4a3e-b324-e1a43c213de2 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:45.013471 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 515/1033] 10.222.0.15 () {56 vars in 1133 bytes} [Fri Aug 5 02:08:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:45.013636 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 519/1034] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:44 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 02:08:45.014490 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91bcd02-767c-4a3e-b324-e1a43c213de2 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:45.031940 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30532fbb-572d-40ce-be55-dcb0d3cb9fc3 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:45.122515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91bcd02-767c-4a3e-b324-e1a43c213de2 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:45.137762 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30532fbb-572d-40ce-be55-dcb0d3cb9fc3 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:45.154836 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:45.160579 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b002678-2621-490e-9714-a5e06f8df5fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:45.161202 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b002678-2621-490e-9714-a5e06f8df5fa None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:45.161869 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b002678-2621-490e-9714-a5e06f8df5fa None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:45.162768 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b002678-2621-490e-9714-a5e06f8df5fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:45.175051 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c369e-e2fd-4e54-b9b9-13f5ec5f4d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:45.175699 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c369e-e2fd-4e54-b9b9-13f5ec5f4d36 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:45.175984 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c369e-e2fd-4e54-b9b9-13f5ec5f4d36 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:45.176263 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269c369e-e2fd-4e54-b9b9-13f5ec5f4d36 None admin] PATH_INFO: `/v3/services/image` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:45.176921 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c369e-e2fd-4e54-b9b9-13f5ec5f4d36 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:45.178293 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269c369e-e2fd-4e54-b9b9-13f5ec5f4d36 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:45.187606 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-269c369e-e2fd-4e54-b9b9-13f5ec5f4d36 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 02:08:45.187606 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:45.187606 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:08:45.187606 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:08:45.187606 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:08:45.187606 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:08:45.187606 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:08:45.187606 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:08:45.187606 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 02:08:45.187606 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:45.187606 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:08:45.187606 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:45.187606 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:45.187606 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:45.187606 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:45.187606 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:45.187606 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:45.188623 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:45.188623 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:45.188623 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:45.188623 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:45.188623 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:45.188623 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:45.188623 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:08:45.188623 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:08:45.188623 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:08:45.188623 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:08:45.188623 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:45.188623 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:45.188623 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:45.188623 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:45.188623 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:45.188623 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:45.189468 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:45.189468 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:45.189468 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:45.189468 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:45.189468 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:45.189468 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:45.189468 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:45.189468 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:45.189468 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:45.189468 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:45.189468 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:08:45.189468 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:08:45.189468 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 02:08:45.189468 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:45.189468 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 520/1035] 10.222.0.15 () {56 vars in 1105 bytes} [Fri Aug 5 02:08:45 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:08:45.195290 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c369e-e2fd-4e54-b9b9-13f5ec5f4d36 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:45.211340 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:45.241829 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b002678-2621-490e-9714-a5e06f8df5fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:45.243264 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b002678-2621-490e-9714-a5e06f8df5fa None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:45.305917 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269c369e-e2fd-4e54-b9b9-13f5ec5f4d36 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:45.341261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74486d37-de37-41c2-ac4f-c62d0ef4ac59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:45.341880 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74486d37-de37-41c2-ac4f-c62d0ef4ac59 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:45.342161 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74486d37-de37-41c2-ac4f-c62d0ef4ac59 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:45.342434 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74486d37-de37-41c2-ac4f-c62d0ef4ac59 None admin] PATH_INFO: `/v3/services` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:45.343117 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74486d37-de37-41c2-ac4f-c62d0ef4ac59 None admin] RBAC: Adding query filter params (name=image) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:45.343422 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74486d37-de37-41c2-ac4f-c62d0ef4ac59 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:45.345075 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74486d37-de37-41c2-ac4f-c62d0ef4ac59 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:45.350553 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 521/1036] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:45 2022] GET /identity/v3/services?name=image => generated 122 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:45.358820 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 516/1037] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:08:45 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 02:08:45.358997 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74486d37-de37-41c2-ac4f-c62d0ef4ac59 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:45.360748 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b002678-2621-490e-9714-a5e06f8df5fa None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:45.392930 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:45.438249 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:45.465031 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74486d37-de37-41c2-ac4f-c62d0ef4ac59 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:45.468333 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b002678-2621-490e-9714-a5e06f8df5fa None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:45.502620 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f868b21-986a-498c-859c-3c5ed33c4d4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:45.503780 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f868b21-986a-498c-859c-3c5ed33c4d4f None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:45.504049 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f868b21-986a-498c-859c-3c5ed33c4d4f None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:45.504421 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f868b21-986a-498c-859c-3c5ed33c4d4f None admin] PATH_INFO: `/v3/services` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:45.505235 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f868b21-986a-498c-859c-3c5ed33c4d4f None admin] RBAC: Adding query filter params (type=image) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:45.505488 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f868b21-986a-498c-859c-3c5ed33c4d4f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:45.506991 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d0ee0-f986-4145-8530-a0124c5c1cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:45.507120 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f868b21-986a-498c-859c-3c5ed33c4d4f None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:45.507645 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d0ee0-f986-4145-8530-a0124c5c1cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:45.507933 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d0ee0-f986-4145-8530-a0124c5c1cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:45.508203 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1d0ee0-f986-4145-8530-a0124c5c1cd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:45.513365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 522/1038] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:45 2022] GET /identity/v3/services?type=image => generated 350 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:45.518952 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f868b21-986a-498c-859c-3c5ed33c4d4f None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:45.520669 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1d0ee0-f986-4145-8530-a0124c5c1cd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:45.523108 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1d0ee0-f986-4145-8530-a0124c5c1cd5 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:45.539391 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-ca1d0ee0-f986-4145-8530-a0124c5c1cd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:45.539391 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:45.539391 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:45.539391 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:45.539391 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:45.539391 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:45.539391 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:45.539391 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:45.539391 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:45.539391 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:45.539391 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:45.539391 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:45.539391 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:08:45.539391 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:08:45.539391 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:08:45.540417 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:08:45.540417 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:45.540417 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:45.540417 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:45.540417 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:45.540417 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:45.540417 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:45.540417 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:45.540417 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:45.540417 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:45.540417 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:45.540417 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:45.540417 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:45.540417 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:45.540417 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:45.540417 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:45.540417 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:45.541787 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:08:45.541787 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:08:45.541787 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:45.541787 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:45.541787 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 517/1039] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:45.545997 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d0ee0-f986-4145-8530-a0124c5c1cd5 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:45.629242 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f868b21-986a-498c-859c-3c5ed33c4d4f None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:45.631136 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:45.648748 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1d0ee0-f986-4145-8530-a0124c5c1cd5 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:45.667286 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe1395-069a-4903-b0e8-1c34524e37eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:45.667901 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe1395-069a-4903-b0e8-1c34524e37eb None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:45.668289 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe1395-069a-4903-b0e8-1c34524e37eb None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:45.668589 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abe1395-069a-4903-b0e8-1c34524e37eb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:45.669339 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abe1395-069a-4903-b0e8-1c34524e37eb None admin] RBAC: Adding query filter params (interface=public, service_id=53ce2c4981134120abac3142c230dfb0, region_id=RegionOne) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:45.669642 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abe1395-069a-4903-b0e8-1c34524e37eb None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:45.671002 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abe1395-069a-4903-b0e8-1c34524e37eb None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:45.681661 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 523/1040] 10.222.0.15 () {56 vars in 1251 bytes} [Fri Aug 5 02:08:45 2022] GET /identity/v3/endpoints?service_id=53ce2c4981134120abac3142c230dfb0&interface=public®ion_id=RegionOne => generated 194 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:45.682692 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe1395-069a-4903-b0e8-1c34524e37eb None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:45.686164 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:45.688047 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3628b67-3df0-4355-83d1-233d26799506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:45.688758 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3628b67-3df0-4355-83d1-233d26799506 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:45.689072 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3628b67-3df0-4355-83d1-233d26799506 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:45.689425 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3628b67-3df0-4355-83d1-233d26799506 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:45.690114 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3628b67-3df0-4355-83d1-233d26799506 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:45.690406 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3628b67-3df0-4355-83d1-233d26799506 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:45.692391 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3628b67-3df0-4355-83d1-233d26799506 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:45.704822 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 518/1041] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:08:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:45.711131 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3628b67-3df0-4355-83d1-233d26799506 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:45.793011 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abe1395-069a-4903-b0e8-1c34524e37eb None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:45.813804 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3628b67-3df0-4355-83d1-233d26799506 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:45.828981 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68303a1c-c6ef-4618-83a3-e0d1a30b1015 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:45.829595 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68303a1c-c6ef-4618-83a3-e0d1a30b1015 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:45.829874 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68303a1c-c6ef-4618-83a3-e0d1a30b1015 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:45.830145 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68303a1c-c6ef-4618-83a3-e0d1a30b1015 None admin] PATH_INFO: `/v3/services` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:45.830789 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68303a1c-c6ef-4618-83a3-e0d1a30b1015 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:45.832914 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68303a1c-c6ef-4618-83a3-e0d1a30b1015 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:45.839644 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 524/1042] 10.222.0.15 () {56 vars in 1087 bytes} [Fri Aug 5 02:08:45 2022] GET /identity/v3/services => generated 1957 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:08:45.845945 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73774bf9-afa0-4803-8621-4801936a4a92 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:45.846258 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73774bf9-afa0-4803-8621-4801936a4a92 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:45.846498 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73774bf9-afa0-4803-8621-4801936a4a92 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:45.847987 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 525/1043] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:45 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:08:45.853917 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24183e85-7f0f-429d-8411-9a87f98d1b74 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:45.854199 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24183e85-7f0f-429d-8411-9a87f98d1b74 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:45.854478 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24183e85-7f0f-429d-8411-9a87f98d1b74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:45.855499 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e2987-b7e4-4310-8362-a8989ff498bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:45.856359 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e2987-b7e4-4310-8362-a8989ff498bb None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:45.856802 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e2987-b7e4-4310-8362-a8989ff498bb None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:45.857325 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-068e2987-b7e4-4310-8362-a8989ff498bb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:45.866882 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e2987-b7e4-4310-8362-a8989ff498bb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:45.869392 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-068e2987-b7e4-4310-8362-a8989ff498bb None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:45.873845 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-24183e85-7f0f-429d-8411-9a87f98d1b74 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:45.875074 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-24183e85-7f0f-429d-8411-9a87f98d1b74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:45.885814 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-068e2987-b7e4-4310-8362-a8989ff498bb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:08:45.885814 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:45.885814 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:45.885814 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:45.885814 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:45.885814 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:45.885814 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:45.885814 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:45.885814 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:45.885814 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:45.885814 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:45.885814 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:45.885814 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:08:45.885814 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:08:45.885814 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:08:45.886817 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:08:45.886817 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:45.886817 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:45.886817 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:45.886817 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:45.886817 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:45.886817 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:45.886817 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:45.886817 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:45.886817 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:45.886817 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:45.886817 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:45.886817 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:45.886817 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:45.886817 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:45.886817 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:45.886817 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:45.887703 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:08:45.887703 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:08:45.887703 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:08:45.887703 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:08:45.887703 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:08:45.887703 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:08:45.887703 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:08:45.887703 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:45.887703 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 519/1044] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:08:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:08:45.893831 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e2987-b7e4-4310-8362-a8989ff498bb None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:45.901638 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:45.951474 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:45.960212 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 526/1045] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:45 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:08:45.984579 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24183e85-7f0f-429d-8411-9a87f98d1b74 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:46.015995 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-068e2987-b7e4-4310-8362-a8989ff498bb None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:46.053341 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b287d53-17ed-4c30-a58f-f5ca65709a29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:46.053962 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b287d53-17ed-4c30-a58f-f5ca65709a29 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:46.054237 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b287d53-17ed-4c30-a58f-f5ca65709a29 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:46.054505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b287d53-17ed-4c30-a58f-f5ca65709a29 None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:46.055246 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b287d53-17ed-4c30-a58f-f5ca65709a29 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:46.055544 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b287d53-17ed-4c30-a58f-f5ca65709a29 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:46.056982 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b287d53-17ed-4c30-a58f-f5ca65709a29 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:46.069529 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 520/1046] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Aug 5 02:08:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:46.075706 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b287d53-17ed-4c30-a58f-f5ca65709a29 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:46.100112 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24183e85-7f0f-429d-8411-9a87f98d1b74 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:46.137097 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9b0f4-b13a-41f1-a787-7067c71930ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:46.137652 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9b0f4-b13a-41f1-a787-7067c71930ce None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:46.137930 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9b0f4-b13a-41f1-a787-7067c71930ce None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:46.138203 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32d9b0f4-b13a-41f1-a787-7067c71930ce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:46.146167 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:46.148649 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32d9b0f4-b13a-41f1-a787-7067c71930ce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:08:46.153577 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-32d9b0f4-b13a-41f1-a787-7067c71930ce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:08:46.153577 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:46.153577 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:46.153577 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:46.153577 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:46.153577 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:46.153577 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:46.153577 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:46.153577 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:46.153577 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:46.153577 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:46.153577 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:46.153577 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:08:46.153577 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:08:46.153577 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:08:46.153577 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:08:46.154533 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:08:46.154533 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:08:46.154533 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:08:46.154533 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:08:46.154533 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:46.154533 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:46.154533 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:46.154533 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:46.154533 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:46.154533 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:46.154533 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:46.154533 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:46.154533 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:46.154533 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:46.154533 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:46.154533 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:46.155394 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:46.155394 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:46.155394 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:46.155394 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:46.155394 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:08:46.155394 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:08:46.155394 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:08:46.155394 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:08:46.155394 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:08:46.155394 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:08:46.155394 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:08:46.155394 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:46.155394 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 527/1047] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Aug 5 02:08:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:08:46.161249 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9b0f4-b13a-41f1-a787-7067c71930ce None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:46.190740 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b287d53-17ed-4c30-a58f-f5ca65709a29 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:46.226069 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:46.233216 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb8f61-a860-43db-9fb6-0384c101a37f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:46.233836 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb8f61-a860-43db-9fb6-0384c101a37f None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:46.234120 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb8f61-a860-43db-9fb6-0384c101a37f None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:46.234418 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eb8f61-a860-43db-9fb6-0384c101a37f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:46.235600 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb8f61-a860-43db-9fb6-0384c101a37f None admin] RBAC: Adding query filter params (role.id=27e54d7ab8954b0bbd5f964610e01cea, scope.project.id=95d88dece7184bf1842c4f8d275d52cd, user.id=4b5c0958604b436daa44b1f67c9dec26) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:46.235600 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb8f61-a860-43db-9fb6-0384c101a37f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:46.237027 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eb8f61-a860-43db-9fb6-0384c101a37f None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:46.243649 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 521/1048] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:08:46 2022] GET /identity/v3/role_assignments?user.id=4b5c0958604b436daa44b1f67c9dec26&scope.project.id=95d88dece7184bf1842c4f8d275d52cd&role.id=27e54d7ab8954b0bbd5f964610e01cea => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:46.275979 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32d9b0f4-b13a-41f1-a787-7067c71930ce None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:46.315391 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9def10-7343-473e-a252-bece034a2a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:46.316627 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9def10-7343-473e-a252-bece034a2a0c None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:46.316912 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9def10-7343-473e-a252-bece034a2a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:46.317184 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d9def10-7343-473e-a252-bece034a2a0c None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:46.317926 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9def10-7343-473e-a252-bece034a2a0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:46.318233 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9def10-7343-473e-a252-bece034a2a0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:46.319627 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d9def10-7343-473e-a252-bece034a2a0c None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:46.334251 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 528/1049] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:08:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:46.335265 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb8f61-a860-43db-9fb6-0384c101a37f None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:46.442381 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eb8f61-a860-43db-9fb6-0384c101a37f None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:46.470342 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:46.480500 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdebe7-0dae-46bc-a94a-a25321e16390 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:46.481151 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdebe7-0dae-46bc-a94a-a25321e16390 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:46.481443 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdebe7-0dae-46bc-a94a-a25321e16390 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:46.481719 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4bdebe7-0dae-46bc-a94a-a25321e16390 None admin] PATH_INFO: `/v3/users/14aaf60c579140e6b7ecb8a8575afff2` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:46.496264 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bdebe7-0dae-46bc-a94a-a25321e16390 None admin] RBAC: Authorizing `identity:get_user(user_id=14aaf60c579140e6b7ecb8a8575afff2)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:46.497725 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4bdebe7-0dae-46bc-a94a-a25321e16390 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:46.499688 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 522/1050] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:08:46 2022] GET /identity/v3/users/14aaf60c579140e6b7ecb8a8575afff2 => generated 285 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:46.505469 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9def10-7343-473e-a252-bece034a2a0c None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:46.610376 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d9def10-7343-473e-a252-bece034a2a0c None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:46.630630 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:46.646893 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09606f8-e2b9-40f0-bd4b-814607d8f440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:46.647518 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09606f8-e2b9-40f0-bd4b-814607d8f440 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:46.647799 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09606f8-e2b9-40f0-bd4b-814607d8f440 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:46.648077 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c09606f8-e2b9-40f0-bd4b-814607d8f440 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:46.717928 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09606f8-e2b9-40f0-bd4b-814607d8f440 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:46.719554 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c09606f8-e2b9-40f0-bd4b-814607d8f440 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:46.823575 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 529/1051] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:08:46 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 02:08:46.824847 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdebe7-0dae-46bc-a94a-a25321e16390 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:46.929322 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4bdebe7-0dae-46bc-a94a-a25321e16390 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:46.965876 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4d8bd4-1a0d-434b-9413-b69d4f01aeda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:46.966519 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d8bd4-1a0d-434b-9413-b69d4f01aeda None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:46.966801 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d8bd4-1a0d-434b-9413-b69d4f01aeda None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:46.967078 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4d8bd4-1a0d-434b-9413-b69d4f01aeda None admin] PATH_INFO: `/v3/projects/54ca5e241c5d4737aee16091b1e82226` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:46.968289 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d8bd4-1a0d-434b-9413-b69d4f01aeda None admin] RBAC: Authorizing `identity:get_project(project_id=54ca5e241c5d4737aee16091b1e82226)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:46.969946 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4d8bd4-1a0d-434b-9413-b69d4f01aeda None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:46.971846 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 523/1052] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:08:46 2022] GET /identity/v3/projects/54ca5e241c5d4737aee16091b1e82226 => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:46.977879 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09606f8-e2b9-40f0-bd4b-814607d8f440 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:47.000418 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:47.079954 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c09606f8-e2b9-40f0-bd4b-814607d8f440 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:47.114989 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d8b2c4-d440-45e1-b0b6-4bf47c9eea63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:47.115606 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8b2c4-d440-45e1-b0b6-4bf47c9eea63 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:47.115890 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8b2c4-d440-45e1-b0b6-4bf47c9eea63 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:47.116168 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d8b2c4-d440-45e1-b0b6-4bf47c9eea63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:47.116981 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8b2c4-d440-45e1-b0b6-4bf47c9eea63 None admin] RBAC: Adding query filter params (role.id=e1b75d5eea2a43b2b1b14cf0515350fa, scope.project.id=54ca5e241c5d4737aee16091b1e82226, user.id=14aaf60c579140e6b7ecb8a8575afff2) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:47.117294 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8b2c4-d440-45e1-b0b6-4bf47c9eea63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:47.118723 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2d8b2c4-d440-45e1-b0b6-4bf47c9eea63 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:47.124249 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 530/1053] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:08:46 2022] GET /identity/v3/role_assignments?user.id=14aaf60c579140e6b7ecb8a8575afff2&scope.project.id=54ca5e241c5d4737aee16091b1e82226&role.id=e1b75d5eea2a43b2b1b14cf0515350fa => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:47.897466 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f2a90-ed09-4ae7-a485-9293165c161e None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:47.897985 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f2a90-ed09-4ae7-a485-9293165c161e None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:47.898061 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8f2a90-ed09-4ae7-a485-9293165c161e None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:47.899379 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 524/1054] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:08:47.904694 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b62e9-2258-45c1-b786-689561f8d00e None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:47.904982 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b62e9-2258-45c1-b786-689561f8d00e None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:47.905249 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5b62e9-2258-45c1-b786-689561f8d00e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:47.923039 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-ef5b62e9-2258-45c1-b786-689561f8d00e None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:47.924224 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-ef5b62e9-2258-45c1-b786-689561f8d00e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:47.992800 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 531/1055] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:47 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:08:48.015013 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f2a90-ed09-4ae7-a485-9293165c161e None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:48.072352 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:48.120240 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8f2a90-ed09-4ae7-a485-9293165c161e None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:48.155065 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ea0725-b63c-40ec-ac8b-af908bb0ddc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:48.155703 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea0725-b63c-40ec-ac8b-af908bb0ddc7 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:48.155983 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea0725-b63c-40ec-ac8b-af908bb0ddc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:48.156255 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ea0725-b63c-40ec-ac8b-af908bb0ddc7 None admin] PATH_INFO: `/v3/services/image` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:48.156905 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ea0725-b63c-40ec-ac8b-af908bb0ddc7 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:48.158273 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ea0725-b63c-40ec-ac8b-af908bb0ddc7 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:48.167851 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-d6ea0725-b63c-40ec-ac8b-af908bb0ddc7 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 02:08:48.167851 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:48.167851 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:08:48.167851 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:08:48.167851 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:08:48.167851 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:08:48.167851 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:08:48.167851 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:08:48.167851 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 02:08:48.167851 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:48.167851 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:08:48.167851 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:48.167851 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:48.167851 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:48.167851 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:48.167851 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:48.167851 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:48.168873 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:48.168873 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:48.168873 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:48.168873 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:48.168873 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:48.168873 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:48.168873 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:08:48.168873 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:08:48.168873 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:08:48.168873 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:08:48.168873 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:48.168873 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:48.168873 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:48.168873 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:48.168873 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:48.168873 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:48.174604 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:48.174604 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:48.174604 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:48.174604 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:48.174604 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:48.174604 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:48.174604 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:48.174604 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:48.174604 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:48.174604 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:48.174604 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:08:48.174604 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:08:48.174604 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 05 02:08:48.174604 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:48.174604 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 525/1056] 10.222.0.15 () {56 vars in 1105 bytes} [Fri Aug 5 02:08:48 2022] GET /identity/v3/services/image => generated 86 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:48.177819 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b62e9-2258-45c1-b786-689561f8d00e None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:48.194194 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:48.233098 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140c5f2-0b87-455f-af1f-8525c296e687 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:48.233425 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140c5f2-0b87-455f-af1f-8525c296e687 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:48.233651 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140c5f2-0b87-455f-af1f-8525c296e687 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:48.235007 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 526/1057] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:08:48.239922 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bcc347-5fa5-48e7-a5b2-f4f5c06a097e None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:48.240203 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bcc347-5fa5-48e7-a5b2-f4f5c06a097e None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:48.240527 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bcc347-5fa5-48e7-a5b2-f4f5c06a097e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:48.259915 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-08bcc347-5fa5-48e7-a5b2-f4f5c06a097e None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:48.261129 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-08bcc347-5fa5-48e7-a5b2-f4f5c06a097e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:48.295085 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5b62e9-2258-45c1-b786-689561f8d00e None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:48.332505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 527/1058] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:48 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 02:08:48.337060 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78bdcd4-0be6-47da-b6bc-8865644c0bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:48.337785 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78bdcd4-0be6-47da-b6bc-8865644c0bcd None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:48.338133 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78bdcd4-0be6-47da-b6bc-8865644c0bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:48.338479 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78bdcd4-0be6-47da-b6bc-8865644c0bcd None admin] PATH_INFO: `/v3/services` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:48.339224 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78bdcd4-0be6-47da-b6bc-8865644c0bcd None admin] RBAC: Adding query filter params (name=image) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:48.339594 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78bdcd4-0be6-47da-b6bc-8865644c0bcd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:48.341058 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78bdcd4-0be6-47da-b6bc-8865644c0bcd None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:48.349511 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 532/1059] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:48 2022] GET /identity/v3/services?name=image => generated 122 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:48.352283 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bcc347-5fa5-48e7-a5b2-f4f5c06a097e None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:48.354914 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78bdcd4-0be6-47da-b6bc-8865644c0bcd None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:48.407627 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:48.442823 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:48.462657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08bcc347-5fa5-48e7-a5b2-f4f5c06a097e None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:48.465980 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78bdcd4-0be6-47da-b6bc-8865644c0bcd None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:48.498029 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24cdfe-2da4-430f-83c8-edea3de83a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:48.498642 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24cdfe-2da4-430f-83c8-edea3de83a9c None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:48.498925 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24cdfe-2da4-430f-83c8-edea3de83a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:48.499199 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f24cdfe-2da4-430f-83c8-edea3de83a9c None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:48.499881 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f24cdfe-2da4-430f-83c8-edea3de83a9c None admin] RBAC: Adding query filter params (type=image) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:48.500178 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f24cdfe-2da4-430f-83c8-edea3de83a9c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:48.501561 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f24cdfe-2da4-430f-83c8-edea3de83a9c None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:48.501924 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0398801-a76e-4f9f-a5ac-255b27718a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:48.502551 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0398801-a76e-4f9f-a5ac-255b27718a95 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:48.503356 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0398801-a76e-4f9f-a5ac-255b27718a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:48.503710 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0398801-a76e-4f9f-a5ac-255b27718a95 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:48.513006 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 528/1060] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:48 2022] GET /identity/v3/services?type=image => generated 350 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:48.513779 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24cdfe-2da4-430f-83c8-edea3de83a9c None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:48.520141 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0398801-a76e-4f9f-a5ac-255b27718a95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:08:48.525217 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-b0398801-a76e-4f9f-a5ac-255b27718a95 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 02:08:48.525217 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:48.525217 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:48.525217 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:48.525217 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:48.525217 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:48.525217 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:48.525217 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:48.525217 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:48.525217 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:48.525217 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:48.525217 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:48.525217 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:08:48.525217 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:08:48.525217 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:08:48.525217 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:08:48.526145 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:08:48.526145 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:08:48.526145 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:08:48.526145 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:08:48.526145 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:48.526145 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:48.526145 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:48.526145 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:48.526145 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:48.526145 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:48.526145 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:48.526145 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:48.526145 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:48.526145 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:48.526145 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:48.526145 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:48.527649 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:48.527649 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:48.527649 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:48.527649 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:48.527649 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:08:48.527649 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:08:48.527649 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:08:48.527649 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:08:48.527649 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:08:48.527649 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:08:48.527649 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 02:08:48.527649 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:48.527649 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 533/1061] 10.222.0.15 () {56 vars in 1120 bytes} [Fri Aug 5 02:08:48 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:08:48.532116 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0398801-a76e-4f9f-a5ac-255b27718a95 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:48.619460 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f24cdfe-2da4-430f-83c8-edea3de83a9c None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:48.633178 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:48.639469 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0398801-a76e-4f9f-a5ac-255b27718a95 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:48.654793 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338c041-73d9-419e-8ca3-509a7d7593bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:48.655408 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338c041-73d9-419e-8ca3-509a7d7593bb None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:48.655688 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338c041-73d9-419e-8ca3-509a7d7593bb None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:48.655965 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9338c041-73d9-419e-8ca3-509a7d7593bb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:48.656704 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9338c041-73d9-419e-8ca3-509a7d7593bb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:48.658109 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9338c041-73d9-419e-8ca3-509a7d7593bb None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:48.678255 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7d823-dbee-4d09-8f53-0c520de2cc57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:48.678878 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7d823-dbee-4d09-8f53-0c520de2cc57 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:48.679150 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7d823-dbee-4d09-8f53-0c520de2cc57 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:48.679423 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4db7d823-dbee-4d09-8f53-0c520de2cc57 None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:48.680164 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7d823-dbee-4d09-8f53-0c520de2cc57 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:48.680497 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7d823-dbee-4d09-8f53-0c520de2cc57 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:48.681537 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 529/1062] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:08:48 2022] POST /identity/v3/endpoints => generated 327 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:08:48.681879 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4db7d823-dbee-4d09-8f53-0c520de2cc57 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:48.688171 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:48.698288 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 534/1063] 10.222.0.15 () {56 vars in 1115 bytes} [Fri Aug 5 02:08:48 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:48.699647 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338c041-73d9-419e-8ca3-509a7d7593bb None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:48.827150 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9338c041-73d9-419e-8ca3-509a7d7593bb None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:48.870641 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60981051-7b75-4ef6-8da3-f29aa00a579d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:48.871284 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60981051-7b75-4ef6-8da3-f29aa00a579d None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:48.871564 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60981051-7b75-4ef6-8da3-f29aa00a579d None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:48.871837 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60981051-7b75-4ef6-8da3-f29aa00a579d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:48.883139 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60981051-7b75-4ef6-8da3-f29aa00a579d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:48.884601 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60981051-7b75-4ef6-8da3-f29aa00a579d None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:48.899689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-60981051-7b75-4ef6-8da3-f29aa00a579d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:48.899689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:48.899689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:48.899689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:48.899689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:48.899689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:48.899689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:48.899689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:48.899689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:48.899689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:48.899689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:48.899689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:48.899689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:08:48.899689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:08:48.899689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:08:48.901116 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:08:48.901116 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:48.901116 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:48.901116 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:48.901116 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:48.901116 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:48.901116 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:48.901116 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:48.901116 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:48.901116 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:48.901116 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:48.901116 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:48.901116 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:48.901116 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:48.901116 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:48.901116 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:48.901116 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:48.902674 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:08:48.902674 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:08:48.902674 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:48.902674 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:48.902674 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 530/1064] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:48.906602 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7d823-dbee-4d09-8f53-0c520de2cc57 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:49.010997 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4db7d823-dbee-4d09-8f53-0c520de2cc57 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:49.044990 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a375a1de-40eb-4158-87d6-29a8c3d9e309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:49.045605 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375a1de-40eb-4158-87d6-29a8c3d9e309 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:49.045886 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375a1de-40eb-4158-87d6-29a8c3d9e309 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:49.046161 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a375a1de-40eb-4158-87d6-29a8c3d9e309 None admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:49.046847 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a375a1de-40eb-4158-87d6-29a8c3d9e309 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:49.047149 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a375a1de-40eb-4158-87d6-29a8c3d9e309 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:49.048657 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a375a1de-40eb-4158-87d6-29a8c3d9e309 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:49.065848 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 535/1065] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:08:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:49.067236 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60981051-7b75-4ef6-8da3-f29aa00a579d None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:49.086968 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:49.139187 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebdea6-f2dc-4df9-b6c5-8147f9f5e9bf None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:49.139514 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebdea6-f2dc-4df9-b6c5-8147f9f5e9bf None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:49.139770 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ebdea6-f2dc-4df9-b6c5-8147f9f5e9bf None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:49.141270 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 536/1066] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:08:49.146533 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878422a3-ee34-4fd8-bebd-9d29bce76a1e None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:49.146820 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878422a3-ee34-4fd8-bebd-9d29bce76a1e None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:49.147099 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878422a3-ee34-4fd8-bebd-9d29bce76a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:49.165482 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-878422a3-ee34-4fd8-bebd-9d29bce76a1e None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:49.167179 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-878422a3-ee34-4fd8-bebd-9d29bce76a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:49.177249 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60981051-7b75-4ef6-8da3-f29aa00a579d None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:49.213403 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d6134-e2a6-4e0b-9940-32956719cbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:49.214389 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d6134-e2a6-4e0b-9940-32956719cbb8 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:49.214869 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d6134-e2a6-4e0b-9940-32956719cbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:49.215336 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830d6134-e2a6-4e0b-9940-32956719cbb8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:49.223698 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830d6134-e2a6-4e0b-9940-32956719cbb8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:49.225431 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830d6134-e2a6-4e0b-9940-32956719cbb8 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:49.234882 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:49.236895 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-830d6134-e2a6-4e0b-9940-32956719cbb8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 02:08:49.236895 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:49.236895 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:49.236895 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:49.236895 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:49.236895 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:49.236895 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:49.236895 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:49.236895 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:49.236895 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:49.236895 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:49.236895 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:49.236895 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:08:49.236895 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:08:49.236895 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:08:49.236895 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:08:49.238153 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:49.238153 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:49.238153 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:08:49.238153 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:08:49.238153 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:08:49.238153 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:08:49.238153 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:49.238153 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:49.238153 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:49.238153 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:49.238153 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:49.238153 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:49.238153 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:49.238153 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:49.238153 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:49.238153 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:49.238153 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:49.238153 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:49.239145 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:49.239145 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:49.239145 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:08:49.239145 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:08:49.239145 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:08:49.239145 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:08:49.239145 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:08:49.239145 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:08:49.239145 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 02:08:49.239145 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:49.239145 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 531/1067] 10.222.0.15 () {56 vars in 1093 bytes} [Fri Aug 5 02:08:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:49.244002 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d6134-e2a6-4e0b-9940-32956719cbb8 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:49.250587 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 537/1068] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 02:08:49.272670 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878422a3-ee34-4fd8-bebd-9d29bce76a1e None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:49.326098 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:49.352689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830d6134-e2a6-4e0b-9940-32956719cbb8 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:49.382279 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878422a3-ee34-4fd8-bebd-9d29bce76a1e None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:49.388557 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732d7c5-8b79-4bc8-b68a-e5e9e24f52ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:49.389175 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732d7c5-8b79-4bc8-b68a-e5e9e24f52ee None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:49.389449 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732d7c5-8b79-4bc8-b68a-e5e9e24f52ee None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:49.389759 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7732d7c5-8b79-4bc8-b68a-e5e9e24f52ee None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:49.390544 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732d7c5-8b79-4bc8-b68a-e5e9e24f52ee None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:49.390847 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732d7c5-8b79-4bc8-b68a-e5e9e24f52ee None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:49.392248 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7732d7c5-8b79-4bc8-b68a-e5e9e24f52ee None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:49.410520 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 532/1069] 10.222.0.15 () {56 vars in 1133 bytes} [Fri Aug 5 02:08:49 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:49.416103 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732d7c5-8b79-4bc8-b68a-e5e9e24f52ee None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:49.420908 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c04ee-980c-4906-b506-e71228fd0be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:49.421555 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c04ee-980c-4906-b506-e71228fd0be1 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:49.421844 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c04ee-980c-4906-b506-e71228fd0be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:49.422120 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76c04ee-980c-4906-b506-e71228fd0be1 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:49.433801 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76c04ee-980c-4906-b506-e71228fd0be1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:08:49.438759 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-b76c04ee-980c-4906-b506-e71228fd0be1 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:08:49.438759 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:49.438759 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:49.438759 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:49.438759 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:49.438759 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:49.438759 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:49.438759 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:49.438759 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:49.438759 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:49.438759 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:49.438759 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:49.438759 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:08:49.438759 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:08:49.438759 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:08:49.438759 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:08:49.439934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:08:49.439934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:08:49.439934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:08:49.439934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:08:49.439934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:49.439934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:49.439934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:49.439934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:49.439934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:49.439934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:49.439934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:49.439934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:49.439934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:49.439934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:49.439934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:49.439934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:49.441706 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:49.441706 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:49.441706 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:49.441706 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:49.441706 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:08:49.441706 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:08:49.441706 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:08:49.441706 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:08:49.441706 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:08:49.441706 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:08:49.441706 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:08:49.441706 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:49.441706 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 538/1070] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Aug 5 02:08:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:08:49.446588 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c04ee-980c-4906-b506-e71228fd0be1 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:49.510181 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:49.525587 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7732d7c5-8b79-4bc8-b68a-e5e9e24f52ee None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:49.561013 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85d7e0-c84e-4d82-91f4-e2361c55ec19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:49.561649 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85d7e0-c84e-4d82-91f4-e2361c55ec19 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:49.561929 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85d7e0-c84e-4d82-91f4-e2361c55ec19 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:49.562200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef85d7e0-c84e-4d82-91f4-e2361c55ec19 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:49.562459 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76c04ee-980c-4906-b506-e71228fd0be1 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:49.564129 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:49.573479 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef85d7e0-c84e-4d82-91f4-e2361c55ec19 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:49.574913 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef85d7e0-c84e-4d82-91f4-e2361c55ec19 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:49.590230 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-ef85d7e0-c84e-4d82-91f4-e2361c55ec19 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:49.590230 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:49.590230 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:49.590230 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:49.590230 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:49.590230 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:49.590230 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:49.590230 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:49.590230 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:49.590230 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:49.590230 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:49.590230 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:49.590230 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:08:49.590230 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:08:49.590230 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:08:49.591326 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:08:49.591326 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:49.591326 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:49.591326 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:49.591326 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:49.591326 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:49.591326 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:49.591326 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:49.591326 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:49.591326 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:49.591326 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:49.591326 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:49.591326 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:49.591326 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:49.591326 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:49.591326 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:49.591326 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:49.592222 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:08:49.592222 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:08:49.592222 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:49.592222 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:49.592222 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 533/1071] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:08:49.597433 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85d7e0-c84e-4d82-91f4-e2361c55ec19 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:49.603589 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4dd70-4e66-4042-ae0c-8d50b9cdf8ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:49.604213 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4dd70-4e66-4042-ae0c-8d50b9cdf8ed None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:49.604527 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4dd70-4e66-4042-ae0c-8d50b9cdf8ed None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:49.604804 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a4dd70-4e66-4042-ae0c-8d50b9cdf8ed None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:49.605515 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4dd70-4e66-4042-ae0c-8d50b9cdf8ed None admin] RBAC: Adding query filter params (name=admin) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:49.605819 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4dd70-4e66-4042-ae0c-8d50b9cdf8ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:49.607182 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a4dd70-4e66-4042-ae0c-8d50b9cdf8ed None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:49.615992 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 539/1072] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:08:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:49.621626 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4dd70-4e66-4042-ae0c-8d50b9cdf8ed None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:49.709165 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef85d7e0-c84e-4d82-91f4-e2361c55ec19 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:49.725118 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a4dd70-4e66-4042-ae0c-8d50b9cdf8ed None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:49.738447 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:49.746520 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38f26e-028e-4d4c-ba71-7ca9886a94d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:49.747223 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38f26e-028e-4d4c-ba71-7ca9886a94d8 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:49.747583 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38f26e-028e-4d4c-ba71-7ca9886a94d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:49.747861 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee38f26e-028e-4d4c-ba71-7ca9886a94d8 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:49.748589 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee38f26e-028e-4d4c-ba71-7ca9886a94d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:49.748898 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee38f26e-028e-4d4c-ba71-7ca9886a94d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:49.750253 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee38f26e-028e-4d4c-ba71-7ca9886a94d8 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:49.761816 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34cfb88-6b82-4c3d-8eda-669f8ed34a03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:49.762451 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34cfb88-6b82-4c3d-8eda-669f8ed34a03 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:49.767370 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34cfb88-6b82-4c3d-8eda-669f8ed34a03 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:49.767512 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 534/1073] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:08:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:49.767595 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34cfb88-6b82-4c3d-8eda-669f8ed34a03 None admin] PATH_INFO: `/v3/users/14aaf60c579140e6b7ecb8a8575afff2` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:49.767595 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34cfb88-6b82-4c3d-8eda-669f8ed34a03 None admin] RBAC: Authorizing `identity:get_user(user_id=14aaf60c579140e6b7ecb8a8575afff2)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:49.767595 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a34cfb88-6b82-4c3d-8eda-669f8ed34a03 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:49.768182 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38f26e-028e-4d4c-ba71-7ca9886a94d8 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:49.772661 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 540/1074] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:08:49 2022] GET /identity/v3/users/14aaf60c579140e6b7ecb8a8575afff2 => generated 285 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:49.773531 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34cfb88-6b82-4c3d-8eda-669f8ed34a03 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:49.824791 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:49.885186 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34cfb88-6b82-4c3d-8eda-669f8ed34a03 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:49.889650 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee38f26e-028e-4d4c-ba71-7ca9886a94d8 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:49.922114 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2d440-c31d-433b-8b18-fc4e3ef32624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:49.922846 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2d440-c31d-433b-8b18-fc4e3ef32624 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:49.923177 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2d440-c31d-433b-8b18-fc4e3ef32624 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:49.923452 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd2d440-c31d-433b-8b18-fc4e3ef32624 None admin] PATH_INFO: `/v3/projects/54ca5e241c5d4737aee16091b1e82226` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:49.924716 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2d440-c31d-433b-8b18-fc4e3ef32624 None admin] RBAC: Authorizing `identity:get_project(project_id=54ca5e241c5d4737aee16091b1e82226)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:49.925984 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99962a5e-ed54-4332-a635-84d55c0adce1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:49.926429 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd2d440-c31d-433b-8b18-fc4e3ef32624 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:49.926693 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99962a5e-ed54-4332-a635-84d55c0adce1 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:49.927041 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99962a5e-ed54-4332-a635-84d55c0adce1 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:49.927384 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99962a5e-ed54-4332-a635-84d55c0adce1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:49.927992 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 541/1075] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:08:49 2022] GET /identity/v3/projects/54ca5e241c5d4737aee16091b1e82226 => generated 311 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:49.933424 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2d440-c31d-433b-8b18-fc4e3ef32624 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:49.934615 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99962a5e-ed54-4332-a635-84d55c0adce1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:49.936113 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99962a5e-ed54-4332-a635-84d55c0adce1 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:49.950094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-99962a5e-ed54-4332-a635-84d55c0adce1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:08:49.950094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:49.950094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:49.950094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:49.950094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:49.950094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:49.950094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:49.950094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:49.950094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:49.950094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:49.950094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:49.950094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:49.950094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:08:49.950094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:08:49.950094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:08:49.950995 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:08:49.950995 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:49.950995 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:49.950995 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:49.950995 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:49.950995 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:49.950995 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:49.950995 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:49.950995 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:49.950995 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:49.950995 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:49.950995 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:49.950995 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:49.950995 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:49.950995 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:49.950995 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:49.950995 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:49.951921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:08:49.951921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:08:49.951921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:08:49.951921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:08:49.951921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:08:49.951921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:08:49.951921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:08:49.951921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:49.956714 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 535/1076] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:08:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:08:49.957717 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99962a5e-ed54-4332-a635-84d55c0adce1 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:49.985939 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:50.041735 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd2d440-c31d-433b-8b18-fc4e3ef32624 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:50.068482 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99962a5e-ed54-4332-a635-84d55c0adce1 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:50.075374 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:50.079296 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf31ed-4879-474c-b5d6-815a62e40190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:50.079945 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf31ed-4879-474c-b5d6-815a62e40190 None admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:50.080232 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf31ed-4879-474c-b5d6-815a62e40190 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:50.080541 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cf31ed-4879-474c-b5d6-815a62e40190 None admin] PATH_INFO: `/v3/projects/54ca5e241c5d4737aee16091b1e82226/users/14aaf60c579140e6b7ecb8a8575afff2/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:50.083009 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf31ed-4879-474c-b5d6-815a62e40190 None admin] RBAC: Authorizing `identity:create_grant(project_id=54ca5e241c5d4737aee16091b1e82226, user_id=14aaf60c579140e6b7ecb8a8575afff2, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:50.084482 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cf31ed-4879-474c-b5d6-815a62e40190 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:50.108361 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 542/1077] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Aug 5 02:08:49 2022] PUT /identity/v3/projects/54ca5e241c5d4737aee16091b1e82226/users/14aaf60c579140e6b7ecb8a8575afff2/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:08:50.115207 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79aaa018-e4de-4884-b54e-37c95d501262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:50.115983 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aaa018-e4de-4884-b54e-37c95d501262 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:50.116345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aaa018-e4de-4884-b54e-37c95d501262 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:50.116712 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79aaa018-e4de-4884-b54e-37c95d501262 None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:50.117562 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aaa018-e4de-4884-b54e-37c95d501262 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:50.117979 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aaa018-e4de-4884-b54e-37c95d501262 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:50.119596 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79aaa018-e4de-4884-b54e-37c95d501262 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:50.139186 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 536/1078] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Aug 5 02:08:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:50.140561 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf31ed-4879-474c-b5d6-815a62e40190 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:50.252657 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cf31ed-4879-474c-b5d6-815a62e40190 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:50.261576 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:50.289735 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af503b8-e3dc-48af-88c1-bbfe29f2748d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:50.290402 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af503b8-e3dc-48af-88c1-bbfe29f2748d None admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:50.290678 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af503b8-e3dc-48af-88c1-bbfe29f2748d None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:50.290952 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af503b8-e3dc-48af-88c1-bbfe29f2748d None admin] PATH_INFO: `/v3/projects/95d88dece7184bf1842c4f8d275d52cd/users/4b5c0958604b436daa44b1f67c9dec26/roles/27e54d7ab8954b0bbd5f964610e01cea` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:50.293143 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af503b8-e3dc-48af-88c1-bbfe29f2748d None admin] RBAC: Authorizing `identity:create_grant(project_id=95d88dece7184bf1842c4f8d275d52cd, user_id=4b5c0958604b436daa44b1f67c9dec26, role_id=27e54d7ab8954b0bbd5f964610e01cea)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:50.294577 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af503b8-e3dc-48af-88c1-bbfe29f2748d None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:50.309070 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 543/1079] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Aug 5 02:08:50 2022] PUT /identity/v3/projects/95d88dece7184bf1842c4f8d275d52cd/users/4b5c0958604b436daa44b1f67c9dec26/roles/27e54d7ab8954b0bbd5f964610e01cea => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:08:50.753355 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97604f-16f9-45a2-9c00-69acee2b5f26 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:50.753641 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97604f-16f9-45a2-9c00-69acee2b5f26 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:50.753919 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce97604f-16f9-45a2-9c00-69acee2b5f26 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:50.755296 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 537/1080] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:08:50.760530 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a49585-3b26-4142-8439-4ff44a30b17f None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:50.760827 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a49585-3b26-4142-8439-4ff44a30b17f None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:50.761107 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a49585-3b26-4142-8439-4ff44a30b17f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:50.779473 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-c6a49585-3b26-4142-8439-4ff44a30b17f None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:50.780691 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-c6a49585-3b26-4142-8439-4ff44a30b17f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:50.859202 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 544/1081] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:50 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:08:50.881134 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97604f-16f9-45a2-9c00-69acee2b5f26 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:50.984734 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce97604f-16f9-45a2-9c00-69acee2b5f26 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:51.019380 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408f4a1-15ce-4340-be2f-a5eed5f04791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:51.019946 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408f4a1-15ce-4340-be2f-a5eed5f04791 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:51.020226 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408f4a1-15ce-4340-be2f-a5eed5f04791 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:51.020530 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b408f4a1-15ce-4340-be2f-a5eed5f04791 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:51.054384 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:51.089422 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408f4a1-15ce-4340-be2f-a5eed5f04791 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:51.090857 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b408f4a1-15ce-4340-be2f-a5eed5f04791 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:51.189594 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 538/1082] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:08:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 02:08:51.195959 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a49585-3b26-4142-8439-4ff44a30b17f None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:51.294590 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:51.299264 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a49585-3b26-4142-8439-4ff44a30b17f None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:51.335153 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38901404-c734-4449-85cc-f17988dd97ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:51.335794 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38901404-c734-4449-85cc-f17988dd97ed None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:51.336076 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38901404-c734-4449-85cc-f17988dd97ed None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:51.336439 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38901404-c734-4449-85cc-f17988dd97ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:51.346613 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38901404-c734-4449-85cc-f17988dd97ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:51.348055 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38901404-c734-4449-85cc-f17988dd97ed None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:51.362707 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-38901404-c734-4449-85cc-f17988dd97ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:51.362707 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:51.362707 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:51.362707 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:51.362707 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:51.362707 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:51.362707 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:51.362707 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:51.362707 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:51.362707 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:51.362707 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:51.362707 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:51.362707 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:08:51.362707 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:08:51.362707 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:08:51.363645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:08:51.363645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:51.363645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:51.363645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:51.363645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:51.363645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:51.363645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:51.363645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:51.363645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:51.363645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:51.363645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:51.363645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:51.363645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:51.363645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:51.363645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:51.363645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:51.363645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:51.364987 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:08:51.364987 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:08:51.364987 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:51.364987 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:51.368482 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 545/1083] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:08:51.369789 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408f4a1-15ce-4340-be2f-a5eed5f04791 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:51.436828 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:51.473660 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b408f4a1-15ce-4340-be2f-a5eed5f04791 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:51.522232 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e1fa0c-bbe6-4b8c-8ed9-6b22b5ecbff0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:51.522853 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1fa0c-bbe6-4b8c-8ed9-6b22b5ecbff0 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:51.523132 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1fa0c-bbe6-4b8c-8ed9-6b22b5ecbff0 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:51.523406 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e1fa0c-bbe6-4b8c-8ed9-6b22b5ecbff0 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:51.524093 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e1fa0c-bbe6-4b8c-8ed9-6b22b5ecbff0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:51.524419 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e1fa0c-bbe6-4b8c-8ed9-6b22b5ecbff0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:51.525770 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e1fa0c-bbe6-4b8c-8ed9-6b22b5ecbff0 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:51.537755 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 539/1084] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:08:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:52.132531 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46467da2-155c-45f1-aa5a-8850224b1c7e None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:52.132776 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46467da2-155c-45f1-aa5a-8850224b1c7e None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:52.133006 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46467da2-155c-45f1-aa5a-8850224b1c7e None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:52.134353 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 546/1085] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:08:52.139546 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a36282-20f6-4401-8cea-1b797f6c5b8f None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:52.139981 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a36282-20f6-4401-8cea-1b797f6c5b8f None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:52.140229 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a36282-20f6-4401-8cea-1b797f6c5b8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:52.158081 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-30a36282-20f6-4401-8cea-1b797f6c5b8f None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:52.159770 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-30a36282-20f6-4401-8cea-1b797f6c5b8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:52.224890 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 540/1086] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:08:52.248033 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46467da2-155c-45f1-aa5a-8850224b1c7e None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:52.323433 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90125d-d2f0-4d0c-9505-30a4ab610484 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:52.323716 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90125d-d2f0-4d0c-9505-30a4ab610484 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:52.323989 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f90125d-d2f0-4d0c-9505-30a4ab610484 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:52.325383 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 541/1087] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:08:52.330099 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce218799-9c21-4002-91f9-1638904d9c62 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:52.330386 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce218799-9c21-4002-91f9-1638904d9c62 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:52.331197 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce218799-9c21-4002-91f9-1638904d9c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:52.350584 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46467da2-155c-45f1-aa5a-8850224b1c7e None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:52.350754 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-ce218799-9c21-4002-91f9-1638904d9c62 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:52.351848 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-ce218799-9c21-4002-91f9-1638904d9c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:52.384119 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2659f4-b1e2-45eb-8cc3-5e9daecdc5eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:52.384715 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2659f4-b1e2-45eb-8cc3-5e9daecdc5eb None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:52.384996 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2659f4-b1e2-45eb-8cc3-5e9daecdc5eb None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:52.385267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2659f4-b1e2-45eb-8cc3-5e9daecdc5eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:52.396554 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2659f4-b1e2-45eb-8cc3-5e9daecdc5eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:08:52.401399 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-5c2659f4-b1e2-45eb-8cc3-5e9daecdc5eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:08:52.401399 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:52.401399 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:52.401399 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:52.401399 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:52.401399 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:52.401399 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:52.401399 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:52.401399 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:52.401399 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:52.401399 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:52.401399 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:52.401399 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:08:52.401399 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:08:52.401399 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:08:52.401399 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:08:52.402428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:08:52.402428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:08:52.402428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:08:52.402428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:08:52.402428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:52.402428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:52.402428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:52.402428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:52.402428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:52.402428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:52.402428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:52.402428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:52.402428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:52.402428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:52.402428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:52.402428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:52.403317 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:52.403317 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:52.403317 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:52.403317 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:52.403317 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:08:52.403317 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:08:52.403317 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:08:52.403317 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:08:52.403317 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:08:52.403317 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:08:52.403317 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:08:52.403317 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:08:52.403317 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 547/1088] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Aug 5 02:08:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:52.404740 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:52.408544 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2659f4-b1e2-45eb-8cc3-5e9daecdc5eb None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:52.418068 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 542/1089] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:52 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 02:08:52.420764 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:52.441895 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce218799-9c21-4002-91f9-1638904d9c62 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:52.508796 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2659f4-b1e2-45eb-8cc3-5e9daecdc5eb None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:52.538165 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce218799-9c21-4002-91f9-1638904d9c62 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:52.545478 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80acc3b5-ad83-4d5f-bb82-84d3ba947309 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:52.546089 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acc3b5-ad83-4d5f-bb82-84d3ba947309 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:52.546368 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acc3b5-ad83-4d5f-bb82-84d3ba947309 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:52.546639 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80acc3b5-ad83-4d5f-bb82-84d3ba947309 None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:52.547350 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80acc3b5-ad83-4d5f-bb82-84d3ba947309 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:52.547707 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80acc3b5-ad83-4d5f-bb82-84d3ba947309 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:52.549099 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80acc3b5-ad83-4d5f-bb82-84d3ba947309 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:52.557632 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 548/1090] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:08:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:52.563316 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80acc3b5-ad83-4d5f-bb82-84d3ba947309 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:52.573454 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db4b1d-f994-4d7b-90ec-df5aafe39e8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:52.574096 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db4b1d-f994-4d7b-90ec-df5aafe39e8f None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:52.574387 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db4b1d-f994-4d7b-90ec-df5aafe39e8f None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:52.574653 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db4b1d-f994-4d7b-90ec-df5aafe39e8f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:52.584643 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db4b1d-f994-4d7b-90ec-df5aafe39e8f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:08:52.589555 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-32db4b1d-f994-4d7b-90ec-df5aafe39e8f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 02:08:52.589555 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:52.589555 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:52.589555 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:52.589555 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:52.589555 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:52.589555 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:52.589555 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:52.589555 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:52.589555 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:52.589555 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:52.589555 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:52.589555 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:08:52.589555 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:08:52.589555 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:08:52.589555 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:08:52.590581 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:08:52.590581 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:08:52.590581 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:08:52.590581 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:08:52.590581 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:52.590581 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:52.590581 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:52.590581 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:52.590581 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:52.590581 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:52.590581 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:52.590581 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:52.590581 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:52.590581 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:52.590581 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:52.590581 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:52.591440 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:52.591440 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:52.591440 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:52.591440 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:52.591440 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:08:52.591440 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:08:52.591440 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:08:52.591440 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:08:52.591440 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:08:52.591440 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:08:52.591440 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 05 02:08:52.591440 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:52.591440 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 543/1091] 10.222.0.15 () {56 vars in 1120 bytes} [Fri Aug 5 02:08:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:08:52.596922 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db4b1d-f994-4d7b-90ec-df5aafe39e8f None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:52.636673 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:52.646748 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:52.667553 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80acc3b5-ad83-4d5f-bb82-84d3ba947309 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:52.698855 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db4b1d-f994-4d7b-90ec-df5aafe39e8f None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:52.700689 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e903f84e-89f7-4846-9c5f-0b21ec57eb1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:52.701330 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903f84e-89f7-4846-9c5f-0b21ec57eb1e None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:52.701616 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903f84e-89f7-4846-9c5f-0b21ec57eb1e None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:52.701893 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e903f84e-89f7-4846-9c5f-0b21ec57eb1e None admin] PATH_INFO: `/v3/users/14aaf60c579140e6b7ecb8a8575afff2` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:52.703071 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e903f84e-89f7-4846-9c5f-0b21ec57eb1e None admin] RBAC: Authorizing `identity:get_user(user_id=14aaf60c579140e6b7ecb8a8575afff2)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:52.704534 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e903f84e-89f7-4846-9c5f-0b21ec57eb1e None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:52.710959 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 549/1092] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:08:52 2022] GET /identity/v3/users/14aaf60c579140e6b7ecb8a8575afff2 => generated 285 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:52.712094 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e903f84e-89f7-4846-9c5f-0b21ec57eb1e None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:52.735141 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8abe6b-3959-4da3-aa70-5af1e7397f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:52.735758 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8abe6b-3959-4da3-aa70-5af1e7397f8a None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:52.736041 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8abe6b-3959-4da3-aa70-5af1e7397f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:52.736317 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e8abe6b-3959-4da3-aa70-5af1e7397f8a None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:52.737644 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8abe6b-3959-4da3-aa70-5af1e7397f8a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:52.738143 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8abe6b-3959-4da3-aa70-5af1e7397f8a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:52.739459 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e8abe6b-3959-4da3-aa70-5af1e7397f8a None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:52.747482 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 544/1093] 10.222.0.15 () {56 vars in 1115 bytes} [Fri Aug 5 02:08:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:52.753335 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8abe6b-3959-4da3-aa70-5af1e7397f8a None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:52.813675 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e903f84e-89f7-4846-9c5f-0b21ec57eb1e None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:52.852526 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b750a0d-eff7-43a8-8665-c7611d897bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:52.853137 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b750a0d-eff7-43a8-8665-c7611d897bed None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:52.853416 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b750a0d-eff7-43a8-8665-c7611d897bed None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:52.853686 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b750a0d-eff7-43a8-8665-c7611d897bed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:52.855842 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e8abe6b-3959-4da3-aa70-5af1e7397f8a None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:52.864908 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:52.865963 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:52.891364 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84c88d-94e5-40ea-9283-239ab0629afe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:52.891934 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84c88d-94e5-40ea-9283-239ab0629afe None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:52.892219 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84c88d-94e5-40ea-9283-239ab0629afe None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:52.892529 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a84c88d-94e5-40ea-9283-239ab0629afe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:52.903074 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84c88d-94e5-40ea-9283-239ab0629afe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:52.904527 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a84c88d-94e5-40ea-9283-239ab0629afe None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:52.919448 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-4a84c88d-94e5-40ea-9283-239ab0629afe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:52.919448 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:52.919448 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:52.919448 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:52.919448 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:52.919448 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:52.919448 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:52.919448 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:52.919448 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:52.919448 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:52.919448 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:52.919448 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:52.919448 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:08:52.919448 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:08:52.919448 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:08:52.920657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:08:52.920657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:52.920657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:52.920657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:52.920657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:52.920657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:52.920657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:52.920657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:52.920657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:52.920657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:52.920657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:52.920657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:52.920657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:52.920657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:52.920657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:52.920657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:52.920657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:52.922068 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:08:52.922068 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:08:52.922068 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:52.922068 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:52.922068 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 545/1094] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:08:52.922765 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b750a0d-eff7-43a8-8665-c7611d897bed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:52.924198 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b750a0d-eff7-43a8-8665-c7611d897bed None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:52.926899 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84c88d-94e5-40ea-9283-239ab0629afe None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:53.023716 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 550/1095] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:08:52 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Aug 05 02:08:53.024974 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a84c88d-94e5-40ea-9283-239ab0629afe None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:53.029511 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b750a0d-eff7-43a8-8665-c7611d897bed None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:53.058387 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b88002-1b57-4c8d-bc21-3cec20ff0c8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:53.058989 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b88002-1b57-4c8d-bc21-3cec20ff0c8f None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:53.059263 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b88002-1b57-4c8d-bc21-3cec20ff0c8f None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:53.059530 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b88002-1b57-4c8d-bc21-3cec20ff0c8f None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:53.060212 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b88002-1b57-4c8d-bc21-3cec20ff0c8f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:53.060541 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b88002-1b57-4c8d-bc21-3cec20ff0c8f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:53.061897 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b88002-1b57-4c8d-bc21-3cec20ff0c8f None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:53.070286 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:53.074868 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 546/1096] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:08:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:53.080310 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b88002-1b57-4c8d-bc21-3cec20ff0c8f None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:53.102263 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:53.130044 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b750a0d-eff7-43a8-8665-c7611d897bed None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:53.163374 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e46ac1-6a2a-4903-9c84-d024a525b360 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:53.163934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e46ac1-6a2a-4903-9c84-d024a525b360 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:53.164211 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e46ac1-6a2a-4903-9c84-d024a525b360 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:53.164519 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e46ac1-6a2a-4903-9c84-d024a525b360 None admin] PATH_INFO: `/v3/projects/54ca5e241c5d4737aee16091b1e82226` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:53.165657 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e46ac1-6a2a-4903-9c84-d024a525b360 None admin] RBAC: Authorizing `identity:get_project(project_id=54ca5e241c5d4737aee16091b1e82226)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:53.167080 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e46ac1-6a2a-4903-9c84-d024a525b360 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:53.168770 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 551/1097] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:08:53 2022] GET /identity/v3/projects/54ca5e241c5d4737aee16091b1e82226 => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:53.175288 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e46ac1-6a2a-4903-9c84-d024a525b360 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:53.181003 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b88002-1b57-4c8d-bc21-3cec20ff0c8f None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:53.216217 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead9819-2273-4f9d-b2ea-653f376681ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:53.216892 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead9819-2273-4f9d-b2ea-653f376681ba None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:53.217167 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead9819-2273-4f9d-b2ea-653f376681ba None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:53.217432 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ead9819-2273-4f9d-b2ea-653f376681ba None admin] PATH_INFO: `/v3/users/nova` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:53.224577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ead9819-2273-4f9d-b2ea-653f376681ba None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:53.225989 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ead9819-2273-4f9d-b2ea-653f376681ba None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:53.238040 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-7ead9819-2273-4f9d-b2ea-653f376681ba None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 05 02:08:53.238040 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:53.238040 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:53.238040 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:53.238040 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:53.238040 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:53.238040 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:53.238040 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:53.238040 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:53.238040 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:53.238040 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:53.238040 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:53.238040 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:08:53.238040 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:08:53.238040 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:08:53.238040 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:08:53.239028 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:53.239028 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:53.239028 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:08:53.239028 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:08:53.239028 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:08:53.239028 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:08:53.239028 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:53.239028 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:53.239028 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:53.239028 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:53.239028 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:53.239028 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:53.239028 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:53.239028 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:53.239028 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:53.239028 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:53.239028 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:53.239028 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:53.240094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:53.240094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:53.240094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:08:53.240094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:08:53.240094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:08:53.240094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:08:53.240094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:08:53.240094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:08:53.240094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 05 02:08:53.240094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:53.240094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 547/1098] 10.222.0.15 () {56 vars in 1093 bytes} [Fri Aug 5 02:08:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:08:53.244824 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead9819-2273-4f9d-b2ea-653f376681ba None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:53.275604 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e46ac1-6a2a-4903-9c84-d024a525b360 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:53.284740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:53.311211 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec542f-2a44-449a-b81a-14050181d2b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:53.311814 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec542f-2a44-449a-b81a-14050181d2b2 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:53.312092 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec542f-2a44-449a-b81a-14050181d2b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:53.312387 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ec542f-2a44-449a-b81a-14050181d2b2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:53.313196 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ec542f-2a44-449a-b81a-14050181d2b2 None admin] RBAC: Adding query filter params (role.id=e1b75d5eea2a43b2b1b14cf0515350fa, scope.project.id=54ca5e241c5d4737aee16091b1e82226, user.id=14aaf60c579140e6b7ecb8a8575afff2) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:53.313501 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ec542f-2a44-449a-b81a-14050181d2b2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:53.315453 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ec542f-2a44-449a-b81a-14050181d2b2 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:53.321103 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 552/1099] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:08:53 2022] GET /identity/v3/role_assignments?user.id=14aaf60c579140e6b7ecb8a8575afff2&scope.project.id=54ca5e241c5d4737aee16091b1e82226&role.id=e1b75d5eea2a43b2b1b14cf0515350fa => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:53.325629 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:53.347306 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ead9819-2273-4f9d-b2ea-653f376681ba None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:53.384610 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9489a-417c-4522-9629-7be85728e9c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:53.385247 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9489a-417c-4522-9629-7be85728e9c6 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:53.385530 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9489a-417c-4522-9629-7be85728e9c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:53.385806 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d9489a-417c-4522-9629-7be85728e9c6 None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:53.386623 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d9489a-417c-4522-9629-7be85728e9c6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:53.386935 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d9489a-417c-4522-9629-7be85728e9c6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:53.388412 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d9489a-417c-4522-9629-7be85728e9c6 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:53.407704 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 548/1100] 10.222.0.15 () {56 vars in 1133 bytes} [Fri Aug 5 02:08:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:53.414903 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec542f-2a44-449a-b81a-14050181d2b2 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:53.523657 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ec542f-2a44-449a-b81a-14050181d2b2 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:53.557765 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde34209-2427-4be9-9cd8-c407dcff9180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:53.558377 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde34209-2427-4be9-9cd8-c407dcff9180 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:53.558658 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde34209-2427-4be9-9cd8-c407dcff9180 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:53.558933 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde34209-2427-4be9-9cd8-c407dcff9180 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:53.601119 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:53.628640 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde34209-2427-4be9-9cd8-c407dcff9180 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:53.630084 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde34209-2427-4be9-9cd8-c407dcff9180 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:53.727493 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 553/1101] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:08:53 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 02:08:53.733191 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9489a-417c-4522-9629-7be85728e9c6 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:53.831333 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d9489a-417c-4522-9629-7be85728e9c6 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:53.866273 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcdbd8-0c95-4be9-871f-b79aa1978cce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:53.866906 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcdbd8-0c95-4be9-871f-b79aa1978cce None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:53.867186 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcdbd8-0c95-4be9-871f-b79aa1978cce None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:53.867459 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fcdbd8-0c95-4be9-871f-b79aa1978cce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:53.874050 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:53.878631 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fcdbd8-0c95-4be9-871f-b79aa1978cce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:53.880056 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fcdbd8-0c95-4be9-871f-b79aa1978cce None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:53.894950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-26fcdbd8-0c95-4be9-871f-b79aa1978cce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:53.894950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:53.894950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:53.894950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:53.894950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:53.894950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:53.894950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:53.894950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:53.894950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:53.894950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:53.894950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:53.894950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:53.894950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:08:53.894950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:08:53.894950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:08:53.896039 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:08:53.896039 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:53.896039 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:53.896039 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:53.896039 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:53.896039 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:53.896039 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:53.896039 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:53.896039 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:53.896039 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:53.896039 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:53.896039 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:53.896039 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:53.896039 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:53.896039 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:53.896039 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:53.896039 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:53.897180 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:08:53.897180 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:08:53.897180 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:08:53.897180 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:53.897180 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 549/1102] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:08:53.901663 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde34209-2427-4be9-9cd8-c407dcff9180 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:53.968728 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:53.998079 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde34209-2427-4be9-9cd8-c407dcff9180 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:54.031212 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9157c-4b8e-405c-bbe0-9dc48d5ff7f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:54.031823 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9157c-4b8e-405c-bbe0-9dc48d5ff7f9 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:54.032098 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9157c-4b8e-405c-bbe0-9dc48d5ff7f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:54.032392 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e9157c-4b8e-405c-bbe0-9dc48d5ff7f9 None admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:54.033078 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e9157c-4b8e-405c-bbe0-9dc48d5ff7f9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:54.033377 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e9157c-4b8e-405c-bbe0-9dc48d5ff7f9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:54.034735 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e9157c-4b8e-405c-bbe0-9dc48d5ff7f9 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:54.045782 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 554/1103] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:08:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:54.051946 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcdbd8-0c95-4be9-871f-b79aa1978cce None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:54.148774 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fcdbd8-0c95-4be9-871f-b79aa1978cce None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:54.181748 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6101b6-1f44-4b60-a287-7fbd52fd13c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:54.182381 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6101b6-1f44-4b60-a287-7fbd52fd13c7 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:54.182657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6101b6-1f44-4b60-a287-7fbd52fd13c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:54.182928 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6101b6-1f44-4b60-a287-7fbd52fd13c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:54.189399 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6101b6-1f44-4b60-a287-7fbd52fd13c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:54.191026 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc6101b6-1f44-4b60-a287-7fbd52fd13c7 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:54.202914 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-fc6101b6-1f44-4b60-a287-7fbd52fd13c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:08:54.202914 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:08:54.202914 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:08:54.202914 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:08:54.202914 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:08:54.202914 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:08:54.202914 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:08:54.202914 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:08:54.202914 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:08:54.202914 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:08:54.202914 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:08:54.202914 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:08:54.202914 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:08:54.202914 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:08:54.202914 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:08:54.203788 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:08:54.203788 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:08:54.203788 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:08:54.203788 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:08:54.203788 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:08:54.203788 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:08:54.203788 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:08:54.203788 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:08:54.203788 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:08:54.203788 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:08:54.203788 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:08:54.203788 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:08:54.203788 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:08:54.203788 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:08:54.203788 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:08:54.203788 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:08:54.203788 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:08:54.204702 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:08:54.204702 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:08:54.204702 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:08:54.204702 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:08:54.204702 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:08:54.204702 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:08:54.204702 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:08:54.204702 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:08:54.204702 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 550/1104] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:08:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:08:54.210297 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9157c-4b8e-405c-bbe0-9dc48d5ff7f9 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:54.308297 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e9157c-4b8e-405c-bbe0-9dc48d5ff7f9 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:54.336818 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:54.342345 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb03fe84-67d4-4dab-9bd8-9c9b79ae542e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:54.342904 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03fe84-67d4-4dab-9bd8-9c9b79ae542e None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:54.343180 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03fe84-67d4-4dab-9bd8-9c9b79ae542e None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:54.343450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb03fe84-67d4-4dab-9bd8-9c9b79ae542e None admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:54.344477 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03fe84-67d4-4dab-9bd8-9c9b79ae542e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:54.344780 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03fe84-67d4-4dab-9bd8-9c9b79ae542e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:54.346722 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb03fe84-67d4-4dab-9bd8-9c9b79ae542e None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:54.358365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 555/1105] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Aug 5 02:08:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:54.364598 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6101b6-1f44-4b60-a287-7fbd52fd13c7 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:54.414762 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:54.467095 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc6101b6-1f44-4b60-a287-7fbd52fd13c7 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:54.508794 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ed74bc-afc3-4513-9969-fa9610fcd60b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:54.509421 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed74bc-afc3-4513-9969-fa9610fcd60b None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:54.509701 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed74bc-afc3-4513-9969-fa9610fcd60b None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:54.509971 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ed74bc-afc3-4513-9969-fa9610fcd60b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:54.510755 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ed74bc-afc3-4513-9969-fa9610fcd60b None admin] RBAC: Adding query filter params (role.id=27e54d7ab8954b0bbd5f964610e01cea, scope.project.id=95d88dece7184bf1842c4f8d275d52cd, user.id=4b5c0958604b436daa44b1f67c9dec26) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:54.511062 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ed74bc-afc3-4513-9969-fa9610fcd60b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:54.512514 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ed74bc-afc3-4513-9969-fa9610fcd60b None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:54.520872 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 551/1106] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:08:54 2022] GET /identity/v3/role_assignments?user.id=4b5c0958604b436daa44b1f67c9dec26&scope.project.id=95d88dece7184bf1842c4f8d275d52cd&role.id=27e54d7ab8954b0bbd5f964610e01cea => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:55.385515 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58511ec-c381-4cb9-b311-35fd3b08eebf None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:55.386061 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58511ec-c381-4cb9-b311-35fd3b08eebf None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:55.386061 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58511ec-c381-4cb9-b311-35fd3b08eebf None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:55.387397 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 556/1107] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:08:55.392537 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28606c9-95d1-4f6c-a563-a2e3579561f4 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:55.393053 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28606c9-95d1-4f6c-a563-a2e3579561f4 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:55.393232 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b28606c9-95d1-4f6c-a563-a2e3579561f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:55.410913 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-b28606c9-95d1-4f6c-a563-a2e3579561f4 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:55.412074 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-b28606c9-95d1-4f6c-a563-a2e3579561f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:55.478418 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 552/1108] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:08:55.503637 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58511ec-c381-4cb9-b311-35fd3b08eebf None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:55.601413 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58511ec-c381-4cb9-b311-35fd3b08eebf None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:55.635086 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ccabb0d-c276-411b-a9f7-24e912762385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:55.635753 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccabb0d-c276-411b-a9f7-24e912762385 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:55.635980 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccabb0d-c276-411b-a9f7-24e912762385 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:55.636250 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccabb0d-c276-411b-a9f7-24e912762385 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:55.637410 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccabb0d-c276-411b-a9f7-24e912762385 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:55.638828 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ccabb0d-c276-411b-a9f7-24e912762385 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:55.640406 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 557/1109] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:08:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:55.646258 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28606c9-95d1-4f6c-a563-a2e3579561f4 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:55.690239 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:55.742720 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b28606c9-95d1-4f6c-a563-a2e3579561f4 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:55.774491 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c914d1e-0c54-4dc9-88a9-1cd9aec64cdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:55.775091 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c914d1e-0c54-4dc9-88a9-1cd9aec64cdb None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:55.775367 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c914d1e-0c54-4dc9-88a9-1cd9aec64cdb None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:55.775637 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c914d1e-0c54-4dc9-88a9-1cd9aec64cdb None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:55.776314 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c914d1e-0c54-4dc9-88a9-1cd9aec64cdb None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:55.777726 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c914d1e-0c54-4dc9-88a9-1cd9aec64cdb None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:55.798605 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 553/1110] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Aug 5 02:08:55 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:08:57.806975 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59714432-4d76-49a2-a709-ace7e35f6ac9 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:57.807514 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59714432-4d76-49a2-a709-ace7e35f6ac9 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:57.807514 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59714432-4d76-49a2-a709-ace7e35f6ac9 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:57.808884 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 558/1111] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:08:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:08:57.813877 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8c908-764f-42df-af72-7732045c8801 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:57.814347 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8c908-764f-42df-af72-7732045c8801 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:57.814450 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c8c908-764f-42df-af72-7732045c8801 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:57.833598 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-b6c8c908-764f-42df-af72-7732045c8801 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:08:57.834793 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-b6c8c908-764f-42df-af72-7732045c8801 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:08:57.901607 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 554/1112] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:08:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 02:08:57.925665 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59714432-4d76-49a2-a709-ace7e35f6ac9 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:57.984541 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:58.025555 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59714432-4d76-49a2-a709-ace7e35f6ac9 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:58.057827 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fdb764-5a77-4609-8b84-85fe406d82fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:58.058385 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fdb764-5a77-4609-8b84-85fe406d82fa None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:58.058663 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fdb764-5a77-4609-8b84-85fe406d82fa None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:58.058936 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54fdb764-5a77-4609-8b84-85fe406d82fa None admin] PATH_INFO: `/v3/roles/5c52e382f2bc436d95d82f2a2fae8ace` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:58.060381 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fdb764-5a77-4609-8b84-85fe406d82fa None admin] RBAC: Authorizing `identity:get_role(role_id=5c52e382f2bc436d95d82f2a2fae8ace)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:58.061738 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54fdb764-5a77-4609-8b84-85fe406d82fa None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:58.063059 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 559/1113] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:08:57 2022] GET /identity/v3/roles/5c52e382f2bc436d95d82f2a2fae8ace => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:08:58.070073 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8c908-764f-42df-af72-7732045c8801 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:58.100444 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:58.178547 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c8c908-764f-42df-af72-7732045c8801 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:58.211843 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d72c52-9a88-4faa-bbbc-f71d9a54096f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:58.212503 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d72c52-9a88-4faa-bbbc-f71d9a54096f None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:58.212787 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d72c52-9a88-4faa-bbbc-f71d9a54096f None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:58.213057 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69d72c52-9a88-4faa-bbbc-f71d9a54096f None admin] PATH_INFO: `/v3/users/30bc771cd4e74d958c91e25362b7a9a8` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:58.226368 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d72c52-9a88-4faa-bbbc-f71d9a54096f None admin] RBAC: Authorizing `identity:get_user(user_id=30bc771cd4e74d958c91e25362b7a9a8)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:58.227795 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69d72c52-9a88-4faa-bbbc-f71d9a54096f None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:58.229462 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 555/1114] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:08:58 2022] GET /identity/v3/users/30bc771cd4e74d958c91e25362b7a9a8 => generated 286 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:58.238243 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fdb764-5a77-4609-8b84-85fe406d82fa None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:58.334789 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54fdb764-5a77-4609-8b84-85fe406d82fa None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:58.359838 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:58.368418 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551127b-5cbd-44af-b4d7-1b89214e8c60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:58.369022 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551127b-5cbd-44af-b4d7-1b89214e8c60 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:58.369301 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551127b-5cbd-44af-b4d7-1b89214e8c60 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:58.369574 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2551127b-5cbd-44af-b4d7-1b89214e8c60 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:58.434164 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551127b-5cbd-44af-b4d7-1b89214e8c60 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:58.435583 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2551127b-5cbd-44af-b4d7-1b89214e8c60 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:58.534238 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 560/1115] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:08:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 02:08:58.540366 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d72c52-9a88-4faa-bbbc-f71d9a54096f None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:58.624252 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:58.635825 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69d72c52-9a88-4faa-bbbc-f71d9a54096f None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:58.669732 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36135a9c-18b4-4174-a392-14f8fd1d6c89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:58.670345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36135a9c-18b4-4174-a392-14f8fd1d6c89 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:58.670623 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36135a9c-18b4-4174-a392-14f8fd1d6c89 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:58.670892 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36135a9c-18b4-4174-a392-14f8fd1d6c89 None admin] PATH_INFO: `/v3/projects/54ca5e241c5d4737aee16091b1e82226` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:58.672006 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36135a9c-18b4-4174-a392-14f8fd1d6c89 None admin] RBAC: Authorizing `identity:get_project(project_id=54ca5e241c5d4737aee16091b1e82226)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:58.673433 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36135a9c-18b4-4174-a392-14f8fd1d6c89 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:58.675194 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 556/1116] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:08:58 2022] GET /identity/v3/projects/54ca5e241c5d4737aee16091b1e82226 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:08:58.681288 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551127b-5cbd-44af-b4d7-1b89214e8c60 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:08:58.709118 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:08:58.780689 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2551127b-5cbd-44af-b4d7-1b89214e8c60 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:08:58.812822 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06893a3f-8036-4886-8840-7432fd5ba9ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:08:58.813419 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06893a3f-8036-4886-8840-7432fd5ba9ca None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:08:58.813697 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06893a3f-8036-4886-8840-7432fd5ba9ca None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:08:58.813970 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06893a3f-8036-4886-8840-7432fd5ba9ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:08:58.815363 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06893a3f-8036-4886-8840-7432fd5ba9ca None admin] RBAC: Adding query filter params (role.id=5c52e382f2bc436d95d82f2a2fae8ace, scope.project.id=54ca5e241c5d4737aee16091b1e82226, user.id=30bc771cd4e74d958c91e25362b7a9a8) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:08:58.815680 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06893a3f-8036-4886-8840-7432fd5ba9ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:08:58.817106 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06893a3f-8036-4886-8840-7432fd5ba9ca None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:08:58.822315 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 561/1117] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:08:58 2022] GET /identity/v3/role_assignments?user.id=30bc771cd4e74d958c91e25362b7a9a8&scope.project.id=54ca5e241c5d4737aee16091b1e82226&role.id=5c52e382f2bc436d95d82f2a2fae8ace => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:09:00.798530 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942a890-d64c-45fb-b0f0-ca3a83965603 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:00.799732 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942a890-d64c-45fb-b0f0-ca3a83965603 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:00.799732 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942a890-d64c-45fb-b0f0-ca3a83965603 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:00.801158 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 557/1118] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:09:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:09:00.806463 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c365e77-cfd0-45a4-b6c5-6e28f837f386 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:00.806908 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c365e77-cfd0-45a4-b6c5-6e28f837f386 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:00.807003 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c365e77-cfd0-45a4-b6c5-6e28f837f386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:00.825222 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-8c365e77-cfd0-45a4-b6c5-6e28f837f386 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:09:00.826404 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-8c365e77-cfd0-45a4-b6c5-6e28f837f386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:09:00.891831 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 562/1119] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:09:00 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:09:00.914640 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1942a890-d64c-45fb-b0f0-ca3a83965603 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:01.013063 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1942a890-d64c-45fb-b0f0-ca3a83965603 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:01.045984 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b090a28-c227-44bd-bfa8-a73e87469389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:01.046612 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b090a28-c227-44bd-bfa8-a73e87469389 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:01.046888 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b090a28-c227-44bd-bfa8-a73e87469389 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:01.047182 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b090a28-c227-44bd-bfa8-a73e87469389 None admin] PATH_INFO: `/v3/roles/5c52e382f2bc436d95d82f2a2fae8ace` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:01.048669 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b090a28-c227-44bd-bfa8-a73e87469389 None admin] RBAC: Authorizing `identity:get_role(role_id=5c52e382f2bc436d95d82f2a2fae8ace)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:01.050500 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b090a28-c227-44bd-bfa8-a73e87469389 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:01.051814 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 558/1120] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:09:00 2022] GET /identity/v3/roles/5c52e382f2bc436d95d82f2a2fae8ace => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:09:01.057681 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c365e77-cfd0-45a4-b6c5-6e28f837f386 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:01.080565 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:01.155006 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c365e77-cfd0-45a4-b6c5-6e28f837f386 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:01.188018 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e0574b-5090-4c8a-8691-f5117f4c9c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:01.188673 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0574b-5090-4c8a-8691-f5117f4c9c7d None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:01.188954 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0574b-5090-4c8a-8691-f5117f4c9c7d None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:01.189232 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e0574b-5090-4c8a-8691-f5117f4c9c7d None admin] PATH_INFO: `/v3/users/30bc771cd4e74d958c91e25362b7a9a8` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:01.190413 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e0574b-5090-4c8a-8691-f5117f4c9c7d None admin] RBAC: Authorizing `identity:get_user(user_id=30bc771cd4e74d958c91e25362b7a9a8)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:01.191827 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2e0574b-5090-4c8a-8691-f5117f4c9c7d None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:01.193436 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 563/1121] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:09:01 2022] GET /identity/v3/users/30bc771cd4e74d958c91e25362b7a9a8 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:09:01.199258 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b090a28-c227-44bd-bfa8-a73e87469389 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:01.224502 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:01.295714 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b090a28-c227-44bd-bfa8-a73e87469389 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:01.327762 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c74cc277-6949-42d4-a0d9-e70ff2b061bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:01.328335 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74cc277-6949-42d4-a0d9-e70ff2b061bb None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:01.328622 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74cc277-6949-42d4-a0d9-e70ff2b061bb None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:01.328890 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c74cc277-6949-42d4-a0d9-e70ff2b061bb None admin] PATH_INFO: `/v3/projects/54ca5e241c5d4737aee16091b1e82226` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:01.330549 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74cc277-6949-42d4-a0d9-e70ff2b061bb None admin] RBAC: Authorizing `identity:get_project(project_id=54ca5e241c5d4737aee16091b1e82226)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:01.331952 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c74cc277-6949-42d4-a0d9-e70ff2b061bb None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:01.333628 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 559/1122] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:09:01 2022] GET /identity/v3/projects/54ca5e241c5d4737aee16091b1e82226 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:09:01.341625 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e0574b-5090-4c8a-8691-f5117f4c9c7d None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:01.430693 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:01.440835 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e0574b-5090-4c8a-8691-f5117f4c9c7d None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:01.474591 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80481eea-0ef4-4b82-9b78-e03a74f20727 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:01.475240 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80481eea-0ef4-4b82-9b78-e03a74f20727 None admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:01.475522 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80481eea-0ef4-4b82-9b78-e03a74f20727 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:01.475796 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80481eea-0ef4-4b82-9b78-e03a74f20727 None admin] PATH_INFO: `/v3/projects/54ca5e241c5d4737aee16091b1e82226/users/30bc771cd4e74d958c91e25362b7a9a8/roles/5c52e382f2bc436d95d82f2a2fae8ace` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:01.477954 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80481eea-0ef4-4b82-9b78-e03a74f20727 None admin] RBAC: Authorizing `identity:create_grant(project_id=54ca5e241c5d4737aee16091b1e82226, user_id=30bc771cd4e74d958c91e25362b7a9a8, role_id=5c52e382f2bc436d95d82f2a2fae8ace)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:01.479380 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80481eea-0ef4-4b82-9b78-e03a74f20727 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:01.493228 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 564/1123] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Aug 5 02:09:01 2022] PUT /identity/v3/projects/54ca5e241c5d4737aee16091b1e82226/users/30bc771cd4e74d958c91e25362b7a9a8/roles/5c52e382f2bc436d95d82f2a2fae8ace => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:09:03.467011 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c90f02-e2e2-436b-b35a-e2ccd261eb59 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:03.467551 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c90f02-e2e2-436b-b35a-e2ccd261eb59 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:03.467551 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c90f02-e2e2-436b-b35a-e2ccd261eb59 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:03.469183 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 560/1124] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:09:03.474947 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f2796-8a68-4757-9a44-c9cdbea2bab1 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:03.475382 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f2796-8a68-4757-9a44-c9cdbea2bab1 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:03.475484 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9f2796-8a68-4757-9a44-c9cdbea2bab1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:03.493634 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-2d9f2796-8a68-4757-9a44-c9cdbea2bab1 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:09:03.494806 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-2d9f2796-8a68-4757-9a44-c9cdbea2bab1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:09:03.558393 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 565/1125] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:09:03 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:09:03.582286 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c90f02-e2e2-436b-b35a-e2ccd261eb59 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:03.671349 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:03.681393 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c90f02-e2e2-436b-b35a-e2ccd261eb59 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:03.713980 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28e0ab-6e9c-47b3-b065-c88465cad9e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:03.714602 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28e0ab-6e9c-47b3-b065-c88465cad9e7 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:03.714883 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28e0ab-6e9c-47b3-b065-c88465cad9e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:03.715158 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e28e0ab-6e9c-47b3-b065-c88465cad9e7 None admin] PATH_INFO: `/v3/roles/5c52e382f2bc436d95d82f2a2fae8ace` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:03.716604 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e28e0ab-6e9c-47b3-b065-c88465cad9e7 None admin] RBAC: Authorizing `identity:get_role(role_id=5c52e382f2bc436d95d82f2a2fae8ace)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:03.717990 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e28e0ab-6e9c-47b3-b065-c88465cad9e7 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:03.719515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 561/1126] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:09:03 2022] GET /identity/v3/roles/5c52e382f2bc436d95d82f2a2fae8ace => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:09:03.725525 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f2796-8a68-4757-9a44-c9cdbea2bab1 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:03.802682 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:03.822386 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d9f2796-8a68-4757-9a44-c9cdbea2bab1 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:03.855468 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fabdef-733d-49c3-8e64-7acf6446d3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:03.856095 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fabdef-733d-49c3-8e64-7acf6446d3e5 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:03.856400 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fabdef-733d-49c3-8e64-7acf6446d3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:03.856675 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fabdef-733d-49c3-8e64-7acf6446d3e5 None admin] PATH_INFO: `/v3/users/30bc771cd4e74d958c91e25362b7a9a8` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:03.857808 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fabdef-733d-49c3-8e64-7acf6446d3e5 None admin] RBAC: Authorizing `identity:get_user(user_id=30bc771cd4e74d958c91e25362b7a9a8)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:03.859222 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fabdef-733d-49c3-8e64-7acf6446d3e5 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:03.860841 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 566/1127] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:09:03 2022] GET /identity/v3/users/30bc771cd4e74d958c91e25362b7a9a8 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:09:03.867284 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28e0ab-6e9c-47b3-b065-c88465cad9e7 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:03.964319 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e28e0ab-6e9c-47b3-b065-c88465cad9e7 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:03.997690 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81baa65f-7587-4299-8c45-07a60fb99cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:03.998228 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81baa65f-7587-4299-8c45-07a60fb99cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:03.998512 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81baa65f-7587-4299-8c45-07a60fb99cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:03.998787 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81baa65f-7587-4299-8c45-07a60fb99cc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:04.025470 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:04.064647 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81baa65f-7587-4299-8c45-07a60fb99cc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:04.066056 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81baa65f-7587-4299-8c45-07a60fb99cc8 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:04.160753 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 562/1128] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:09:03 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 02:09:04.166753 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fabdef-733d-49c3-8e64-7acf6446d3e5 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:04.265793 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fabdef-733d-49c3-8e64-7acf6446d3e5 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:04.299671 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed628c8-ce5f-4ab3-9c58-593635780d79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:04.300291 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed628c8-ce5f-4ab3-9c58-593635780d79 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:04.300602 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed628c8-ce5f-4ab3-9c58-593635780d79 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:04.300879 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed628c8-ce5f-4ab3-9c58-593635780d79 None admin] PATH_INFO: `/v3/projects/54ca5e241c5d4737aee16091b1e82226` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:04.302017 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed628c8-ce5f-4ab3-9c58-593635780d79 None admin] RBAC: Authorizing `identity:get_project(project_id=54ca5e241c5d4737aee16091b1e82226)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:04.303435 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed628c8-ce5f-4ab3-9c58-593635780d79 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:04.305085 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 567/1129] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:09:04 2022] GET /identity/v3/projects/54ca5e241c5d4737aee16091b1e82226 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:09:04.311024 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81baa65f-7587-4299-8c45-07a60fb99cc8 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:04.367925 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:04.406557 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81baa65f-7587-4299-8c45-07a60fb99cc8 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:04.438451 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e304f3f4-9411-4dbc-b1d8-a311a5f17254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:04.439043 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304f3f4-9411-4dbc-b1d8-a311a5f17254 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:04.439931 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304f3f4-9411-4dbc-b1d8-a311a5f17254 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:04.440358 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e304f3f4-9411-4dbc-b1d8-a311a5f17254 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:04.441137 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304f3f4-9411-4dbc-b1d8-a311a5f17254 None admin] RBAC: Adding query filter params (role.id=5c52e382f2bc436d95d82f2a2fae8ace, scope.project.id=54ca5e241c5d4737aee16091b1e82226, user.id=30bc771cd4e74d958c91e25362b7a9a8) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:09:04.441441 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304f3f4-9411-4dbc-b1d8-a311a5f17254 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:04.442845 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e304f3f4-9411-4dbc-b1d8-a311a5f17254 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:04.448371 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 563/1130] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:09:04 2022] GET /identity/v3/role_assignments?user.id=30bc771cd4e74d958c91e25362b7a9a8&scope.project.id=54ca5e241c5d4737aee16091b1e82226&role.id=5c52e382f2bc436d95d82f2a2fae8ace => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:09:06.531355 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426e8ad-5162-4db2-9fec-1954651fa630 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:06.531935 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426e8ad-5162-4db2-9fec-1954651fa630 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:06.531935 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4426e8ad-5162-4db2-9fec-1954651fa630 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:06.534005 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 568/1131] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:09:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:09:06.538991 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f173f5-8b61-40f8-b916-fe5a9f421fa4 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:06.544862 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f173f5-8b61-40f8-b916-fe5a9f421fa4 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:06.544862 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78f173f5-8b61-40f8-b916-fe5a9f421fa4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:06.558664 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-78f173f5-8b61-40f8-b916-fe5a9f421fa4 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:09:06.559853 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-78f173f5-8b61-40f8-b916-fe5a9f421fa4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:09:06.625580 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 564/1132] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:09:06 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:09:06.649699 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426e8ad-5162-4db2-9fec-1954651fa630 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:06.668463 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:06.750810 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4426e8ad-5162-4db2-9fec-1954651fa630 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:06.790796 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99192f6-320d-4db7-9773-f66c7b25f1c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:06.791352 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99192f6-320d-4db7-9773-f66c7b25f1c5 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:06.791726 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99192f6-320d-4db7-9773-f66c7b25f1c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:06.792003 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99192f6-320d-4db7-9773-f66c7b25f1c5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:06.793161 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99192f6-320d-4db7-9773-f66c7b25f1c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:06.794581 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b99192f6-320d-4db7-9773-f66c7b25f1c5 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:06.796153 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 569/1133] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:09:06 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:09:06.802621 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f173f5-8b61-40f8-b916-fe5a9f421fa4 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:06.858862 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:06.904389 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78f173f5-8b61-40f8-b916-fe5a9f421fa4 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:06.937774 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cca8ca3a-8184-4aa9-9729-d5d974174a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:06.938384 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca8ca3a-8184-4aa9-9729-d5d974174a90 None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:06.938664 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca8ca3a-8184-4aa9-9729-d5d974174a90 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:06.939481 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cca8ca3a-8184-4aa9-9729-d5d974174a90 None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:06.940613 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca8ca3a-8184-4aa9-9729-d5d974174a90 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:06.942024 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cca8ca3a-8184-4aa9-9729-d5d974174a90 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:06.969461 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 565/1134] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Aug 5 02:09:06 2022] POST /identity/v3/projects => generated 311 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:09:09.036029 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df9356-730b-4c3d-9544-d1010ed08c24 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:09.036615 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df9356-730b-4c3d-9544-d1010ed08c24 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:09.036758 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8df9356-730b-4c3d-9544-d1010ed08c24 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:09.038103 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 570/1135] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:09:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:09:09.043471 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669c278-6ba1-4a82-865d-d160ff674b9b None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:09.043889 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669c278-6ba1-4a82-865d-d160ff674b9b None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:09.044000 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f669c278-6ba1-4a82-865d-d160ff674b9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:09.061914 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-f669c278-6ba1-4a82-865d-d160ff674b9b None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:09:09.063077 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-f669c278-6ba1-4a82-865d-d160ff674b9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:09:09.127080 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 566/1136] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:09:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:09:09.151394 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df9356-730b-4c3d-9544-d1010ed08c24 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:09.236333 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:09.253652 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8df9356-730b-4c3d-9544-d1010ed08c24 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:09.287041 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a8436a-a15a-408c-b1d8-5ad0a299e688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:09.287666 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8436a-a15a-408c-b1d8-5ad0a299e688 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:09.287949 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8436a-a15a-408c-b1d8-5ad0a299e688 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:09.288226 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a8436a-a15a-408c-b1d8-5ad0a299e688 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:09.289392 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8436a-a15a-408c-b1d8-5ad0a299e688 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:09.290811 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a8436a-a15a-408c-b1d8-5ad0a299e688 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:09.292404 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 571/1137] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:09:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:09:09.298194 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f669c278-6ba1-4a82-865d-d160ff674b9b None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:09.331890 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:09.394285 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f669c278-6ba1-4a82-865d-d160ff674b9b None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:09.427112 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19541f75-edb5-41e3-8cfa-04fc43abcf34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:09.427716 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19541f75-edb5-41e3-8cfa-04fc43abcf34 None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:09.427991 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19541f75-edb5-41e3-8cfa-04fc43abcf34 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:09.428259 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19541f75-edb5-41e3-8cfa-04fc43abcf34 None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:09.428968 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19541f75-edb5-41e3-8cfa-04fc43abcf34 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:09.430363 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19541f75-edb5-41e3-8cfa-04fc43abcf34 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:09.450107 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 567/1138] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Aug 5 02:09:09 2022] POST /identity/v3/users => generated 286 bytes in 152 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:09:11.486568 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290d7cf-a6d0-4ce0-84c5-ddd3bf155c35 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:11.487133 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290d7cf-a6d0-4ce0-84c5-ddd3bf155c35 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:11.487133 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290d7cf-a6d0-4ce0-84c5-ddd3bf155c35 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:11.488466 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 572/1139] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:09:11.494227 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ceba8-ea4d-4f6f-a6a5-e3123d01bcae None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:11.494667 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ceba8-ea4d-4f6f-a6a5-e3123d01bcae None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:11.494762 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5ceba8-ea4d-4f6f-a6a5-e3123d01bcae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:11.512449 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-5a5ceba8-ea4d-4f6f-a6a5-e3123d01bcae None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:09:11.513615 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-5a5ceba8-ea4d-4f6f-a6a5-e3123d01bcae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:09:11.577474 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 568/1140] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:09:11 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:09:11.600958 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290d7cf-a6d0-4ce0-84c5-ddd3bf155c35 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:11.699237 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290d7cf-a6d0-4ce0-84c5-ddd3bf155c35 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:11.731983 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28515b3-457f-4cb5-a501-8ea827b6b0cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:11.732630 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28515b3-457f-4cb5-a501-8ea827b6b0cb None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:11.732911 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28515b3-457f-4cb5-a501-8ea827b6b0cb None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:11.733186 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28515b3-457f-4cb5-a501-8ea827b6b0cb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:11.744030 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28515b3-457f-4cb5-a501-8ea827b6b0cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:09:11.748881 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-a28515b3-457f-4cb5-a501-8ea827b6b0cb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:09:11.748881 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:09:11.748881 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:09:11.748881 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:09:11.748881 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:09:11.748881 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:09:11.748881 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:09:11.748881 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:09:11.748881 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:09:11.748881 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:09:11.748881 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:09:11.748881 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:09:11.748881 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:09:11.748881 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:09:11.748881 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:09:11.748881 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:09:11.750065 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:09:11.750065 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:09:11.750065 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:09:11.750065 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:09:11.750065 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:09:11.750065 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:09:11.750065 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:09:11.750065 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:09:11.750065 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:09:11.750065 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:09:11.750065 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:09:11.750065 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:09:11.750065 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:09:11.750065 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:09:11.750065 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:09:11.750065 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:09:11.751239 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:09:11.751239 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:09:11.751239 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:09:11.751239 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:09:11.751239 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:09:11.751239 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:09:11.751239 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:09:11.751239 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:09:11.751239 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:09:11.751239 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:09:11.751239 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:09:11.751239 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:09:11.751239 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 573/1141] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Aug 5 02:09:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:09:11.755906 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ceba8-ea4d-4f6f-a6a5-e3123d01bcae None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:11.778857 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:11.857405 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5ceba8-ea4d-4f6f-a6a5-e3123d01bcae None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:11.890370 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb75ef3-64e1-4c72-913c-6ce45da1585d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:11.890983 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb75ef3-64e1-4c72-913c-6ce45da1585d None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:11.891266 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb75ef3-64e1-4c72-913c-6ce45da1585d None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:11.891541 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb75ef3-64e1-4c72-913c-6ce45da1585d None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:11.892855 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb75ef3-64e1-4c72-913c-6ce45da1585d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:09:11.893195 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb75ef3-64e1-4c72-913c-6ce45da1585d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:11.894555 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbb75ef3-64e1-4c72-913c-6ce45da1585d None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:11.902392 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 569/1142] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:09:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:09:11.909026 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28515b3-457f-4cb5-a501-8ea827b6b0cb None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:11.924244 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:12.006850 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28515b3-457f-4cb5-a501-8ea827b6b0cb None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:12.040766 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6df5c-61f4-4c8c-8a56-79ce24fa2285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:12.041390 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6df5c-61f4-4c8c-8a56-79ce24fa2285 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:12.041670 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6df5c-61f4-4c8c-8a56-79ce24fa2285 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:12.041944 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a6df5c-61f4-4c8c-8a56-79ce24fa2285 None admin] PATH_INFO: `/v3/users/f14d0eab37e54139a93e39d962262838` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:12.055036 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a6df5c-61f4-4c8c-8a56-79ce24fa2285 None admin] RBAC: Authorizing `identity:get_user(user_id=f14d0eab37e54139a93e39d962262838)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:12.056499 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a6df5c-61f4-4c8c-8a56-79ce24fa2285 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:12.058086 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 574/1143] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:09:11 2022] GET /identity/v3/users/f14d0eab37e54139a93e39d962262838 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:09:12.063818 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb75ef3-64e1-4c72-913c-6ce45da1585d None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:12.146645 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:12.163335 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb75ef3-64e1-4c72-913c-6ce45da1585d None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:12.196285 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cda9f7-7e89-46cb-b191-8f3a3f3fb66c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:12.196926 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cda9f7-7e89-46cb-b191-8f3a3f3fb66c None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:12.197208 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cda9f7-7e89-46cb-b191-8f3a3f3fb66c None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:12.197482 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08cda9f7-7e89-46cb-b191-8f3a3f3fb66c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:12.262767 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cda9f7-7e89-46cb-b191-8f3a3f3fb66c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:12.264116 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08cda9f7-7e89-46cb-b191-8f3a3f3fb66c None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:12.342337 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:12.358401 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 570/1144] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:09:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 02:09:12.364309 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6df5c-61f4-4c8c-8a56-79ce24fa2285 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:12.431167 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:12.461119 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a6df5c-61f4-4c8c-8a56-79ce24fa2285 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:12.493554 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec3d2f8-0c6c-4657-8c3e-f41ea5ff03e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:12.494180 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3d2f8-0c6c-4657-8c3e-f41ea5ff03e2 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:12.494458 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3d2f8-0c6c-4657-8c3e-f41ea5ff03e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:12.494731 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec3d2f8-0c6c-4657-8c3e-f41ea5ff03e2 None admin] PATH_INFO: `/v3/projects/011971eeac0b406a9e67d6286a743aab` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:12.495865 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec3d2f8-0c6c-4657-8c3e-f41ea5ff03e2 None admin] RBAC: Authorizing `identity:get_project(project_id=011971eeac0b406a9e67d6286a743aab)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:12.497309 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec3d2f8-0c6c-4657-8c3e-f41ea5ff03e2 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:12.498936 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 575/1145] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:09:12 2022] GET /identity/v3/projects/011971eeac0b406a9e67d6286a743aab => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:09:12.505553 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cda9f7-7e89-46cb-b191-8f3a3f3fb66c None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:12.606777 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08cda9f7-7e89-46cb-b191-8f3a3f3fb66c None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:12.640131 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a31269-4478-4633-ac1b-72fd65664ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:12.640753 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a31269-4478-4633-ac1b-72fd65664ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:12.641030 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a31269-4478-4633-ac1b-72fd65664ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:12.641299 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a31269-4478-4633-ac1b-72fd65664ce4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:12.642103 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a31269-4478-4633-ac1b-72fd65664ce4 None admin] RBAC: Adding query filter params (role.id=e1b75d5eea2a43b2b1b14cf0515350fa, scope.project.id=011971eeac0b406a9e67d6286a743aab, user.id=f14d0eab37e54139a93e39d962262838) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:09:12.642407 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a31269-4478-4633-ac1b-72fd65664ce4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:12.643911 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a31269-4478-4633-ac1b-72fd65664ce4 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:12.649121 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 571/1146] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:09:12 2022] GET /identity/v3/role_assignments?user.id=f14d0eab37e54139a93e39d962262838&scope.project.id=011971eeac0b406a9e67d6286a743aab&role.id=e1b75d5eea2a43b2b1b14cf0515350fa => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:09:14.614698 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62269aa1-604f-4aa2-92a3-52e750b1a495 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:14.615236 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62269aa1-604f-4aa2-92a3-52e750b1a495 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:14.615236 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62269aa1-604f-4aa2-92a3-52e750b1a495 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:14.616617 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 576/1147] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:09:14.621678 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf4d5e-7f47-4fb8-bfc9-3b1398031799 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:14.622061 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf4d5e-7f47-4fb8-bfc9-3b1398031799 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:14.622241 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbf4d5e-7f47-4fb8-bfc9-3b1398031799 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:14.639913 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-4dbf4d5e-7f47-4fb8-bfc9-3b1398031799 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:09:14.641131 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-4dbf4d5e-7f47-4fb8-bfc9-3b1398031799 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:09:14.684888 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:14.707393 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 572/1148] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:09:14 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:09:14.730062 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62269aa1-604f-4aa2-92a3-52e750b1a495 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:14.829726 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62269aa1-604f-4aa2-92a3-52e750b1a495 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:14.865883 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb0212-a8b2-44ea-a8bf-5c9e72244e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:14.866450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb0212-a8b2-44ea-a8bf-5c9e72244e73 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:14.866731 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb0212-a8b2-44ea-a8bf-5c9e72244e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:14.867006 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb0212-a8b2-44ea-a8bf-5c9e72244e73 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:14.873627 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:14.877892 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb0212-a8b2-44ea-a8bf-5c9e72244e73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:09:14.882991 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-9bcb0212-a8b2-44ea-a8bf-5c9e72244e73 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:09:14.882991 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:09:14.882991 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:09:14.882991 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:09:14.882991 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:09:14.882991 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:09:14.882991 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:09:14.882991 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:09:14.882991 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:09:14.882991 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:09:14.882991 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:09:14.882991 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:09:14.882991 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:09:14.882991 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:09:14.882991 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:09:14.882991 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:09:14.884066 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:09:14.884066 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:09:14.884066 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:09:14.884066 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:09:14.884066 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:09:14.884066 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:09:14.884066 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:09:14.884066 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:09:14.884066 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:09:14.884066 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:09:14.884066 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:09:14.884066 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:09:14.884066 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:09:14.884066 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:09:14.884066 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:09:14.884066 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:09:14.885042 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:09:14.885042 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:09:14.885042 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:09:14.885042 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:09:14.885042 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:09:14.885042 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:09:14.885042 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:09:14.885042 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:09:14.885042 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:09:14.885042 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:09:14.885042 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:09:14.885042 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:09:14.885042 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 577/1149] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Aug 5 02:09:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:09:14.890176 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf4d5e-7f47-4fb8-bfc9-3b1398031799 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:14.988113 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbf4d5e-7f47-4fb8-bfc9-3b1398031799 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:15.021625 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7212ed-2ca9-4b40-96ee-b03e9096a554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:15.022231 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7212ed-2ca9-4b40-96ee-b03e9096a554 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:15.022506 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7212ed-2ca9-4b40-96ee-b03e9096a554 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:15.022774 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7212ed-2ca9-4b40-96ee-b03e9096a554 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:15.023475 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7212ed-2ca9-4b40-96ee-b03e9096a554 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:09:15.023774 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7212ed-2ca9-4b40-96ee-b03e9096a554 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:15.025185 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7212ed-2ca9-4b40-96ee-b03e9096a554 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:15.033731 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 573/1150] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:09:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:09:15.039539 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb0212-a8b2-44ea-a8bf-5c9e72244e73 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:15.138844 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb0212-a8b2-44ea-a8bf-5c9e72244e73 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:15.171975 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ac571-2c9e-4188-8e7d-833bf97e6787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:15.172617 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ac571-2c9e-4188-8e7d-833bf97e6787 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:15.173558 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ac571-2c9e-4188-8e7d-833bf97e6787 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:15.173841 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862ac571-2c9e-4188-8e7d-833bf97e6787 None admin] PATH_INFO: `/v3/users/f14d0eab37e54139a93e39d962262838` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:15.174994 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ac571-2c9e-4188-8e7d-833bf97e6787 None admin] RBAC: Authorizing `identity:get_user(user_id=f14d0eab37e54139a93e39d962262838)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:15.176435 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862ac571-2c9e-4188-8e7d-833bf97e6787 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:15.177991 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 578/1151] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:09:15 2022] GET /identity/v3/users/f14d0eab37e54139a93e39d962262838 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:09:15.183565 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7212ed-2ca9-4b40-96ee-b03e9096a554 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:15.224739 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:15.281275 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7212ed-2ca9-4b40-96ee-b03e9096a554 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:15.313089 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb742ab0-e8c3-4bf9-9622-f9a4b27bc453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:15.314354 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb742ab0-e8c3-4bf9-9622-f9a4b27bc453 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:15.314631 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb742ab0-e8c3-4bf9-9622-f9a4b27bc453 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:15.314904 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb742ab0-e8c3-4bf9-9622-f9a4b27bc453 None admin] PATH_INFO: `/v3/projects/011971eeac0b406a9e67d6286a743aab` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:15.316039 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb742ab0-e8c3-4bf9-9622-f9a4b27bc453 None admin] RBAC: Authorizing `identity:get_project(project_id=011971eeac0b406a9e67d6286a743aab)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:15.317476 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb742ab0-e8c3-4bf9-9622-f9a4b27bc453 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:15.319119 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 574/1152] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:09:15 2022] GET /identity/v3/projects/011971eeac0b406a9e67d6286a743aab => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:09:15.324946 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ac571-2c9e-4188-8e7d-833bf97e6787 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:15.388492 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:15.422108 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862ac571-2c9e-4188-8e7d-833bf97e6787 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:15.454495 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33d265f9-99ba-41b7-bbc0-806f5c10401f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:15.455149 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d265f9-99ba-41b7-bbc0-806f5c10401f None admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:15.455427 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d265f9-99ba-41b7-bbc0-806f5c10401f None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:15.455701 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33d265f9-99ba-41b7-bbc0-806f5c10401f None admin] PATH_INFO: `/v3/projects/011971eeac0b406a9e67d6286a743aab/users/f14d0eab37e54139a93e39d962262838/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:15.457614 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d265f9-99ba-41b7-bbc0-806f5c10401f None admin] RBAC: Authorizing `identity:create_grant(project_id=011971eeac0b406a9e67d6286a743aab, user_id=f14d0eab37e54139a93e39d962262838, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:15.459029 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33d265f9-99ba-41b7-bbc0-806f5c10401f None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:15.471889 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 579/1153] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Aug 5 02:09:15 2022] PUT /identity/v3/projects/011971eeac0b406a9e67d6286a743aab/users/f14d0eab37e54139a93e39d962262838/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:09:17.439634 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f05d7-025b-4013-811c-85c1ca685b44 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:17.440171 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f05d7-025b-4013-811c-85c1ca685b44 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:17.440171 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e8f05d7-025b-4013-811c-85c1ca685b44 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:17.441553 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 575/1154] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:09:17.446637 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af056bef-c932-4555-9d8d-7ed3b49454a4 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:17.447064 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af056bef-c932-4555-9d8d-7ed3b49454a4 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:17.447179 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af056bef-c932-4555-9d8d-7ed3b49454a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:17.465161 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-af056bef-c932-4555-9d8d-7ed3b49454a4 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:09:17.466344 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-af056bef-c932-4555-9d8d-7ed3b49454a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:09:17.533973 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 580/1155] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:09:17 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:09:17.557268 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f05d7-025b-4013-811c-85c1ca685b44 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:17.655260 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e8f05d7-025b-4013-811c-85c1ca685b44 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:17.664693 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:17.689121 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ab764-ce4f-490d-815b-690a0f5d1f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:17.689785 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ab764-ce4f-490d-815b-690a0f5d1f0d None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:17.690008 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ab764-ce4f-490d-815b-690a0f5d1f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:17.690273 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813ab764-ce4f-490d-815b-690a0f5d1f0d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:17.699924 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813ab764-ce4f-490d-815b-690a0f5d1f0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:09:17.705396 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-813ab764-ce4f-490d-815b-690a0f5d1f0d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:09:17.705396 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:09:17.705396 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:09:17.705396 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:09:17.705396 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:09:17.705396 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:09:17.705396 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:09:17.705396 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:09:17.705396 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:09:17.705396 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:09:17.705396 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:09:17.705396 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:09:17.705396 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:09:17.705396 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:09:17.705396 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:09:17.705396 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:09:17.706478 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:09:17.706478 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:09:17.706478 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:09:17.706478 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:09:17.706478 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:09:17.706478 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:09:17.706478 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:09:17.706478 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:09:17.706478 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:09:17.706478 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:09:17.706478 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:09:17.706478 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:09:17.706478 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:09:17.706478 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:09:17.706478 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:09:17.706478 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:09:17.707603 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:09:17.707603 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:09:17.707603 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:09:17.707603 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:09:17.707603 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:09:17.707603 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:09:17.707603 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:09:17.707603 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:09:17.707603 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:09:17.707603 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:09:17.707603 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:09:17.707603 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:09:17.707603 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 576/1156] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Aug 5 02:09:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:09:17.712470 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af056bef-c932-4555-9d8d-7ed3b49454a4 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:17.765896 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:17.808768 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af056bef-c932-4555-9d8d-7ed3b49454a4 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:17.842542 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a9f11-d0d9-4a6e-87b9-aefe65e213d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:17.843405 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a9f11-d0d9-4a6e-87b9-aefe65e213d2 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:17.843677 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a9f11-d0d9-4a6e-87b9-aefe65e213d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:17.843945 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-725a9f11-d0d9-4a6e-87b9-aefe65e213d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:17.844708 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a9f11-d0d9-4a6e-87b9-aefe65e213d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:09:17.845005 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a9f11-d0d9-4a6e-87b9-aefe65e213d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:17.846363 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-725a9f11-d0d9-4a6e-87b9-aefe65e213d2 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:17.854214 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 581/1157] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:09:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:09:17.859926 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ab764-ce4f-490d-815b-690a0f5d1f0d None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:17.957486 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813ab764-ce4f-490d-815b-690a0f5d1f0d None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:17.990728 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9210f-4bf7-4789-9695-82b189e03047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:17.991353 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9210f-4bf7-4789-9695-82b189e03047 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:17.991636 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9210f-4bf7-4789-9695-82b189e03047 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:17.991913 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc9210f-4bf7-4789-9695-82b189e03047 None admin] PATH_INFO: `/v3/users/f14d0eab37e54139a93e39d962262838` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:17.993096 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc9210f-4bf7-4789-9695-82b189e03047 None admin] RBAC: Authorizing `identity:get_user(user_id=f14d0eab37e54139a93e39d962262838)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:17.994519 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc9210f-4bf7-4789-9695-82b189e03047 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:17.996111 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 577/1158] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:09:17 2022] GET /identity/v3/users/f14d0eab37e54139a93e39d962262838 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:09:18.002445 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a9f11-d0d9-4a6e-87b9-aefe65e213d2 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:18.099689 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-725a9f11-d0d9-4a6e-87b9-aefe65e213d2 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:18.116089 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:18.133197 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ca802-1363-4a9c-8bc6-5e4856025ac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:18.133802 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ca802-1363-4a9c-8bc6-5e4856025ac0 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:18.134086 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ca802-1363-4a9c-8bc6-5e4856025ac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:18.134365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59ca802-1363-4a9c-8bc6-5e4856025ac0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:18.200156 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59ca802-1363-4a9c-8bc6-5e4856025ac0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:18.201622 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59ca802-1363-4a9c-8bc6-5e4856025ac0 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:18.296618 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 582/1159] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:09:18 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 02:09:18.302593 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9210f-4bf7-4789-9695-82b189e03047 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:18.336795 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:18.399000 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc9210f-4bf7-4789-9695-82b189e03047 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:18.432308 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d6d019-da30-4f01-9bf4-eb619c38218a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:18.432961 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6d019-da30-4f01-9bf4-eb619c38218a None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:18.433241 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6d019-da30-4f01-9bf4-eb619c38218a None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:18.433512 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d6d019-da30-4f01-9bf4-eb619c38218a None admin] PATH_INFO: `/v3/projects/011971eeac0b406a9e67d6286a743aab` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:18.434641 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6d019-da30-4f01-9bf4-eb619c38218a None admin] RBAC: Authorizing `identity:get_project(project_id=011971eeac0b406a9e67d6286a743aab)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:18.436038 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d6d019-da30-4f01-9bf4-eb619c38218a None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:18.437702 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 578/1160] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:09:18 2022] GET /identity/v3/projects/011971eeac0b406a9e67d6286a743aab => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:09:18.443773 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ca802-1363-4a9c-8bc6-5e4856025ac0 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:18.461719 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:18.541590 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59ca802-1363-4a9c-8bc6-5e4856025ac0 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:18.574887 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed939db-c308-452a-8415-8b4424ff53d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:18.575425 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed939db-c308-452a-8415-8b4424ff53d1 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:18.575707 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed939db-c308-452a-8415-8b4424ff53d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:18.575985 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed939db-c308-452a-8415-8b4424ff53d1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:18.576790 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed939db-c308-452a-8415-8b4424ff53d1 None admin] RBAC: Adding query filter params (role.id=e1b75d5eea2a43b2b1b14cf0515350fa, scope.project.id=011971eeac0b406a9e67d6286a743aab, user.id=f14d0eab37e54139a93e39d962262838) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:09:18.577102 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed939db-c308-452a-8415-8b4424ff53d1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:18.578533 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed939db-c308-452a-8415-8b4424ff53d1 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:18.584709 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 583/1161] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:09:18 2022] GET /identity/v3/role_assignments?user.id=f14d0eab37e54139a93e39d962262838&scope.project.id=011971eeac0b406a9e67d6286a743aab&role.id=e1b75d5eea2a43b2b1b14cf0515350fa => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:09:20.562249 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa69ba-89f4-40c6-b61d-a466d3494c1a None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:20.562785 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa69ba-89f4-40c6-b61d-a466d3494c1a None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:20.562785 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6fa69ba-89f4-40c6-b61d-a466d3494c1a None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:20.564775 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 579/1162] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:09:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:09:20.569771 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9eec98-a3c6-4c63-905a-253c818d559a None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:20.570156 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9eec98-a3c6-4c63-905a-253c818d559a None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:20.570320 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9eec98-a3c6-4c63-905a-253c818d559a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:20.588465 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-cc9eec98-a3c6-4c63-905a-253c818d559a None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:09:20.589644 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-cc9eec98-a3c6-4c63-905a-253c818d559a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:09:20.657894 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 584/1163] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:09:20 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:09:20.679172 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa69ba-89f4-40c6-b61d-a466d3494c1a None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:20.777146 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6fa69ba-89f4-40c6-b61d-a466d3494c1a None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:20.779372 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:20.811238 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d21e68-4721-49f2-9064-911e428ac3f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:20.811848 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d21e68-4721-49f2-9064-911e428ac3f5 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:20.812122 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d21e68-4721-49f2-9064-911e428ac3f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:20.812473 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d21e68-4721-49f2-9064-911e428ac3f5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:20.880746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d21e68-4721-49f2-9064-911e428ac3f5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:20.882184 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d21e68-4721-49f2-9064-911e428ac3f5 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:20.978783 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 580/1164] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:09:20 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 02:09:20.984682 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9eec98-a3c6-4c63-905a-253c818d559a None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:20.998457 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:21.082073 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9eec98-a3c6-4c63-905a-253c818d559a None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:21.115159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52b74640-8c25-4cdd-89bc-ee9505e92869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:21.115789 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b74640-8c25-4cdd-89bc-ee9505e92869 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:21.116071 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b74640-8c25-4cdd-89bc-ee9505e92869 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:21.116365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b74640-8c25-4cdd-89bc-ee9505e92869 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:21.123297 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b74640-8c25-4cdd-89bc-ee9505e92869 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:21.124825 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52b74640-8c25-4cdd-89bc-ee9505e92869 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:21.138906 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-52b74640-8c25-4cdd-89bc-ee9505e92869 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 05 02:09:21.138906 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:09:21.138906 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 05 02:09:21.138906 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 05 02:09:21.138906 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:09:21.138906 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:09:21.138906 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:09:21.138906 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:09:21.138906 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 05 02:09:21.138906 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:09:21.138906 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:09:21.138906 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:09:21.138906 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:09:21.138906 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:09:21.138906 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:09:21.138906 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:09:21.138906 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:09:21.140146 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:09:21.140146 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:09:21.140146 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:09:21.140146 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:09:21.140146 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:09:21.140146 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:09:21.140146 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:09:21.140146 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:09:21.140146 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:09:21.140146 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:09:21.140146 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:09:21.140146 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:09:21.140146 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:09:21.140146 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:09:21.140146 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:09:21.140146 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:09:21.141866 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:09:21.141866 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:09:21.141866 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:09:21.141866 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:09:21.141866 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:09:21.141866 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:09:21.141866 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:09:21.141866 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:09:21.141866 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:09:21.141866 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:09:21.141866 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 05 02:09:21.141866 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:09:21.141866 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 05 02:09:21.141866 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:09:21.141866 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 585/1165] 10.222.0.15 () {56 vars in 1117 bytes} [Fri Aug 5 02:09:20 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:09:21.146621 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d21e68-4721-49f2-9064-911e428ac3f5 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:21.149730 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:21.242150 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d21e68-4721-49f2-9064-911e428ac3f5 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:21.275100 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f78a84-9184-467f-bf1d-aa628162f0cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:21.275700 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f78a84-9184-467f-bf1d-aa628162f0cf None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:21.275977 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f78a84-9184-467f-bf1d-aa628162f0cf None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:21.276245 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f78a84-9184-467f-bf1d-aa628162f0cf None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:21.276950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f78a84-9184-467f-bf1d-aa628162f0cf None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:09:21.277247 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f78a84-9184-467f-bf1d-aa628162f0cf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:21.278580 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f78a84-9184-467f-bf1d-aa628162f0cf None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:21.285476 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 581/1166] 10.222.0.15 () {56 vars in 1115 bytes} [Fri Aug 5 02:09:21 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:09:23.257963 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d88b6-0ec4-46f6-86e8-380c9f1106ca None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:23.258495 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d88b6-0ec4-46f6-86e8-380c9f1106ca None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:23.258495 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01d88b6-0ec4-46f6-86e8-380c9f1106ca None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:23.259840 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 586/1167] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:09:23.265134 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3130b-3f1d-4b14-b7de-157fe464393a None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:23.265521 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3130b-3f1d-4b14-b7de-157fe464393a None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:23.265684 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d3130b-3f1d-4b14-b7de-157fe464393a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:23.283319 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-d6d3130b-3f1d-4b14-b7de-157fe464393a None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:09:23.284537 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-d6d3130b-3f1d-4b14-b7de-157fe464393a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:09:23.348187 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:23.354039 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 582/1168] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:09:23 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:09:23.377660 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d88b6-0ec4-46f6-86e8-380c9f1106ca None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:23.445155 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:23.474357 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01d88b6-0ec4-46f6-86e8-380c9f1106ca None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:23.506588 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c4ece60-2dcf-43f8-a404-583fd1cd7af6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:23.507177 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ece60-2dcf-43f8-a404-583fd1cd7af6 None admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:23.507454 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ece60-2dcf-43f8-a404-583fd1cd7af6 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:23.507725 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c4ece60-2dcf-43f8-a404-583fd1cd7af6 None admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:23.508503 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ece60-2dcf-43f8-a404-583fd1cd7af6 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:23.509800 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c4ece60-2dcf-43f8-a404-583fd1cd7af6 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:23.525439 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 587/1169] 10.222.0.15 () {60 vars in 1138 bytes} [Fri Aug 5 02:09:23 2022] POST /identity/v3/domains => generated 267 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:09:25.545540 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f6880-574c-484c-9b2e-bf3fdc0b5201 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:25.546077 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f6880-574c-484c-9b2e-bf3fdc0b5201 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:25.546077 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888f6880-574c-484c-9b2e-bf3fdc0b5201 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:25.547455 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 583/1170] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:09:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:09:25.552774 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451173b-13b1-41ef-b457-dd66b808eeb0 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:25.553180 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451173b-13b1-41ef-b457-dd66b808eeb0 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:25.553350 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6451173b-13b1-41ef-b457-dd66b808eeb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:25.571510 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-6451173b-13b1-41ef-b457-dd66b808eeb0 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:09:25.572735 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-6451173b-13b1-41ef-b457-dd66b808eeb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:09:25.638720 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 588/1171] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:09:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:09:25.663315 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f6880-574c-484c-9b2e-bf3fdc0b5201 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:25.762708 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888f6880-574c-484c-9b2e-bf3fdc0b5201 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:25.795069 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d8af52-4792-44ff-9130-489cd3a4b0e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:25.795744 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8af52-4792-44ff-9130-489cd3a4b0e9 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:25.795973 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8af52-4792-44ff-9130-489cd3a4b0e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:25.796248 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d8af52-4792-44ff-9130-489cd3a4b0e9 None admin] PATH_INFO: `/v3/domains/3f679c0c6725436b9c7e55e59a5f3166` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:25.806826 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d8af52-4792-44ff-9130-489cd3a4b0e9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=3f679c0c6725436b9c7e55e59a5f3166)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:25.808279 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d8af52-4792-44ff-9130-489cd3a4b0e9 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:25.809999 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 584/1172] 10.222.0.15 () {56 vars in 1183 bytes} [Fri Aug 5 02:09:25 2022] GET /identity/v3/domains/3f679c0c6725436b9c7e55e59a5f3166 => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:09:25.817389 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451173b-13b1-41ef-b457-dd66b808eeb0 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:25.878838 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:25.917233 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6451173b-13b1-41ef-b457-dd66b808eeb0 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:25.949465 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799ab8a8-d6dc-473a-9c98-6e17319ba76a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:25.950068 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ab8a8-d6dc-473a-9c98-6e17319ba76a None admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:25.950346 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ab8a8-d6dc-473a-9c98-6e17319ba76a None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:25.950619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799ab8a8-d6dc-473a-9c98-6e17319ba76a None admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:25.951295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ab8a8-d6dc-473a-9c98-6e17319ba76a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:25.952752 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799ab8a8-d6dc-473a-9c98-6e17319ba76a None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:25.977976 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 589/1173] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Aug 5 02:09:25 2022] POST /identity/v3/projects => generated 361 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:09:27.983410 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ce51d-2507-441a-ae8c-9690c22c6729 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:27.983963 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ce51d-2507-441a-ae8c-9690c22c6729 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:27.983963 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200ce51d-2507-441a-ae8c-9690c22c6729 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:27.985406 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 585/1174] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:09:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:09:27.990525 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd9f0d-2d3c-466a-86e3-2f3f9b78e845 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:27.990935 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd9f0d-2d3c-466a-86e3-2f3f9b78e845 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:27.991082 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd9f0d-2d3c-466a-86e3-2f3f9b78e845 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:28.009497 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-66cd9f0d-2d3c-466a-86e3-2f3f9b78e845 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:09:28.010699 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-66cd9f0d-2d3c-466a-86e3-2f3f9b78e845 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:09:28.078791 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 590/1175] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:09:27 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 02:09:28.103108 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ce51d-2507-441a-ae8c-9690c22c6729 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:28.161316 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:28.204347 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200ce51d-2507-441a-ae8c-9690c22c6729 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:28.236523 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351daa1e-58ad-4600-baf4-ba08c97e65d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:28.237141 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351daa1e-58ad-4600-baf4-ba08c97e65d8 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:28.237420 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351daa1e-58ad-4600-baf4-ba08c97e65d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:28.237692 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351daa1e-58ad-4600-baf4-ba08c97e65d8 None admin] PATH_INFO: `/v3/domains/3f679c0c6725436b9c7e55e59a5f3166` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:28.238821 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351daa1e-58ad-4600-baf4-ba08c97e65d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=3f679c0c6725436b9c7e55e59a5f3166)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:28.240225 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351daa1e-58ad-4600-baf4-ba08c97e65d8 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:28.241815 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 586/1176] 10.222.0.15 () {56 vars in 1183 bytes} [Fri Aug 5 02:09:28 2022] GET /identity/v3/domains/3f679c0c6725436b9c7e55e59a5f3166 => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:09:28.247540 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd9f0d-2d3c-466a-86e3-2f3f9b78e845 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:28.291952 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:28.346246 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd9f0d-2d3c-466a-86e3-2f3f9b78e845 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:28.380070 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d5af6a-b600-4e4a-8c95-ecc67fbf3be0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:28.380648 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5af6a-b600-4e4a-8c95-ecc67fbf3be0 None admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:28.380931 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5af6a-b600-4e4a-8c95-ecc67fbf3be0 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:28.381208 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d5af6a-b600-4e4a-8c95-ecc67fbf3be0 None admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:28.381879 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5af6a-b600-4e4a-8c95-ecc67fbf3be0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:28.383303 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d5af6a-b600-4e4a-8c95-ecc67fbf3be0 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:28.403675 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 591/1177] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Aug 5 02:09:28 2022] POST /identity/v3/users => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:09:30.427967 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa303c67-ac17-4afe-9d47-75878b98f8bc None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:30.428653 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa303c67-ac17-4afe-9d47-75878b98f8bc None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:30.428653 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa303c67-ac17-4afe-9d47-75878b98f8bc None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:30.429884 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 587/1178] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:09:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:09:30.435059 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d030a-5e01-4f69-9c93-50db4f5e0580 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:30.435468 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d030a-5e01-4f69-9c93-50db4f5e0580 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:30.435608 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90d030a-5e01-4f69-9c93-50db4f5e0580 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:30.455186 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-e90d030a-5e01-4f69-9c93-50db4f5e0580 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:09:30.456386 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-e90d030a-5e01-4f69-9c93-50db4f5e0580 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:09:30.521919 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 592/1179] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:09:30 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:09:30.545117 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa303c67-ac17-4afe-9d47-75878b98f8bc None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:30.643707 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa303c67-ac17-4afe-9d47-75878b98f8bc None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:30.668839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:30.677708 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e6733-e63b-4cbd-bf0b-4b2f5b351900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:30.678387 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e6733-e63b-4cbd-bf0b-4b2f5b351900 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:30.678618 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e6733-e63b-4cbd-bf0b-4b2f5b351900 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:30.678889 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0e6733-e63b-4cbd-bf0b-4b2f5b351900 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:30.689339 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb0e6733-e63b-4cbd-bf0b-4b2f5b351900 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:09:30.694217 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-eb0e6733-e63b-4cbd-bf0b-4b2f5b351900 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:09:30.694217 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:09:30.694217 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:09:30.694217 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:09:30.694217 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:09:30.694217 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:09:30.694217 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:09:30.694217 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:09:30.694217 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:09:30.694217 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:09:30.694217 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:09:30.694217 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:09:30.694217 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:09:30.694217 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:09:30.694217 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:09:30.694217 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:09:30.695377 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:09:30.695377 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:09:30.695377 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:09:30.695377 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:09:30.695377 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:09:30.695377 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:09:30.695377 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:09:30.695377 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:09:30.695377 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:09:30.695377 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:09:30.695377 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:09:30.695377 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:09:30.695377 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:09:30.695377 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:09:30.695377 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:09:30.695377 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:09:30.696651 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:09:30.696651 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:09:30.696651 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:09:30.696651 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:09:30.696651 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:09:30.696651 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:09:30.696651 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:09:30.696651 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:09:30.696651 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:09:30.696651 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:09:30.696651 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:09:30.696651 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:09:30.696651 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 588/1180] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Aug 5 02:09:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:09:30.701347 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d030a-5e01-4f69-9c93-50db4f5e0580 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:30.730922 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:30.799849 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e90d030a-5e01-4f69-9c93-50db4f5e0580 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:30.832746 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b2d8b-f1ca-400d-8130-f60b25c9dc7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:30.832862 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b2d8b-f1ca-400d-8130-f60b25c9dc7e None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:30.833075 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b2d8b-f1ca-400d-8130-f60b25c9dc7e None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:30.833344 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1b2d8b-f1ca-400d-8130-f60b25c9dc7e None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:30.834046 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b2d8b-f1ca-400d-8130-f60b25c9dc7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:09:30.834342 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b2d8b-f1ca-400d-8130-f60b25c9dc7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:30.835697 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1b2d8b-f1ca-400d-8130-f60b25c9dc7e None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:30.844070 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 593/1181] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:09:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:09:30.849914 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e6733-e63b-4cbd-bf0b-4b2f5b351900 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:30.950529 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0e6733-e63b-4cbd-bf0b-4b2f5b351900 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:30.984708 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b211ce-b397-4655-9bf7-4a2e6e1a9288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:30.985347 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b211ce-b397-4655-9bf7-4a2e6e1a9288 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:30.985627 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b211ce-b397-4655-9bf7-4a2e6e1a9288 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:30.985902 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b211ce-b397-4655-9bf7-4a2e6e1a9288 None admin] PATH_INFO: `/v3/users/aa6b2750e6574232988f54e792fa3be2` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:30.998575 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b211ce-b397-4655-9bf7-4a2e6e1a9288 None admin] RBAC: Authorizing `identity:get_user(user_id=aa6b2750e6574232988f54e792fa3be2)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:31.000019 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b211ce-b397-4655-9bf7-4a2e6e1a9288 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:31.001650 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 589/1182] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:09:30 2022] GET /identity/v3/users/aa6b2750e6574232988f54e792fa3be2 => generated 311 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:09:31.007387 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b2d8b-f1ca-400d-8130-f60b25c9dc7e None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:31.096706 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:31.105519 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1b2d8b-f1ca-400d-8130-f60b25c9dc7e None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:31.138183 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d62f0-e6d4-43a0-a907-c8a2d34ff722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:31.138782 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d62f0-e6d4-43a0-a907-c8a2d34ff722 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:31.139065 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d62f0-e6d4-43a0-a907-c8a2d34ff722 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:31.139341 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325d62f0-e6d4-43a0-a907-c8a2d34ff722 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:31.206386 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325d62f0-e6d4-43a0-a907-c8a2d34ff722 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:31.207759 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325d62f0-e6d4-43a0-a907-c8a2d34ff722 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:31.293960 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:31.303778 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 594/1183] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:09:31 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 02:09:31.309814 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b211ce-b397-4655-9bf7-4a2e6e1a9288 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:31.355401 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:31.407798 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b211ce-b397-4655-9bf7-4a2e6e1a9288 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:31.439575 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e7e58b5-567d-402b-ab20-ec8e0e1d320a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:31.440241 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e58b5-567d-402b-ab20-ec8e0e1d320a None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:31.440496 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e58b5-567d-402b-ab20-ec8e0e1d320a None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:31.440772 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e7e58b5-567d-402b-ab20-ec8e0e1d320a None admin] PATH_INFO: `/v3/projects/01f4e8225876464cb83697bc5e431c22` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:31.441918 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e58b5-567d-402b-ab20-ec8e0e1d320a None admin] RBAC: Authorizing `identity:get_project(project_id=01f4e8225876464cb83697bc5e431c22)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:31.443337 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e7e58b5-567d-402b-ab20-ec8e0e1d320a None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:31.445054 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 590/1184] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:09:31 2022] GET /identity/v3/projects/01f4e8225876464cb83697bc5e431c22 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:09:31.451088 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d62f0-e6d4-43a0-a907-c8a2d34ff722 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:31.548392 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325d62f0-e6d4-43a0-a907-c8a2d34ff722 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:31.581466 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5666a2-0cc1-4033-b048-838a1ace5446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:31.582073 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5666a2-0cc1-4033-b048-838a1ace5446 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:31.582353 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5666a2-0cc1-4033-b048-838a1ace5446 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:31.582629 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5666a2-0cc1-4033-b048-838a1ace5446 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:31.583414 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5666a2-0cc1-4033-b048-838a1ace5446 None admin] RBAC: Adding query filter params (role.id=e1b75d5eea2a43b2b1b14cf0515350fa, scope.project.id=01f4e8225876464cb83697bc5e431c22, user.id=aa6b2750e6574232988f54e792fa3be2) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:09:31.583724 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5666a2-0cc1-4033-b048-838a1ace5446 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:31.585180 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5666a2-0cc1-4033-b048-838a1ace5446 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:31.590574 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 595/1185] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:09:31 2022] GET /identity/v3/role_assignments?user.id=aa6b2750e6574232988f54e792fa3be2&scope.project.id=01f4e8225876464cb83697bc5e431c22&role.id=e1b75d5eea2a43b2b1b14cf0515350fa => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:09:33.555162 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e34423-5953-4fe4-beef-db5782e5ef1a None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:33.555740 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e34423-5953-4fe4-beef-db5782e5ef1a None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:33.555740 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e34423-5953-4fe4-beef-db5782e5ef1a None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:33.557140 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 591/1186] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:09:33.562151 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4269449-2c55-45d1-8e34-96f356390244 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:33.562545 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4269449-2c55-45d1-8e34-96f356390244 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:33.562695 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4269449-2c55-45d1-8e34-96f356390244 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:33.580953 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-d4269449-2c55-45d1-8e34-96f356390244 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:09:33.582128 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-d4269449-2c55-45d1-8e34-96f356390244 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:09:33.631114 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:33.647580 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 596/1187] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:09:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 02:09:33.670785 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e34423-5953-4fe4-beef-db5782e5ef1a None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:33.769867 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e34423-5953-4fe4-beef-db5782e5ef1a None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:33.783211 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:33.803503 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d16bc-209c-4b07-9518-170875ee3763 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:33.804129 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d16bc-209c-4b07-9518-170875ee3763 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:33.804446 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d16bc-209c-4b07-9518-170875ee3763 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:33.804725 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d16bc-209c-4b07-9518-170875ee3763 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:33.814732 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d16bc-209c-4b07-9518-170875ee3763 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:09:33.819574 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-041d16bc-209c-4b07-9518-170875ee3763 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:09:33.819574 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:09:33.819574 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:09:33.819574 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:09:33.819574 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:09:33.819574 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:09:33.819574 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:09:33.819574 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:09:33.819574 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:09:33.819574 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:09:33.819574 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:09:33.819574 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:09:33.819574 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:09:33.819574 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:09:33.819574 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:09:33.819574 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:09:33.820675 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:09:33.820675 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:09:33.820675 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:09:33.820675 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:09:33.820675 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:09:33.820675 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:09:33.820675 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:09:33.820675 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:09:33.820675 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:09:33.820675 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:09:33.820675 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:09:33.820675 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:09:33.820675 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:09:33.820675 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:09:33.820675 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:09:33.820675 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:09:33.821697 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:09:33.821697 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:09:33.821697 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:09:33.821697 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:09:33.821697 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:09:33.821697 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:09:33.821697 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:09:33.821697 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:09:33.821697 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:09:33.821697 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:09:33.821697 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:09:33.821697 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:09:33.821697 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 592/1188] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Aug 5 02:09:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:09:33.826955 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4269449-2c55-45d1-8e34-96f356390244 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:33.924288 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4269449-2c55-45d1-8e34-96f356390244 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:33.956490 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3e0b7-82b0-4dd1-82b7-cdc849cb50d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:33.957084 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3e0b7-82b0-4dd1-82b7-cdc849cb50d2 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:33.957362 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3e0b7-82b0-4dd1-82b7-cdc849cb50d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:33.957633 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb3e0b7-82b0-4dd1-82b7-cdc849cb50d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:33.958334 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3e0b7-82b0-4dd1-82b7-cdc849cb50d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:09:33.958632 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3e0b7-82b0-4dd1-82b7-cdc849cb50d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:33.959976 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb3e0b7-82b0-4dd1-82b7-cdc849cb50d2 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:33.967895 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 597/1189] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:09:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:09:33.974279 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d16bc-209c-4b07-9518-170875ee3763 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:34.072616 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d16bc-209c-4b07-9518-170875ee3763 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:34.105906 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2a062-f44c-46c0-9a84-19b2e8bf1c3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:34.106536 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2a062-f44c-46c0-9a84-19b2e8bf1c3d None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:34.106818 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2a062-f44c-46c0-9a84-19b2e8bf1c3d None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:34.107095 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca2a062-f44c-46c0-9a84-19b2e8bf1c3d None admin] PATH_INFO: `/v3/users/aa6b2750e6574232988f54e792fa3be2` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:34.108245 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca2a062-f44c-46c0-9a84-19b2e8bf1c3d None admin] RBAC: Authorizing `identity:get_user(user_id=aa6b2750e6574232988f54e792fa3be2)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:34.110280 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca2a062-f44c-46c0-9a84-19b2e8bf1c3d None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:34.111864 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 593/1190] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:09:33 2022] GET /identity/v3/users/aa6b2750e6574232988f54e792fa3be2 => generated 311 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:09:34.117726 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3e0b7-82b0-4dd1-82b7-cdc849cb50d2 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:34.164814 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:34.213883 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb3e0b7-82b0-4dd1-82b7-cdc849cb50d2 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:34.247227 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d0644b-a15c-42ee-9763-73b502269c7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:34.247869 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0644b-a15c-42ee-9763-73b502269c7b None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:34.248136 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0644b-a15c-42ee-9763-73b502269c7b None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:34.248440 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d0644b-a15c-42ee-9763-73b502269c7b None admin] PATH_INFO: `/v3/projects/01f4e8225876464cb83697bc5e431c22` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:34.249627 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d0644b-a15c-42ee-9763-73b502269c7b None admin] RBAC: Authorizing `identity:get_project(project_id=01f4e8225876464cb83697bc5e431c22)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:34.251056 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9d0644b-a15c-42ee-9763-73b502269c7b None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:34.252729 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 598/1191] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:09:34 2022] GET /identity/v3/projects/01f4e8225876464cb83697bc5e431c22 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:09:34.258632 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2a062-f44c-46c0-9a84-19b2e8bf1c3d None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:34.300217 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:34.356769 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca2a062-f44c-46c0-9a84-19b2e8bf1c3d None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:34.388722 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6234731e-91b0-4f3b-8780-7ba1054c772a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:34.389372 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234731e-91b0-4f3b-8780-7ba1054c772a None admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:34.389657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234731e-91b0-4f3b-8780-7ba1054c772a None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:34.389929 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6234731e-91b0-4f3b-8780-7ba1054c772a None admin] PATH_INFO: `/v3/projects/01f4e8225876464cb83697bc5e431c22/users/aa6b2750e6574232988f54e792fa3be2/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:34.392555 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6234731e-91b0-4f3b-8780-7ba1054c772a None admin] RBAC: Authorizing `identity:create_grant(project_id=01f4e8225876464cb83697bc5e431c22, user_id=aa6b2750e6574232988f54e792fa3be2, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:34.393970 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6234731e-91b0-4f3b-8780-7ba1054c772a None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:34.405837 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 594/1192] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Aug 5 02:09:34 2022] PUT /identity/v3/projects/01f4e8225876464cb83697bc5e431c22/users/aa6b2750e6574232988f54e792fa3be2/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:09:36.371149 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288ca3b-54e4-4d02-99ce-22e6bc219a79 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:36.371702 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288ca3b-54e4-4d02-99ce-22e6bc219a79 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:36.371702 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288ca3b-54e4-4d02-99ce-22e6bc219a79 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:36.373071 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 599/1193] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:09:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:09:36.378798 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283efac6-985b-4dc1-b134-751d68ea8956 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:36.379190 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283efac6-985b-4dc1-b134-751d68ea8956 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:36.379342 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283efac6-985b-4dc1-b134-751d68ea8956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:36.397728 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-283efac6-985b-4dc1-b134-751d68ea8956 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:09:36.398897 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-283efac6-985b-4dc1-b134-751d68ea8956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:09:36.464517 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 595/1194] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:09:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:09:36.487636 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288ca3b-54e4-4d02-99ce-22e6bc219a79 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:36.586832 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288ca3b-54e4-4d02-99ce-22e6bc219a79 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:36.602799 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:36.620662 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d6e12b-ac97-4ee1-9f6f-731b989373d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:36.621335 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6e12b-ac97-4ee1-9f6f-731b989373d3 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:36.621564 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6e12b-ac97-4ee1-9f6f-731b989373d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:36.621835 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d6e12b-ac97-4ee1-9f6f-731b989373d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:36.632145 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d6e12b-ac97-4ee1-9f6f-731b989373d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:09:36.637080 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-08d6e12b-ac97-4ee1-9f6f-731b989373d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:09:36.637080 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:09:36.637080 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:09:36.637080 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:09:36.637080 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:09:36.637080 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:09:36.637080 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:09:36.637080 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:09:36.637080 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:09:36.637080 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:09:36.637080 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:09:36.637080 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:09:36.637080 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:09:36.637080 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:09:36.637080 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:09:36.637080 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:09:36.638148 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:09:36.638148 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:09:36.638148 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:09:36.638148 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:09:36.638148 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:09:36.638148 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:09:36.638148 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:09:36.638148 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:09:36.638148 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:09:36.638148 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:09:36.638148 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:09:36.638148 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:09:36.638148 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:09:36.638148 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:09:36.638148 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:09:36.638148 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:09:36.639367 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:09:36.639367 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:09:36.639367 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:09:36.639367 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:09:36.639367 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:09:36.639367 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:09:36.639367 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:09:36.639367 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:09:36.639367 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:09:36.639367 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:09:36.639367 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:09:36.639367 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:09:36.639367 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 600/1195] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Aug 5 02:09:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:09:36.644538 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283efac6-985b-4dc1-b134-751d68ea8956 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:36.673629 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:36.740711 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283efac6-985b-4dc1-b134-751d68ea8956 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:36.773638 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499fee0-6163-494a-a053-da5104ff0a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:36.774241 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499fee0-6163-494a-a053-da5104ff0a12 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:36.774519 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499fee0-6163-494a-a053-da5104ff0a12 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:36.774786 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f499fee0-6163-494a-a053-da5104ff0a12 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:36.775488 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f499fee0-6163-494a-a053-da5104ff0a12 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:09:36.775785 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f499fee0-6163-494a-a053-da5104ff0a12 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:36.777145 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f499fee0-6163-494a-a053-da5104ff0a12 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:36.784963 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 596/1196] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:09:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:09:36.790785 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d6e12b-ac97-4ee1-9f6f-731b989373d3 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:36.888583 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d6e12b-ac97-4ee1-9f6f-731b989373d3 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:36.921154 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2936be3-a7b4-4fa4-a0fd-ed14f8a367bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:36.922423 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2936be3-a7b4-4fa4-a0fd-ed14f8a367bf None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:36.922705 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2936be3-a7b4-4fa4-a0fd-ed14f8a367bf None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:36.922978 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2936be3-a7b4-4fa4-a0fd-ed14f8a367bf None admin] PATH_INFO: `/v3/users/aa6b2750e6574232988f54e792fa3be2` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:36.924127 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2936be3-a7b4-4fa4-a0fd-ed14f8a367bf None admin] RBAC: Authorizing `identity:get_user(user_id=aa6b2750e6574232988f54e792fa3be2)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:36.925575 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2936be3-a7b4-4fa4-a0fd-ed14f8a367bf None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:36.927325 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 601/1197] 10.222.0.15 () {56 vars in 1177 bytes} [Fri Aug 5 02:09:36 2022] GET /identity/v3/users/aa6b2750e6574232988f54e792fa3be2 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:09:36.936869 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499fee0-6163-494a-a053-da5104ff0a12 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:37.025012 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:37.034406 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f499fee0-6163-494a-a053-da5104ff0a12 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:37.066718 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97beaa84-461c-48c6-91e2-c837b32aa2b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:37.067315 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97beaa84-461c-48c6-91e2-c837b32aa2b4 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:37.067590 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97beaa84-461c-48c6-91e2-c837b32aa2b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:37.067857 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97beaa84-461c-48c6-91e2-c837b32aa2b4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:37.132025 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97beaa84-461c-48c6-91e2-c837b32aa2b4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:37.133471 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97beaa84-461c-48c6-91e2-c837b32aa2b4 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:37.218488 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:37.227516 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 597/1198] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:09:36 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 02:09:37.233460 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2936be3-a7b4-4fa4-a0fd-ed14f8a367bf None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:37.278825 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:37.330922 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2936be3-a7b4-4fa4-a0fd-ed14f8a367bf None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:37.363693 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535454ea-f06b-4e30-bcb6-2eb8c941ea7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:37.364310 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535454ea-f06b-4e30-bcb6-2eb8c941ea7f None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:37.364618 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535454ea-f06b-4e30-bcb6-2eb8c941ea7f None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:37.364887 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535454ea-f06b-4e30-bcb6-2eb8c941ea7f None admin] PATH_INFO: `/v3/projects/01f4e8225876464cb83697bc5e431c22` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:37.366012 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535454ea-f06b-4e30-bcb6-2eb8c941ea7f None admin] RBAC: Authorizing `identity:get_project(project_id=01f4e8225876464cb83697bc5e431c22)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:37.367419 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535454ea-f06b-4e30-bcb6-2eb8c941ea7f None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:37.369058 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 602/1199] 10.222.0.15 () {56 vars in 1186 bytes} [Fri Aug 5 02:09:37 2022] GET /identity/v3/projects/01f4e8225876464cb83697bc5e431c22 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:09:37.376152 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97beaa84-461c-48c6-91e2-c837b32aa2b4 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:09:37.474222 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97beaa84-461c-48c6-91e2-c837b32aa2b4 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:09:37.508028 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579adb4c-47f9-4fd8-9064-ffead2e52329 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:09:37.508666 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579adb4c-47f9-4fd8-9064-ffead2e52329 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:09:37.508944 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579adb4c-47f9-4fd8-9064-ffead2e52329 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:09:37.509242 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579adb4c-47f9-4fd8-9064-ffead2e52329 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:09:37.510016 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579adb4c-47f9-4fd8-9064-ffead2e52329 None admin] RBAC: Adding query filter params (role.id=e1b75d5eea2a43b2b1b14cf0515350fa, scope.project.id=01f4e8225876464cb83697bc5e431c22, user.id=aa6b2750e6574232988f54e792fa3be2) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:09:37.510322 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579adb4c-47f9-4fd8-9064-ffead2e52329 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:09:37.511750 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579adb4c-47f9-4fd8-9064-ffead2e52329 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:09:37.517922 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 598/1200] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:09:37 2022] GET /identity/v3/role_assignments?user.id=aa6b2750e6574232988f54e792fa3be2&scope.project.id=01f4e8225876464cb83697bc5e431c22&role.id=e1b75d5eea2a43b2b1b14cf0515350fa => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:09:47.359683 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=44 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:09:47.515266 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=72 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:32.565831 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e3cc5-0d78-4f4a-8796-211bdce142be None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:32.566678 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e3cc5-0d78-4f4a-8796-211bdce142be None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:32.566678 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f1e3cc5-0d78-4f4a-8796-211bdce142be None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:32.568090 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 603/1201] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:10:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:10:32.573252 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2091e-2376-415d-b1fc-3e247d77a701 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:32.573875 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2091e-2376-415d-b1fc-3e247d77a701 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:32.574014 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b2091e-2376-415d-b1fc-3e247d77a701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:32.593849 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-50b2091e-2376-415d-b1fc-3e247d77a701 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:10:32.595105 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-50b2091e-2376-415d-b1fc-3e247d77a701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:10:32.681066 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 599/1202] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:10:32 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 05 02:10:32.707723 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e3cc5-0d78-4f4a-8796-211bdce142be None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:32.842045 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f1e3cc5-0d78-4f4a-8796-211bdce142be None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:32.887330 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c0c76-27cb-4b13-bf58-0f6781cd9f91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:32.887993 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c0c76-27cb-4b13-bf58-0f6781cd9f91 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:32.888271 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c0c76-27cb-4b13-bf58-0f6781cd9f91 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:32.888515 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100c0c76-27cb-4b13-bf58-0f6781cd9f91 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:32.906036 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100c0c76-27cb-4b13-bf58-0f6781cd9f91 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:32.907987 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100c0c76-27cb-4b13-bf58-0f6781cd9f91 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:32.930898 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-100c0c76-27cb-4b13-bf58-0f6781cd9f91 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:10:32.930898 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:10:32.930898 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:10:32.930898 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:10:32.930898 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:10:32.930898 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:10:32.930898 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:10:32.930898 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:10:32.930898 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:10:32.930898 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:10:32.930898 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:10:32.930898 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:10:32.930898 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:10:32.930898 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:10:32.930898 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:10:32.932147 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:10:32.932147 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:10:32.932147 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:10:32.932147 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:10:32.932147 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:10:32.932147 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:10:32.932147 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:10:32.932147 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:10:32.932147 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:10:32.932147 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:10:32.932147 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:10:32.932147 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:10:32.932147 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:10:32.932147 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:10:32.932147 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:10:32.932147 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:10:32.932147 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:10:32.933395 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:10:32.933395 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:10:32.933395 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:10:32.933395 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:10:32.934873 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 604/1203] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:10:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:10:32.940891 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b2091e-2376-415d-b1fc-3e247d77a701 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:33.082334 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b2091e-2376-415d-b1fc-3e247d77a701 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:33.128830 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:33.137823 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16ae58b5-b5c1-446c-a630-54f2d63504c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:33.138540 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae58b5-b5c1-446c-a630-54f2d63504c8 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:33.138871 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae58b5-b5c1-446c-a630-54f2d63504c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:33.139247 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16ae58b5-b5c1-446c-a630-54f2d63504c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:33.140138 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae58b5-b5c1-446c-a630-54f2d63504c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:10:33.140534 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae58b5-b5c1-446c-a630-54f2d63504c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:33.142005 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16ae58b5-b5c1-446c-a630-54f2d63504c8 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:33.160426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 600/1204] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:10:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:10:33.163596 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c0c76-27cb-4b13-bf58-0f6781cd9f91 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:33.237004 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:33.303888 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100c0c76-27cb-4b13-bf58-0f6781cd9f91 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:33.355440 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12bcad7a-fd36-406f-977c-c9edbe6f123e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:33.355988 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcad7a-fd36-406f-977c-c9edbe6f123e None admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:33.356272 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcad7a-fd36-406f-977c-c9edbe6f123e None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:33.356666 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12bcad7a-fd36-406f-977c-c9edbe6f123e None admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:33.357400 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bcad7a-fd36-406f-977c-c9edbe6f123e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:33.358966 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12bcad7a-fd36-406f-977c-c9edbe6f123e None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:33.400356 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 605/1205] 10.222.0.15 () {60 vars in 1132 bytes} [Fri Aug 5 02:10:33 2022] POST /identity/v3/users => generated 251 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:10:35.690556 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536628e8-0c87-4f23-b3e3-105236c7cccd None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:35.691128 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536628e8-0c87-4f23-b3e3-105236c7cccd None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:35.691128 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536628e8-0c87-4f23-b3e3-105236c7cccd None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:35.694492 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 601/1206] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:10:35 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:10:35.703027 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5f36a-df0e-480e-b37f-60e661b58fc9 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:35.703505 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5f36a-df0e-480e-b37f-60e661b58fc9 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:35.703725 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff5f36a-df0e-480e-b37f-60e661b58fc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:35.723369 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-7ff5f36a-df0e-480e-b37f-60e661b58fc9 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:10:35.724710 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-7ff5f36a-df0e-480e-b37f-60e661b58fc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:10:35.812400 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 606/1207] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:10:35 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:10:35.836681 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536628e8-0c87-4f23-b3e3-105236c7cccd None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:35.962484 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536628e8-0c87-4f23-b3e3-105236c7cccd None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:36.005330 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e3308-a3c1-46af-b355-b14cbf64227e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:36.006103 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e3308-a3c1-46af-b355-b14cbf64227e None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:36.006447 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e3308-a3c1-46af-b355-b14cbf64227e None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:36.006733 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17e3308-a3c1-46af-b355-b14cbf64227e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:36.019791 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17e3308-a3c1-46af-b355-b14cbf64227e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:10:36.025577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-b17e3308-a3c1-46af-b355-b14cbf64227e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:10:36.025577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:10:36.025577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:10:36.025577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:10:36.025577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:10:36.025577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:10:36.025577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:10:36.025577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:10:36.025577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:10:36.025577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:10:36.025577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:10:36.025577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:10:36.025577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:10:36.025577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:10:36.025577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:10:36.025577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:10:36.026713 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:10:36.026713 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:10:36.026713 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:10:36.026713 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:10:36.026713 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:10:36.026713 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:10:36.026713 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:10:36.026713 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:10:36.026713 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:10:36.026713 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:10:36.026713 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:10:36.026713 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:10:36.026713 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:10:36.026713 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:10:36.026713 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:10:36.026713 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:10:36.033664 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:10:36.033664 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:10:36.033664 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:10:36.033664 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:10:36.033664 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:10:36.033664 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:10:36.033664 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:10:36.033664 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:10:36.033664 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:10:36.033664 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:10:36.033664 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:10:36.033664 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:10:36.033664 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 602/1208] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Aug 5 02:10:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:10:36.034687 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5f36a-df0e-480e-b37f-60e661b58fc9 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:36.087979 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:36.163374 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff5f36a-df0e-480e-b37f-60e661b58fc9 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:36.213275 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa44816-031c-42aa-b2d9-6a0867c7e19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:36.214923 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa44816-031c-42aa-b2d9-6a0867c7e19d None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:36.215328 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa44816-031c-42aa-b2d9-6a0867c7e19d None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:36.215714 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa44816-031c-42aa-b2d9-6a0867c7e19d None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:36.216779 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa44816-031c-42aa-b2d9-6a0867c7e19d None admin] RBAC: Adding query filter params (name=service) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:10:36.217212 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa44816-031c-42aa-b2d9-6a0867c7e19d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:36.219038 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa44816-031c-42aa-b2d9-6a0867c7e19d None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:36.228683 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 607/1209] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Aug 5 02:10:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:10:36.235306 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e3308-a3c1-46af-b355-b14cbf64227e None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:36.296915 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:36.367750 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17e3308-a3c1-46af-b355-b14cbf64227e None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:36.406168 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8242045-aa22-42f4-adec-1e5653507f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:36.406887 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8242045-aa22-42f4-adec-1e5653507f3d None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:36.407156 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8242045-aa22-42f4-adec-1e5653507f3d None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:36.407417 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8242045-aa22-42f4-adec-1e5653507f3d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:36.423288 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8242045-aa22-42f4-adec-1e5653507f3d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:36.425518 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8242045-aa22-42f4-adec-1e5653507f3d None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:36.444178 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-b8242045-aa22-42f4-adec-1e5653507f3d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:10:36.444178 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:10:36.444178 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:10:36.444178 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:10:36.444178 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:10:36.444178 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:10:36.444178 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:10:36.444178 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:10:36.444178 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:10:36.444178 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:10:36.444178 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:10:36.444178 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:10:36.444178 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:10:36.444178 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:10:36.444178 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:10:36.445336 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:10:36.445336 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:10:36.445336 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:10:36.445336 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:10:36.445336 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:10:36.445336 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:10:36.445336 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:10:36.445336 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:10:36.445336 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:10:36.445336 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:10:36.445336 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:10:36.445336 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:10:36.445336 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:10:36.445336 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:10:36.445336 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:10:36.445336 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:10:36.445336 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:10:36.446438 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:10:36.446438 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:10:36.446438 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:10:36.446438 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:10:36.446438 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 603/1210] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:10:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:10:36.452816 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa44816-031c-42aa-b2d9-6a0867c7e19d None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:36.575670 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:36.578488 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa44816-031c-42aa-b2d9-6a0867c7e19d None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:36.618626 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d0569-f467-4105-9737-e3ed2fbd56e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:36.619509 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d0569-f467-4105-9737-e3ed2fbd56e1 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:36.620007 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d0569-f467-4105-9737-e3ed2fbd56e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:36.621420 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331d0569-f467-4105-9737-e3ed2fbd56e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:36.622231 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d0569-f467-4105-9737-e3ed2fbd56e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:10:36.622796 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d0569-f467-4105-9737-e3ed2fbd56e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:36.624490 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331d0569-f467-4105-9737-e3ed2fbd56e1 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:36.640356 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 608/1211] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:10:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:10:36.644931 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8242045-aa22-42f4-adec-1e5653507f3d None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:36.755886 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8242045-aa22-42f4-adec-1e5653507f3d None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:36.757530 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:36.797967 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af4c4a-7e26-4191-8af5-7d71702c7643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:36.798633 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af4c4a-7e26-4191-8af5-7d71702c7643 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:36.798938 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af4c4a-7e26-4191-8af5-7d71702c7643 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:36.799205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68af4c4a-7e26-4191-8af5-7d71702c7643 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:36.808263 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af4c4a-7e26-4191-8af5-7d71702c7643 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:36.809854 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68af4c4a-7e26-4191-8af5-7d71702c7643 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:36.821418 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-68af4c4a-7e26-4191-8af5-7d71702c7643 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 05 02:10:36.821418 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:10:36.821418 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:10:36.821418 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:10:36.821418 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:10:36.821418 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:10:36.821418 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:10:36.821418 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:10:36.821418 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:10:36.821418 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:10:36.821418 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:10:36.821418 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:10:36.821418 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:10:36.821418 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:10:36.821418 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:10:36.821418 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:10:36.824687 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:10:36.824687 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:10:36.824687 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:10:36.824687 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:10:36.824687 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:10:36.824687 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:10:36.824687 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:10:36.824687 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:10:36.824687 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:10:36.824687 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:10:36.824687 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:10:36.824687 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:10:36.824687 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:10:36.824687 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:10:36.824687 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:10:36.824687 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:10:36.824687 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:10:36.824687 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:10:36.825912 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:10:36.825912 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:10:36.825912 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:10:36.825912 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:10:36.825912 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:10:36.825912 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:10:36.825912 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:10:36.825912 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:10:36.825912 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 05 02:10:36.825912 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:10:36.825912 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 604/1212] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:10:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:10:36.829727 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d0569-f467-4105-9737-e3ed2fbd56e1 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:36.947052 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331d0569-f467-4105-9737-e3ed2fbd56e1 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:36.993912 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a66846-50c2-42bd-ba2d-1efc43e96ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:36.995617 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a66846-50c2-42bd-ba2d-1efc43e96ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:36.995817 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a66846-50c2-42bd-ba2d-1efc43e96ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:36.996239 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a66846-50c2-42bd-ba2d-1efc43e96ff8 None admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:36.997292 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a66846-50c2-42bd-ba2d-1efc43e96ff8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:10:36.997705 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a66846-50c2-42bd-ba2d-1efc43e96ff8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:36.999618 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a66846-50c2-42bd-ba2d-1efc43e96ff8 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:37.024788 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 609/1213] 10.222.0.15 () {56 vars in 1143 bytes} [Fri Aug 5 02:10:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:10:37.026926 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af4c4a-7e26-4191-8af5-7d71702c7643 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:37.144070 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68af4c4a-7e26-4191-8af5-7d71702c7643 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:37.187314 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac987b6-e97e-4972-ae50-5b9ac3f941e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:37.187949 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac987b6-e97e-4972-ae50-5b9ac3f941e6 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:37.188225 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac987b6-e97e-4972-ae50-5b9ac3f941e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:37.188527 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac987b6-e97e-4972-ae50-5b9ac3f941e6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:37.224755 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:37.267802 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac987b6-e97e-4972-ae50-5b9ac3f941e6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:37.269271 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac987b6-e97e-4972-ae50-5b9ac3f941e6 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:37.380487 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 605/1214] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:10:37 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 02:10:37.386443 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a66846-50c2-42bd-ba2d-1efc43e96ff8 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:37.412535 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:37.511817 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a66846-50c2-42bd-ba2d-1efc43e96ff8 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:37.557937 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7e5bb-3cd7-4535-bdc1-cdbfd4a25aaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:37.558625 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7e5bb-3cd7-4535-bdc1-cdbfd4a25aaf None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:37.558890 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7e5bb-3cd7-4535-bdc1-cdbfd4a25aaf None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:37.559217 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf7e5bb-3cd7-4535-bdc1-cdbfd4a25aaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:37.573932 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf7e5bb-3cd7-4535-bdc1-cdbfd4a25aaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:37.575721 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf7e5bb-3cd7-4535-bdc1-cdbfd4a25aaf None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:37.593074 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-acf7e5bb-3cd7-4535-bdc1-cdbfd4a25aaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:10:37.593074 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:10:37.593074 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:10:37.593074 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:10:37.593074 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:10:37.593074 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:10:37.593074 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:10:37.593074 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:10:37.593074 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:10:37.593074 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:10:37.593074 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:10:37.593074 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:10:37.593074 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:10:37.593074 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:10:37.593074 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:10:37.594261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:10:37.594261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:10:37.594261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:10:37.594261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:10:37.594261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:10:37.594261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:10:37.594261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:10:37.594261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:10:37.594261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:10:37.594261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:10:37.594261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:10:37.594261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:10:37.594261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:10:37.594261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:10:37.594261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:10:37.594261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:10:37.594261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:10:37.595195 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:10:37.595195 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:10:37.595195 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:10:37.595195 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:10:37.595195 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 610/1215] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:10:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:10:37.601060 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac987b6-e97e-4972-ae50-5b9ac3f941e6 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:37.670606 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:37.710825 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac987b6-e97e-4972-ae50-5b9ac3f941e6 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:37.748479 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d799c0e-123a-4eef-867e-042e10b86b1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:37.751625 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d799c0e-123a-4eef-867e-042e10b86b1b None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:37.751930 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d799c0e-123a-4eef-867e-042e10b86b1b None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:37.752215 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d799c0e-123a-4eef-867e-042e10b86b1b None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:37.752958 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d799c0e-123a-4eef-867e-042e10b86b1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:10:37.753267 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d799c0e-123a-4eef-867e-042e10b86b1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:37.754648 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d799c0e-123a-4eef-867e-042e10b86b1b None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:37.772306 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 606/1216] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:10:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:10:37.773863 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7e5bb-3cd7-4535-bdc1-cdbfd4a25aaf None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:37.847442 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:37.882134 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf7e5bb-3cd7-4535-bdc1-cdbfd4a25aaf None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:37.920983 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786cda7c-05fc-412e-a623-f4803655c8e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:37.921736 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cda7c-05fc-412e-a623-f4803655c8e3 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:37.922100 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cda7c-05fc-412e-a623-f4803655c8e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:37.922460 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-786cda7c-05fc-412e-a623-f4803655c8e3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:37.929571 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786cda7c-05fc-412e-a623-f4803655c8e3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:37.931070 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-786cda7c-05fc-412e-a623-f4803655c8e3 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:37.942944 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-786cda7c-05fc-412e-a623-f4803655c8e3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:10:37.942944 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:10:37.942944 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:10:37.942944 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:10:37.942944 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:10:37.942944 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:10:37.942944 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:10:37.942944 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:10:37.942944 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:10:37.942944 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:10:37.942944 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:10:37.942944 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:10:37.942944 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:10:37.942944 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:10:37.942944 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:10:37.944027 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:10:37.944027 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:10:37.944027 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:10:37.944027 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:10:37.944027 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:10:37.944027 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:10:37.944027 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:10:37.944027 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:10:37.944027 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:10:37.944027 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:10:37.944027 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:10:37.944027 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:10:37.944027 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:10:37.944027 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:10:37.944027 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:10:37.944027 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:10:37.944027 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:10:37.945212 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:10:37.945212 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:10:37.945212 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:10:37.945212 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:10:37.945212 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:10:37.945212 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:10:37.945212 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:10:37.945212 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:10:37.951203 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 611/1217] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:10:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:10:37.952012 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d799c0e-123a-4eef-867e-042e10b86b1b None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:38.080703 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d799c0e-123a-4eef-867e-042e10b86b1b None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:38.112025 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:38.126362 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d290ec-280f-40a6-bf7f-6297e5ad19c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:38.127160 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d290ec-280f-40a6-bf7f-6297e5ad19c5 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:38.127532 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d290ec-280f-40a6-bf7f-6297e5ad19c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:38.127886 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d290ec-280f-40a6-bf7f-6297e5ad19c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:38.128750 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d290ec-280f-40a6-bf7f-6297e5ad19c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:10:38.129192 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d290ec-280f-40a6-bf7f-6297e5ad19c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:38.130701 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d290ec-280f-40a6-bf7f-6297e5ad19c5 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:38.143542 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 607/1218] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Aug 5 02:10:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:10:38.149364 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786cda7c-05fc-412e-a623-f4803655c8e3 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:38.267862 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-786cda7c-05fc-412e-a623-f4803655c8e3 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:38.300319 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:38.308063 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dba01e-3d3a-419e-806b-c1fa2ac07743 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:38.308870 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dba01e-3d3a-419e-806b-c1fa2ac07743 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:38.309512 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dba01e-3d3a-419e-806b-c1fa2ac07743 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:38.309929 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dba01e-3d3a-419e-806b-c1fa2ac07743 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:38.310966 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dba01e-3d3a-419e-806b-c1fa2ac07743 None admin] RBAC: Adding query filter params (role.id=876fd0d181d74df4bbc73b2db1c42fbe, scope.project.id=95d88dece7184bf1842c4f8d275d52cd, user.id=e84ea976b5914aea94c4d8f805139daf) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:10:38.311420 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dba01e-3d3a-419e-806b-c1fa2ac07743 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:38.313163 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dba01e-3d3a-419e-806b-c1fa2ac07743 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:38.319623 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 612/1219] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:10:38 2022] GET /identity/v3/role_assignments?user.id=e84ea976b5914aea94c4d8f805139daf&scope.project.id=95d88dece7184bf1842c4f8d275d52cd&role.id=876fd0d181d74df4bbc73b2db1c42fbe => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:10:40.499569 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91007a8a-0ad4-4d29-945e-654dbcd2a74c None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:40.500227 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91007a8a-0ad4-4d29-945e-654dbcd2a74c None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:40.500227 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91007a8a-0ad4-4d29-945e-654dbcd2a74c None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:40.501478 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 608/1220] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:10:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:10:40.507852 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41832d9c-ecb9-4e5d-a4d0-f78fc60546cf None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:40.508387 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41832d9c-ecb9-4e5d-a4d0-f78fc60546cf None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:40.508531 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41832d9c-ecb9-4e5d-a4d0-f78fc60546cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:40.532465 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-41832d9c-ecb9-4e5d-a4d0-f78fc60546cf None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:10:40.533723 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-41832d9c-ecb9-4e5d-a4d0-f78fc60546cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:10:40.626869 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 613/1221] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:10:40 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:10:40.654799 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91007a8a-0ad4-4d29-945e-654dbcd2a74c None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:40.781219 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91007a8a-0ad4-4d29-945e-654dbcd2a74c None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:40.822583 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb927d70-999c-4bdd-8bd9-dee203fff5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:40.823758 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb927d70-999c-4bdd-8bd9-dee203fff5e1 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:40.824193 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb927d70-999c-4bdd-8bd9-dee203fff5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:40.824510 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb927d70-999c-4bdd-8bd9-dee203fff5e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:40.837578 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb927d70-999c-4bdd-8bd9-dee203fff5e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:10:40.844015 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-cb927d70-999c-4bdd-8bd9-dee203fff5e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:10:40.844015 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:10:40.844015 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:10:40.844015 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:10:40.844015 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:10:40.844015 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:10:40.844015 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:10:40.844015 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:10:40.844015 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:10:40.844015 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:10:40.844015 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:10:40.844015 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:10:40.844015 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:10:40.844015 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:10:40.844015 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:10:40.844015 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:10:40.845259 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:10:40.845259 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:10:40.845259 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:10:40.845259 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:10:40.845259 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:10:40.845259 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:10:40.845259 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:10:40.845259 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:10:40.845259 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:10:40.845259 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:10:40.845259 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:10:40.845259 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:10:40.845259 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:10:40.845259 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:10:40.845259 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:10:40.845259 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:10:40.846319 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:10:40.846319 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:10:40.846319 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:10:40.846319 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:10:40.846319 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:10:40.846319 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:10:40.846319 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:10:40.846319 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:10:40.846319 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:10:40.846319 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:10:40.846319 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:10:40.846319 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:10:40.846319 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 609/1222] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Aug 5 02:10:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:10:40.853713 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41832d9c-ecb9-4e5d-a4d0-f78fc60546cf None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:40.980146 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41832d9c-ecb9-4e5d-a4d0-f78fc60546cf None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:41.008628 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:41.022844 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dbac3e-ddd6-4955-a7ab-d3aa26e4c8cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:41.023503 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbac3e-ddd6-4955-a7ab-d3aa26e4c8cf None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:41.023856 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbac3e-ddd6-4955-a7ab-d3aa26e4c8cf None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:41.024172 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71dbac3e-ddd6-4955-a7ab-d3aa26e4c8cf None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:41.025088 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dbac3e-ddd6-4955-a7ab-d3aa26e4c8cf None admin] RBAC: Adding query filter params (name=service) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:10:41.025436 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dbac3e-ddd6-4955-a7ab-d3aa26e4c8cf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:41.027220 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71dbac3e-ddd6-4955-a7ab-d3aa26e4c8cf None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:41.043588 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 614/1223] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Aug 5 02:10:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:10:41.044991 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb927d70-999c-4bdd-8bd9-dee203fff5e1 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:41.101780 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:41.159036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb927d70-999c-4bdd-8bd9-dee203fff5e1 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:41.193607 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b0e81-227e-45f8-aab9-6713cbd36fcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:41.194256 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b0e81-227e-45f8-aab9-6713cbd36fcd None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:41.194537 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b0e81-227e-45f8-aab9-6713cbd36fcd None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:41.194810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59b0e81-227e-45f8-aab9-6713cbd36fcd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:41.206050 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59b0e81-227e-45f8-aab9-6713cbd36fcd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:41.207503 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59b0e81-227e-45f8-aab9-6713cbd36fcd None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:41.224072 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-e59b0e81-227e-45f8-aab9-6713cbd36fcd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:10:41.224072 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:10:41.224072 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:10:41.224072 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:10:41.224072 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:10:41.224072 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:10:41.224072 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:10:41.224072 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:10:41.224072 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:10:41.224072 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:10:41.224072 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:10:41.224072 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:10:41.224072 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:10:41.224072 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:10:41.224072 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:10:41.230198 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:10:41.230198 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:10:41.230198 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:10:41.230198 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:10:41.230198 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:10:41.230198 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:10:41.230198 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:10:41.230198 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:10:41.230198 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:10:41.230198 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:10:41.230198 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:10:41.230198 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:10:41.230198 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:10:41.230198 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:10:41.230198 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:10:41.230198 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:10:41.230198 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:10:41.231148 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:10:41.231148 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:10:41.231148 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:10:41.231148 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:10:41.231148 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 610/1224] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:10:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:10:41.231439 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dbac3e-ddd6-4955-a7ab-d3aa26e4c8cf None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:41.347139 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71dbac3e-ddd6-4955-a7ab-d3aa26e4c8cf None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:41.383163 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1fd27-6ce4-4797-90e5-1b2593c43d9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:41.383893 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1fd27-6ce4-4797-90e5-1b2593c43d9b None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:41.384084 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1fd27-6ce4-4797-90e5-1b2593c43d9b None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:41.384398 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c1fd27-6ce4-4797-90e5-1b2593c43d9b None admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:41.385918 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c1fd27-6ce4-4797-90e5-1b2593c43d9b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:10:41.386280 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c1fd27-6ce4-4797-90e5-1b2593c43d9b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:41.387952 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9c1fd27-6ce4-4797-90e5-1b2593c43d9b None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:41.402392 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 615/1225] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:10:41.408790 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b0e81-227e-45f8-aab9-6713cbd36fcd None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:41.508852 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:41.517058 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59b0e81-227e-45f8-aab9-6713cbd36fcd None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:41.555391 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84623e-7d6d-46b8-bb0a-db176ce5d22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:41.556294 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84623e-7d6d-46b8-bb0a-db176ce5d22c None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:41.556988 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84623e-7d6d-46b8-bb0a-db176ce5d22c None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:41.557624 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a84623e-7d6d-46b8-bb0a-db176ce5d22c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:41.565581 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84623e-7d6d-46b8-bb0a-db176ce5d22c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:41.567009 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a84623e-7d6d-46b8-bb0a-db176ce5d22c None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:41.579148 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-1a84623e-7d6d-46b8-bb0a-db176ce5d22c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 05 02:10:41.579148 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:10:41.579148 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:10:41.579148 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:10:41.579148 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:10:41.579148 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:10:41.579148 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:10:41.579148 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:10:41.579148 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:10:41.579148 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:10:41.579148 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:10:41.579148 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:10:41.579148 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:10:41.579148 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:10:41.579148 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:10:41.579148 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:10:41.580537 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:10:41.580537 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:10:41.580537 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:10:41.580537 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:10:41.580537 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:10:41.580537 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:10:41.580537 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:10:41.580537 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:10:41.580537 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:10:41.580537 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:10:41.580537 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:10:41.580537 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:10:41.580537 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:10:41.580537 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:10:41.580537 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:10:41.580537 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:10:41.580537 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:10:41.580537 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:10:41.582106 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:10:41.582106 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:10:41.582106 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:10:41.582106 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:10:41.582106 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:10:41.582106 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:10:41.582106 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:10:41.582106 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:10:41.582106 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 05 02:10:41.582106 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:10:41.582106 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 611/1226] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:10:41 2022] GET /identity/v3/users/placement => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:10:41.586289 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1fd27-6ce4-4797-90e5-1b2593c43d9b None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:41.645338 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:41.701023 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9c1fd27-6ce4-4797-90e5-1b2593c43d9b None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:41.736988 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4712f-ad3b-4b53-89b5-ba6f63ffc4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:41.737699 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4712f-ad3b-4b53-89b5-ba6f63ffc4fd None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:41.738040 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4712f-ad3b-4b53-89b5-ba6f63ffc4fd None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:41.738375 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e4712f-ad3b-4b53-89b5-ba6f63ffc4fd None admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:41.739226 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e4712f-ad3b-4b53-89b5-ba6f63ffc4fd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:10:41.739614 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e4712f-ad3b-4b53-89b5-ba6f63ffc4fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:41.741169 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e4712f-ad3b-4b53-89b5-ba6f63ffc4fd None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:41.762977 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 616/1227] 10.222.0.15 () {56 vars in 1143 bytes} [Fri Aug 5 02:10:41 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:10:41.768880 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84623e-7d6d-46b8-bb0a-db176ce5d22c None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:41.885667 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a84623e-7d6d-46b8-bb0a-db176ce5d22c None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:41.924035 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db2f86-53e2-4087-8c10-5245f9edfab1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:41.924713 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db2f86-53e2-4087-8c10-5245f9edfab1 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:41.924993 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db2f86-53e2-4087-8c10-5245f9edfab1 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:41.925267 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26db2f86-53e2-4087-8c10-5245f9edfab1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:41.937093 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26db2f86-53e2-4087-8c10-5245f9edfab1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:41.938783 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26db2f86-53e2-4087-8c10-5245f9edfab1 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:41.954684 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-26db2f86-53e2-4087-8c10-5245f9edfab1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:10:41.954684 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:10:41.954684 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:10:41.954684 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:10:41.954684 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:10:41.954684 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:10:41.954684 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:10:41.954684 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:10:41.954684 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:10:41.954684 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:10:41.954684 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:10:41.954684 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:10:41.954684 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:10:41.954684 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:10:41.954684 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:10:41.955828 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:10:41.955828 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:10:41.955828 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:10:41.955828 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:10:41.955828 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:10:41.955828 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:10:41.955828 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:10:41.955828 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:10:41.955828 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:10:41.955828 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:10:41.955828 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:10:41.955828 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:10:41.955828 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:10:41.955828 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:10:41.955828 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:10:41.955828 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:10:41.955828 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:10:41.962027 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:10:41.962027 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:10:41.962027 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:10:41.962027 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:10:41.962027 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 612/1228] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:10:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:10:41.962313 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4712f-ad3b-4b53-89b5-ba6f63ffc4fd None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:42.075571 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e4712f-ad3b-4b53-89b5-ba6f63ffc4fd None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:42.078296 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:42.117396 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a67ce-1fa6-42e0-b80a-456252d33a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:42.118009 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a67ce-1fa6-42e0-b80a-456252d33a94 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:42.118287 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a67ce-1fa6-42e0-b80a-456252d33a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:42.118593 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a67ce-1fa6-42e0-b80a-456252d33a94 None admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:42.119701 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a67ce-1fa6-42e0-b80a-456252d33a94 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:10:42.120012 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a67ce-1fa6-42e0-b80a-456252d33a94 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:42.121777 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a67ce-1fa6-42e0-b80a-456252d33a94 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:42.134485 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 617/1229] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:10:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:10:42.141110 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db2f86-53e2-4087-8c10-5245f9edfab1 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:42.151847 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:42.249247 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26db2f86-53e2-4087-8c10-5245f9edfab1 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:42.297377 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eac64f-e0c0-4f88-97bc-05cedb0f5d35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:42.298030 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eac64f-e0c0-4f88-97bc-05cedb0f5d35 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:42.298308 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eac64f-e0c0-4f88-97bc-05cedb0f5d35 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:42.298577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56eac64f-e0c0-4f88-97bc-05cedb0f5d35 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:42.308195 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eac64f-e0c0-4f88-97bc-05cedb0f5d35 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:42.308195 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56eac64f-e0c0-4f88-97bc-05cedb0f5d35 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:42.321778 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-56eac64f-e0c0-4f88-97bc-05cedb0f5d35 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:10:42.321778 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:10:42.321778 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:10:42.321778 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:10:42.321778 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:10:42.321778 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:10:42.321778 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:10:42.321778 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:10:42.321778 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:10:42.321778 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:10:42.321778 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:10:42.321778 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:10:42.321778 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:10:42.321778 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:10:42.321778 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:10:42.323464 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:10:42.323464 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:10:42.323464 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:10:42.323464 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:10:42.323464 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:10:42.323464 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:10:42.323464 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:10:42.323464 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:10:42.323464 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:10:42.323464 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:10:42.323464 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:10:42.323464 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:10:42.323464 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:10:42.323464 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:10:42.323464 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:10:42.323464 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:10:42.323464 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:10:42.324674 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:10:42.324674 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:10:42.324674 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:10:42.324674 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:10:42.324674 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:10:42.324674 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:10:42.324674 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:10:42.324674 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:10:42.324674 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 613/1230] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:10:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:10:42.330768 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a67ce-1fa6-42e0-b80a-456252d33a94 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:42.444800 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a67ce-1fa6-42e0-b80a-456252d33a94 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:42.482491 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd5e87-f0ec-418d-b88a-6efa30a865c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:42.483146 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd5e87-f0ec-418d-b88a-6efa30a865c6 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:42.483472 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd5e87-f0ec-418d-b88a-6efa30a865c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:42.483747 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd5e87-f0ec-418d-b88a-6efa30a865c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:42.484559 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd5e87-f0ec-418d-b88a-6efa30a865c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:10:42.484865 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd5e87-f0ec-418d-b88a-6efa30a865c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:42.486345 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd5e87-f0ec-418d-b88a-6efa30a865c6 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:42.500987 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 618/1231] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Aug 5 02:10:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:10:42.507498 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eac64f-e0c0-4f88-97bc-05cedb0f5d35 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:42.581167 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:42.623468 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56eac64f-e0c0-4f88-97bc-05cedb0f5d35 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:42.664953 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f653cc2-e2cf-4536-a65f-e148197d8ea5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:42.665826 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f653cc2-e2cf-4536-a65f-e148197d8ea5 None admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:42.666109 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f653cc2-e2cf-4536-a65f-e148197d8ea5 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:42.666385 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f653cc2-e2cf-4536-a65f-e148197d8ea5 None admin] PATH_INFO: `/v3/projects/95d88dece7184bf1842c4f8d275d52cd/users/e84ea976b5914aea94c4d8f805139daf/roles/876fd0d181d74df4bbc73b2db1c42fbe` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:42.682176 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f653cc2-e2cf-4536-a65f-e148197d8ea5 None admin] RBAC: Authorizing `identity:create_grant(project_id=95d88dece7184bf1842c4f8d275d52cd, user_id=e84ea976b5914aea94c4d8f805139daf, role_id=876fd0d181d74df4bbc73b2db1c42fbe)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:42.683591 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f653cc2-e2cf-4536-a65f-e148197d8ea5 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:42.695690 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 614/1232] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Aug 5 02:10:42 2022] PUT /identity/v3/projects/95d88dece7184bf1842c4f8d275d52cd/users/e84ea976b5914aea94c4d8f805139daf/roles/876fd0d181d74df4bbc73b2db1c42fbe => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:10:44.692090 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f92c2d-7385-4567-9a2e-84a4c560fc56 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:44.692666 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f92c2d-7385-4567-9a2e-84a4c560fc56 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:44.692666 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f92c2d-7385-4567-9a2e-84a4c560fc56 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:44.694172 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 619/1233] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:10:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:10:44.699729 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465a82c-0667-4d27-b982-0e145d8d75be None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:44.700169 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465a82c-0667-4d27-b982-0e145d8d75be None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:44.700313 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4465a82c-0667-4d27-b982-0e145d8d75be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:44.719375 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-4465a82c-0667-4d27-b982-0e145d8d75be None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:10:44.720741 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-4465a82c-0667-4d27-b982-0e145d8d75be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:10:44.794603 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 615/1234] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:10:44 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:10:44.817766 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f92c2d-7385-4567-9a2e-84a4c560fc56 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:44.844737 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:44.926804 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f92c2d-7385-4567-9a2e-84a4c560fc56 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:44.964631 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733c804-99a6-4205-8d2f-72718aa4b6f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:44.965195 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733c804-99a6-4205-8d2f-72718aa4b6f8 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:44.965471 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733c804-99a6-4205-8d2f-72718aa4b6f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:44.965757 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5733c804-99a6-4205-8d2f-72718aa4b6f8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:44.976391 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5733c804-99a6-4205-8d2f-72718aa4b6f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:10:44.982099 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-5733c804-99a6-4205-8d2f-72718aa4b6f8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:10:44.982099 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:10:44.982099 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:10:44.982099 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:10:44.982099 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:10:44.982099 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:10:44.982099 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:10:44.982099 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:10:44.982099 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:10:44.982099 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:10:44.982099 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:10:44.982099 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:10:44.982099 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:10:44.982099 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:10:44.982099 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:10:44.982099 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:10:44.983525 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:10:44.983525 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:10:44.983525 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:10:44.983525 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:10:44.983525 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:10:44.983525 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:10:44.983525 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:10:44.983525 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:10:44.983525 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:10:44.983525 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:10:44.983525 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:10:44.983525 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:10:44.983525 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:10:44.983525 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:10:44.983525 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:10:44.983525 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:10:44.984526 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:10:44.984526 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:10:44.984526 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:10:44.984526 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:10:44.984526 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:10:44.984526 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:10:44.984526 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:10:44.984526 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:10:44.984526 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:10:44.984526 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:10:44.984526 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 05 02:10:44.984526 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:10:44.984526 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 620/1235] 10.222.0.15 () {56 vars in 1102 bytes} [Fri Aug 5 02:10:44 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:10:44.989539 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465a82c-0667-4d27-b982-0e145d8d75be None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:45.038383 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:45.095021 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4465a82c-0667-4d27-b982-0e145d8d75be None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:45.135628 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843fe189-bfdb-4c12-b636-75bb82656fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:45.136912 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fe189-bfdb-4c12-b636-75bb82656fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:45.137337 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fe189-bfdb-4c12-b636-75bb82656fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:45.137743 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843fe189-bfdb-4c12-b636-75bb82656fd7 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:45.138695 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843fe189-bfdb-4c12-b636-75bb82656fd7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:10:45.139112 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843fe189-bfdb-4c12-b636-75bb82656fd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:45.140686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843fe189-bfdb-4c12-b636-75bb82656fd7 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:45.149482 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 616/1236] 10.222.0.15 () {56 vars in 1103 bytes} [Fri Aug 5 02:10:44 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:10:45.156519 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733c804-99a6-4205-8d2f-72718aa4b6f8 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:45.248156 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:45.265808 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5733c804-99a6-4205-8d2f-72718aa4b6f8 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:45.302230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d73ab-6923-41ba-93bd-edd7ece5943a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:45.302872 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d73ab-6923-41ba-93bd-edd7ece5943a None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:45.303162 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d73ab-6923-41ba-93bd-edd7ece5943a None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:45.303440 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103d73ab-6923-41ba-93bd-edd7ece5943a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:45.314271 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d73ab-6923-41ba-93bd-edd7ece5943a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:45.315742 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103d73ab-6923-41ba-93bd-edd7ece5943a None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:45.331439 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-103d73ab-6923-41ba-93bd-edd7ece5943a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:10:45.331439 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:10:45.331439 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:10:45.331439 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:10:45.331439 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:10:45.331439 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:10:45.331439 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:10:45.331439 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:10:45.331439 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:10:45.331439 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:10:45.331439 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:10:45.331439 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:10:45.331439 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:10:45.331439 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:10:45.331439 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:10:45.340159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:10:45.340159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:10:45.340159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:10:45.340159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:10:45.340159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:10:45.340159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:10:45.340159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:10:45.340159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:10:45.340159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:10:45.340159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:10:45.340159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:10:45.340159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:10:45.340159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:10:45.340159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:10:45.340159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:10:45.340159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:10:45.340159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:10:45.341138 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:10:45.341138 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:10:45.341138 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:10:45.341138 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:10:45.341138 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 621/1237] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:10:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:10:45.341414 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843fe189-bfdb-4c12-b636-75bb82656fd7 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:45.450188 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843fe189-bfdb-4c12-b636-75bb82656fd7 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:45.459993 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:45.488663 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfbe350-84e5-4ee5-96a6-032ed98ea6c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:45.489321 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbe350-84e5-4ee5-96a6-032ed98ea6c8 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:45.489599 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbe350-84e5-4ee5-96a6-032ed98ea6c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:45.489869 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cfbe350-84e5-4ee5-96a6-032ed98ea6c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:45.490560 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfbe350-84e5-4ee5-96a6-032ed98ea6c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:10:45.490858 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfbe350-84e5-4ee5-96a6-032ed98ea6c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:45.492211 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cfbe350-84e5-4ee5-96a6-032ed98ea6c8 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:45.504714 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 617/1238] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:10:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:10:45.510913 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d73ab-6923-41ba-93bd-edd7ece5943a None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:45.629202 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103d73ab-6923-41ba-93bd-edd7ece5943a None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:45.663246 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ed5a8-d859-42ad-9136-48b6b863f807 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:45.663983 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ed5a8-d859-42ad-9136-48b6b863f807 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:45.664381 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ed5a8-d859-42ad-9136-48b6b863f807 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:45.664589 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115ed5a8-d859-42ad-9136-48b6b863f807 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:45.668401 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:45.673965 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ed5a8-d859-42ad-9136-48b6b863f807 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:45.675403 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115ed5a8-d859-42ad-9136-48b6b863f807 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:45.688645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-115ed5a8-d859-42ad-9136-48b6b863f807 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 05 02:10:45.688645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:10:45.688645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:10:45.688645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:10:45.688645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:10:45.688645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:10:45.688645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:10:45.688645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:10:45.688645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:10:45.688645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:10:45.688645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:10:45.688645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:10:45.688645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:10:45.688645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:10:45.688645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:10:45.688645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:10:45.689933 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:10:45.689933 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:10:45.689933 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:10:45.689933 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:10:45.689933 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:10:45.689933 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:10:45.689933 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:10:45.689933 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:10:45.689933 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:10:45.689933 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:10:45.689933 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:10:45.689933 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:10:45.689933 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:10:45.689933 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:10:45.689933 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:10:45.689933 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:10:45.689933 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:10:45.689933 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:10:45.690932 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:10:45.690932 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:10:45.690932 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:10:45.690932 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:10:45.690932 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:10:45.690932 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:10:45.690932 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:10:45.690932 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:10:45.690932 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 05 02:10:45.690932 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:10:45.690932 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 622/1239] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:10:45 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:10:45.695970 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfbe350-84e5-4ee5-96a6-032ed98ea6c8 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:45.804420 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cfbe350-84e5-4ee5-96a6-032ed98ea6c8 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:45.853426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e2ac5-7819-41ce-acd7-62240d0e7846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:45.855281 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e2ac5-7819-41ce-acd7-62240d0e7846 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:45.855657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e2ac5-7819-41ce-acd7-62240d0e7846 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:45.855914 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700e2ac5-7819-41ce-acd7-62240d0e7846 None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:45.856756 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e2ac5-7819-41ce-acd7-62240d0e7846 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:10:45.857066 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e2ac5-7819-41ce-acd7-62240d0e7846 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:45.858514 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700e2ac5-7819-41ce-acd7-62240d0e7846 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:45.878805 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 618/1240] 10.222.0.15 () {56 vars in 1143 bytes} [Fri Aug 5 02:10:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:10:45.885514 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ed5a8-d859-42ad-9136-48b6b863f807 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:45.998846 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115ed5a8-d859-42ad-9136-48b6b863f807 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:46.036009 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff438b1-defc-4d1c-ac40-a60ad7522966 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:46.036659 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff438b1-defc-4d1c-ac40-a60ad7522966 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:46.036939 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff438b1-defc-4d1c-ac40-a60ad7522966 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:46.037217 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ff438b1-defc-4d1c-ac40-a60ad7522966 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:46.109984 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:46.119071 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff438b1-defc-4d1c-ac40-a60ad7522966 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:46.120914 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ff438b1-defc-4d1c-ac40-a60ad7522966 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:46.230759 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 623/1241] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:10:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 02:10:46.236774 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e2ac5-7819-41ce-acd7-62240d0e7846 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:46.267510 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:46.346926 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700e2ac5-7819-41ce-acd7-62240d0e7846 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:46.384718 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d249acd-3387-4409-9378-906d8cc9d18f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:46.385736 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d249acd-3387-4409-9378-906d8cc9d18f None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:46.386160 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d249acd-3387-4409-9378-906d8cc9d18f None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:46.386465 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d249acd-3387-4409-9378-906d8cc9d18f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:46.398264 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d249acd-3387-4409-9378-906d8cc9d18f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:46.400310 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d249acd-3387-4409-9378-906d8cc9d18f None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:46.419017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-1d249acd-3387-4409-9378-906d8cc9d18f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:10:46.419017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:10:46.419017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:10:46.419017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:10:46.419017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:10:46.419017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:10:46.419017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:10:46.419017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:10:46.419017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:10:46.419017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:10:46.419017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:10:46.419017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:10:46.419017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:10:46.419017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:10:46.419017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:10:46.420155 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:10:46.420155 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:10:46.420155 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:10:46.420155 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:10:46.420155 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:10:46.420155 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:10:46.420155 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:10:46.420155 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:10:46.420155 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:10:46.420155 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:10:46.420155 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:10:46.420155 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:10:46.420155 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:10:46.420155 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:10:46.420155 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:10:46.420155 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:10:46.420155 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:10:46.421257 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:10:46.421257 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:10:46.421257 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:10:46.421257 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:10:46.421257 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 619/1242] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:10:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:10:46.427129 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff438b1-defc-4d1c-ac40-a60ad7522966 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:46.541703 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:46.549418 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ff438b1-defc-4d1c-ac40-a60ad7522966 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:46.597358 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1ede2-1206-4153-aa82-3232c3d63773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:46.598081 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1ede2-1206-4153-aa82-3232c3d63773 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:46.598441 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1ede2-1206-4153-aa82-3232c3d63773 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:46.598747 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b1ede2-1206-4153-aa82-3232c3d63773 None admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:46.599545 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b1ede2-1206-4153-aa82-3232c3d63773 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:10:46.599852 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b1ede2-1206-4153-aa82-3232c3d63773 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:46.601351 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7b1ede2-1206-4153-aa82-3232c3d63773 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:46.614838 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 624/1243] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:10:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:10:46.620679 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d249acd-3387-4409-9378-906d8cc9d18f None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:46.702789 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:46.725133 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d249acd-3387-4409-9378-906d8cc9d18f None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:46.761025 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fab70f-90f6-49ff-8386-5978a1c94d09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:46.761719 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fab70f-90f6-49ff-8386-5978a1c94d09 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:46.762030 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fab70f-90f6-49ff-8386-5978a1c94d09 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:46.762299 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3fab70f-90f6-49ff-8386-5978a1c94d09 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:46.769169 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fab70f-90f6-49ff-8386-5978a1c94d09 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:46.770588 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3fab70f-90f6-49ff-8386-5978a1c94d09 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:46.785443 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-a3fab70f-90f6-49ff-8386-5978a1c94d09 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:10:46.785443 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:10:46.785443 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:10:46.785443 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:10:46.785443 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:10:46.785443 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:10:46.785443 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:10:46.785443 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:10:46.785443 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:10:46.785443 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:10:46.785443 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:10:46.785443 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:10:46.785443 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:10:46.785443 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:10:46.785443 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:10:46.786544 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:10:46.786544 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:10:46.786544 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:10:46.786544 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:10:46.786544 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:10:46.786544 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:10:46.786544 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:10:46.786544 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:10:46.786544 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:10:46.786544 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:10:46.786544 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:10:46.786544 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:10:46.786544 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:10:46.786544 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:10:46.786544 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:10:46.786544 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:10:46.786544 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:10:46.792574 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:10:46.792574 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:10:46.792574 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:10:46.792574 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:10:46.792574 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:10:46.792574 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:10:46.792574 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:10:46.792574 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:10:46.792574 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 620/1244] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:10:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:10:46.793176 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1ede2-1206-4153-aa82-3232c3d63773 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:46.907915 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b1ede2-1206-4153-aa82-3232c3d63773 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:46.945811 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5230f5-86a9-4079-ace8-69aedf0dfb97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:46.946482 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5230f5-86a9-4079-ace8-69aedf0dfb97 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:46.946699 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5230f5-86a9-4079-ace8-69aedf0dfb97 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:46.946981 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5230f5-86a9-4079-ace8-69aedf0dfb97 None admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:46.948386 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5230f5-86a9-4079-ace8-69aedf0dfb97 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:10:46.948846 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5230f5-86a9-4079-ace8-69aedf0dfb97 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:46.950268 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5230f5-86a9-4079-ace8-69aedf0dfb97 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:46.968917 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 625/1245] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Aug 5 02:10:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:10:46.970145 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fab70f-90f6-49ff-8386-5978a1c94d09 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:47.093204 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3fab70f-90f6-49ff-8386-5978a1c94d09 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:47.136937 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baf31a2-db38-4cad-b66c-ff346e26728f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:47.137610 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf31a2-db38-4cad-b66c-ff346e26728f None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:47.137855 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf31a2-db38-4cad-b66c-ff346e26728f None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:47.138193 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baf31a2-db38-4cad-b66c-ff346e26728f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:47.139102 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baf31a2-db38-4cad-b66c-ff346e26728f None admin] RBAC: Adding query filter params (role.id=876fd0d181d74df4bbc73b2db1c42fbe, scope.project.id=95d88dece7184bf1842c4f8d275d52cd, user.id=e84ea976b5914aea94c4d8f805139daf) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:10:47.139475 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baf31a2-db38-4cad-b66c-ff346e26728f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:47.141140 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baf31a2-db38-4cad-b66c-ff346e26728f None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:47.148108 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 621/1246] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:10:46 2022] GET /identity/v3/role_assignments?user.id=e84ea976b5914aea94c4d8f805139daf&scope.project.id=95d88dece7184bf1842c4f8d275d52cd&role.id=876fd0d181d74df4bbc73b2db1c42fbe => generated 608 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:10:49.412929 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c4609-b5ce-457f-870b-0fc9eff3d8cc None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:49.413467 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c4609-b5ce-457f-870b-0fc9eff3d8cc None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:49.413467 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44c4609-b5ce-457f-870b-0fc9eff3d8cc None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:49.414801 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 626/1247] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:10:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:10:49.421418 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64f286-cdd2-4c04-8838-c846085a2d34 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:49.421859 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64f286-cdd2-4c04-8838-c846085a2d34 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:49.421950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c64f286-cdd2-4c04-8838-c846085a2d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:49.429043 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:49.443688 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-0c64f286-cdd2-4c04-8838-c846085a2d34 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:10:49.445046 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-0c64f286-cdd2-4c04-8838-c846085a2d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:10:49.519438 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 622/1248] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:10:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:10:49.544085 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c4609-b5ce-457f-870b-0fc9eff3d8cc None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:49.567541 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:49.660556 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44c4609-b5ce-457f-870b-0fc9eff3d8cc None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:49.699577 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7fa535-8abe-44c5-86d5-579a2cf037bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:49.700395 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fa535-8abe-44c5-86d5-579a2cf037bd None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:49.700646 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fa535-8abe-44c5-86d5-579a2cf037bd None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:49.700973 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d7fa535-8abe-44c5-86d5-579a2cf037bd None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:49.711633 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d7fa535-8abe-44c5-86d5-579a2cf037bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:10:49.718572 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-4d7fa535-8abe-44c5-86d5-579a2cf037bd None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:10:49.718572 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:10:49.718572 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:10:49.718572 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:10:49.718572 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:10:49.718572 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:10:49.718572 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:10:49.718572 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:10:49.718572 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:10:49.718572 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:10:49.718572 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:10:49.718572 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:10:49.718572 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:10:49.718572 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:10:49.718572 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:10:49.718572 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:10:49.720677 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:10:49.720677 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:10:49.720677 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:10:49.720677 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:10:49.720677 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:10:49.720677 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:10:49.720677 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:10:49.720677 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:10:49.720677 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:10:49.720677 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:10:49.720677 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:10:49.720677 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:10:49.720677 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:10:49.720677 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:10:49.720677 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:10:49.720677 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:10:49.722590 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:10:49.722590 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:10:49.722590 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:10:49.722590 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:10:49.722590 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:10:49.722590 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:10:49.722590 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:10:49.722590 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:10:49.722590 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:10:49.722590 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:10:49.722590 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:10:49.722590 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:10:49.722590 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 627/1249] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Aug 5 02:10:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:10:49.726191 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64f286-cdd2-4c04-8838-c846085a2d34 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:49.853668 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c64f286-cdd2-4c04-8838-c846085a2d34 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:49.887966 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:49.893085 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c83269-8da9-4a6a-a778-eec5724da2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:49.893709 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c83269-8da9-4a6a-a778-eec5724da2c2 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:49.893985 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c83269-8da9-4a6a-a778-eec5724da2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:49.894257 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c83269-8da9-4a6a-a778-eec5724da2c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:49.895826 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c83269-8da9-4a6a-a778-eec5724da2c2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:10:49.896138 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c83269-8da9-4a6a-a778-eec5724da2c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:49.897521 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c83269-8da9-4a6a-a778-eec5724da2c2 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:49.906532 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 623/1250] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:10:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:10:49.912501 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7fa535-8abe-44c5-86d5-579a2cf037bd None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:49.999230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:50.027311 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d7fa535-8abe-44c5-86d5-579a2cf037bd None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:50.064804 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd934e16-bfa2-499c-a564-a8c8e23fb821 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:50.065450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd934e16-bfa2-499c-a564-a8c8e23fb821 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:50.065725 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd934e16-bfa2-499c-a564-a8c8e23fb821 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:50.066009 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd934e16-bfa2-499c-a564-a8c8e23fb821 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:50.076964 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd934e16-bfa2-499c-a564-a8c8e23fb821 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:50.078430 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd934e16-bfa2-499c-a564-a8c8e23fb821 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:50.094104 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-cd934e16-bfa2-499c-a564-a8c8e23fb821 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:10:50.094104 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:10:50.094104 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:10:50.094104 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:10:50.094104 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:10:50.094104 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:10:50.094104 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:10:50.094104 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:10:50.094104 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:10:50.094104 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:10:50.094104 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:10:50.094104 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:10:50.094104 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:10:50.094104 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:10:50.094104 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:10:50.095261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:10:50.095261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:10:50.095261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:10:50.095261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:10:50.095261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:10:50.095261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:10:50.095261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:10:50.095261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:10:50.095261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:10:50.095261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:10:50.095261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:10:50.095261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:10:50.095261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:10:50.095261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:10:50.095261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:10:50.095261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:10:50.095261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:10:50.096362 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:10:50.096362 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:10:50.096362 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:10:50.096362 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:10:50.100210 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 628/1251] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:10:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:10:50.101212 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c83269-8da9-4a6a-a778-eec5724da2c2 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:50.216298 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c83269-8da9-4a6a-a778-eec5724da2c2 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:50.253856 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4a871-1c8e-4268-8ca6-e51f3be7dd5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:50.254402 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4a871-1c8e-4268-8ca6-e51f3be7dd5a None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:50.254681 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4a871-1c8e-4268-8ca6-e51f3be7dd5a None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:50.254952 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e4a871-1c8e-4268-8ca6-e51f3be7dd5a None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:50.255659 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4a871-1c8e-4268-8ca6-e51f3be7dd5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:10:50.255944 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4a871-1c8e-4268-8ca6-e51f3be7dd5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:50.257315 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e4a871-1c8e-4268-8ca6-e51f3be7dd5a None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:50.270131 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 624/1252] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:10:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:10:50.276033 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd934e16-bfa2-499c-a564-a8c8e23fb821 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:50.388272 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd934e16-bfa2-499c-a564-a8c8e23fb821 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:50.419401 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:50.428785 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f4706-0534-45ca-b65b-ea36d7a87f30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:50.429442 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f4706-0534-45ca-b65b-ea36d7a87f30 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:50.429781 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f4706-0534-45ca-b65b-ea36d7a87f30 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:50.430103 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7f4706-0534-45ca-b65b-ea36d7a87f30 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:50.439667 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f4706-0534-45ca-b65b-ea36d7a87f30 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:50.441329 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7f4706-0534-45ca-b65b-ea36d7a87f30 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:50.454450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-9f7f4706-0534-45ca-b65b-ea36d7a87f30 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 05 02:10:50.454450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:10:50.454450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:10:50.454450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:10:50.454450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:10:50.454450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:10:50.454450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:10:50.454450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:10:50.454450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:10:50.454450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:10:50.454450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:10:50.454450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:10:50.454450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:10:50.454450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:10:50.454450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:10:50.454450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:10:50.455647 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:10:50.455647 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:10:50.455647 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:10:50.455647 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:10:50.455647 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:10:50.455647 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:10:50.455647 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:10:50.455647 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:10:50.455647 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:10:50.455647 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:10:50.455647 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:10:50.455647 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:10:50.455647 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:10:50.455647 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:10:50.455647 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:10:50.455647 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:10:50.455647 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:10:50.455647 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:10:50.456649 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:10:50.456649 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:10:50.456649 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:10:50.456649 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:10:50.456649 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:10:50.456649 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:10:50.456649 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:10:50.456649 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:10:50.456649 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 05 02:10:50.456649 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:10:50.456649 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 629/1253] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:10:50 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 05 02:10:50.462573 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4a871-1c8e-4268-8ca6-e51f3be7dd5a None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:50.524538 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:50.583813 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e4a871-1c8e-4268-8ca6-e51f3be7dd5a None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:50.624551 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523608a-96e9-4ad8-81c2-f96a15d62b9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:50.625281 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523608a-96e9-4ad8-81c2-f96a15d62b9f None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:50.625559 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523608a-96e9-4ad8-81c2-f96a15d62b9f None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:50.625831 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d523608a-96e9-4ad8-81c2-f96a15d62b9f None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:50.626686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523608a-96e9-4ad8-81c2-f96a15d62b9f None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:10:50.626983 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523608a-96e9-4ad8-81c2-f96a15d62b9f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:50.628421 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d523608a-96e9-4ad8-81c2-f96a15d62b9f None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:50.647840 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 625/1254] 10.222.0.15 () {56 vars in 1143 bytes} [Fri Aug 5 02:10:50 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:10:50.654452 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f4706-0534-45ca-b65b-ea36d7a87f30 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:50.773109 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7f4706-0534-45ca-b65b-ea36d7a87f30 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:50.815634 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb7fd9-146f-4e6c-85d7-262e21f4dc07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:50.816230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb7fd9-146f-4e6c-85d7-262e21f4dc07 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:50.816586 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb7fd9-146f-4e6c-85d7-262e21f4dc07 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:50.816917 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbeb7fd9-146f-4e6c-85d7-262e21f4dc07 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:50.886011 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:50.901695 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb7fd9-146f-4e6c-85d7-262e21f4dc07 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:50.903142 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbeb7fd9-146f-4e6c-85d7-262e21f4dc07 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:51.025861 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 630/1255] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:10:50 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 02:10:51.027089 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523608a-96e9-4ad8-81c2-f96a15d62b9f None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:51.139412 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d523608a-96e9-4ad8-81c2-f96a15d62b9f None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:51.153255 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:51.177325 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e305c-9349-4c0a-ab98-d022a0581902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:51.178067 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e305c-9349-4c0a-ab98-d022a0581902 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:51.178418 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e305c-9349-4c0a-ab98-d022a0581902 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:51.178733 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed7e305c-9349-4c0a-ab98-d022a0581902 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:51.191141 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e305c-9349-4c0a-ab98-d022a0581902 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:51.192623 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed7e305c-9349-4c0a-ab98-d022a0581902 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:51.209675 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-ed7e305c-9349-4c0a-ab98-d022a0581902 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:10:51.209675 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:10:51.209675 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:10:51.209675 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:10:51.209675 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:10:51.209675 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:10:51.209675 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:10:51.209675 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:10:51.209675 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:10:51.209675 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:10:51.209675 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:10:51.209675 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:10:51.209675 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:10:51.209675 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:10:51.209675 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:10:51.210839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:10:51.210839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:10:51.210839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:10:51.210839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:10:51.210839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:10:51.210839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:10:51.210839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:10:51.210839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:10:51.210839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:10:51.210839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:10:51.210839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:10:51.210839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:10:51.210839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:10:51.210839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:10:51.210839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:10:51.210839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:10:51.210839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:10:51.211767 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:10:51.211767 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:10:51.211767 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:10:51.211767 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:10:51.211767 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 626/1256] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:10:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:10:51.220374 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb7fd9-146f-4e6c-85d7-262e21f4dc07 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:51.313248 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:51.325660 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbeb7fd9-146f-4e6c-85d7-262e21f4dc07 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:51.365915 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9541e8e-947c-4709-b550-8b71e8afce52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:51.366532 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9541e8e-947c-4709-b550-8b71e8afce52 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:51.366807 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9541e8e-947c-4709-b550-8b71e8afce52 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:51.367078 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9541e8e-947c-4709-b550-8b71e8afce52 None admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:51.367760 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9541e8e-947c-4709-b550-8b71e8afce52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:10:51.368061 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9541e8e-947c-4709-b550-8b71e8afce52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:51.369573 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9541e8e-947c-4709-b550-8b71e8afce52 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:51.382391 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 631/1257] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:10:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:10:51.388452 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e305c-9349-4c0a-ab98-d022a0581902 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:51.501617 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed7e305c-9349-4c0a-ab98-d022a0581902 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:51.541360 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9774b72-6d49-4af0-bfed-aa52b72701d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:51.542056 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9774b72-6d49-4af0-bfed-aa52b72701d4 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:51.542384 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9774b72-6d49-4af0-bfed-aa52b72701d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:51.542686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9774b72-6d49-4af0-bfed-aa52b72701d4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:51.550712 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9774b72-6d49-4af0-bfed-aa52b72701d4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:51.552529 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9774b72-6d49-4af0-bfed-aa52b72701d4 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:51.567537 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-e9774b72-6d49-4af0-bfed-aa52b72701d4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:10:51.567537 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:10:51.567537 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:10:51.567537 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:10:51.567537 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:10:51.567537 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:10:51.567537 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:10:51.567537 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:10:51.567537 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:10:51.567537 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:10:51.567537 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:10:51.567537 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:10:51.567537 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:10:51.567537 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:10:51.567537 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:10:51.568604 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:10:51.568604 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:10:51.568604 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:10:51.568604 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:10:51.568604 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:10:51.568604 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:10:51.568604 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:10:51.568604 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:10:51.568604 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:10:51.568604 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:10:51.568604 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:10:51.568604 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:10:51.568604 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:10:51.568604 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:10:51.568604 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:10:51.568604 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:10:51.568604 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:10:51.569544 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:10:51.569544 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:10:51.569544 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:10:51.569544 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:10:51.569544 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:10:51.569544 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:10:51.569544 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:10:51.569544 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:10:51.569544 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 627/1258] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:10:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:10:51.576140 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9541e8e-947c-4709-b550-8b71e8afce52 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:51.690522 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9541e8e-947c-4709-b550-8b71e8afce52 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:51.730765 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88be0aa-fdd1-449b-b1e0-6477459db6b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:51.731410 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88be0aa-fdd1-449b-b1e0-6477459db6b3 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:51.731719 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88be0aa-fdd1-449b-b1e0-6477459db6b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:51.731971 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88be0aa-fdd1-449b-b1e0-6477459db6b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:51.732748 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88be0aa-fdd1-449b-b1e0-6477459db6b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:10:51.733084 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88be0aa-fdd1-449b-b1e0-6477459db6b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:51.734473 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88be0aa-fdd1-449b-b1e0-6477459db6b3 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:51.746754 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 632/1259] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Aug 5 02:10:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:10:51.753018 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9774b72-6d49-4af0-bfed-aa52b72701d4 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:51.783077 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:51.864128 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9774b72-6d49-4af0-bfed-aa52b72701d4 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:51.902362 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e8f5a9-8028-4601-a377-ed3526d80818 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:51.903026 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8f5a9-8028-4601-a377-ed3526d80818 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:51.903342 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8f5a9-8028-4601-a377-ed3526d80818 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:51.903671 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e8f5a9-8028-4601-a377-ed3526d80818 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:51.904559 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8f5a9-8028-4601-a377-ed3526d80818 None admin] RBAC: Adding query filter params (role.id=e1b75d5eea2a43b2b1b14cf0515350fa, scope.project.id=95d88dece7184bf1842c4f8d275d52cd, user.id=e84ea976b5914aea94c4d8f805139daf) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:10:51.904862 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8f5a9-8028-4601-a377-ed3526d80818 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:51.906424 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e8f5a9-8028-4601-a377-ed3526d80818 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:51.912250 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 628/1260] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:10:51 2022] GET /identity/v3/role_assignments?user.id=e84ea976b5914aea94c4d8f805139daf&scope.project.id=95d88dece7184bf1842c4f8d275d52cd&role.id=e1b75d5eea2a43b2b1b14cf0515350fa => generated 259 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:10:53.910373 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476530db-0d6e-4232-9f09-5314aee9bd90 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:53.910949 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476530db-0d6e-4232-9f09-5314aee9bd90 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:53.910949 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-476530db-0d6e-4232-9f09-5314aee9bd90 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:53.912233 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 633/1261] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:10:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:10:53.917650 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29665a61-f127-4e2e-bc4f-b01d2a233681 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:53.918047 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29665a61-f127-4e2e-bc4f-b01d2a233681 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:53.918204 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29665a61-f127-4e2e-bc4f-b01d2a233681 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:53.936473 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-29665a61-f127-4e2e-bc4f-b01d2a233681 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:10:53.937651 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-29665a61-f127-4e2e-bc4f-b01d2a233681 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:10:54.003625 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 629/1262] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:10:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:10:54.026486 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476530db-0d6e-4232-9f09-5314aee9bd90 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:54.037072 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:54.125705 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-476530db-0d6e-4232-9f09-5314aee9bd90 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:54.159646 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eee7f6-c14c-4ef9-89a4-817a4cb8a16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:54.160263 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eee7f6-c14c-4ef9-89a4-817a4cb8a16e None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:54.160574 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eee7f6-c14c-4ef9-89a4-817a4cb8a16e None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:54.160853 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64eee7f6-c14c-4ef9-89a4-817a4cb8a16e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:54.170721 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64eee7f6-c14c-4ef9-89a4-817a4cb8a16e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:10:54.175643 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-64eee7f6-c14c-4ef9-89a4-817a4cb8a16e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:10:54.175643 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:10:54.175643 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:10:54.175643 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:10:54.175643 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:10:54.175643 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:10:54.175643 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:10:54.175643 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:10:54.175643 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:10:54.175643 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:10:54.175643 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:10:54.175643 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:10:54.175643 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:10:54.175643 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:10:54.175643 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:10:54.175643 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:10:54.176750 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:10:54.176750 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:10:54.176750 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:10:54.176750 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:10:54.176750 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:10:54.176750 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:10:54.176750 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:10:54.176750 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:10:54.176750 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:10:54.176750 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:10:54.176750 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:10:54.176750 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:10:54.176750 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:10:54.176750 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:10:54.176750 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:10:54.176750 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:10:54.177755 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:10:54.177755 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:10:54.177755 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:10:54.177755 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:10:54.177755 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:10:54.177755 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:10:54.177755 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:10:54.177755 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:10:54.177755 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:10:54.177755 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:10:54.177755 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:10:54.177755 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:10:54.177755 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 634/1263] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Aug 5 02:10:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:10:54.183313 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29665a61-f127-4e2e-bc4f-b01d2a233681 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:54.201858 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:54.281566 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29665a61-f127-4e2e-bc4f-b01d2a233681 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:54.315349 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21774d1-d699-4088-8678-516f0aedf8ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:54.315948 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21774d1-d699-4088-8678-516f0aedf8ca None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:54.316225 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21774d1-d699-4088-8678-516f0aedf8ca None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:54.316522 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21774d1-d699-4088-8678-516f0aedf8ca None admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:54.317229 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21774d1-d699-4088-8678-516f0aedf8ca None admin] RBAC: Adding query filter params (name=admin) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:10:54.317529 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21774d1-d699-4088-8678-516f0aedf8ca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:54.318889 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21774d1-d699-4088-8678-516f0aedf8ca None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:54.327475 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 630/1264] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:10:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:10:54.333355 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eee7f6-c14c-4ef9-89a4-817a4cb8a16e None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:54.398245 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:54.430975 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64eee7f6-c14c-4ef9-89a4-817a4cb8a16e None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:54.464732 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7439c-47d4-4fc1-be89-3f750e508316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:54.465366 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7439c-47d4-4fc1-be89-3f750e508316 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:54.465647 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7439c-47d4-4fc1-be89-3f750e508316 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:54.465926 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d7439c-47d4-4fc1-be89-3f750e508316 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:54.475574 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d7439c-47d4-4fc1-be89-3f750e508316 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:54.477041 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d7439c-47d4-4fc1-be89-3f750e508316 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:54.491907 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-93d7439c-47d4-4fc1-be89-3f750e508316 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:10:54.491907 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:10:54.491907 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:10:54.491907 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:10:54.491907 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:10:54.491907 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:10:54.491907 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:10:54.491907 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:10:54.491907 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:10:54.491907 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:10:54.491907 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:10:54.491907 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:10:54.491907 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:10:54.491907 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:10:54.491907 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:10:54.493033 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:10:54.493033 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:10:54.493033 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:10:54.493033 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:10:54.493033 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:10:54.493033 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:10:54.493033 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:10:54.493033 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:10:54.493033 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:10:54.493033 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:10:54.493033 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:10:54.493033 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:10:54.493033 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:10:54.493033 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:10:54.493033 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:10:54.493033 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:10:54.493033 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:10:54.494159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:10:54.494159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:10:54.494159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:10:54.494159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:10:54.494159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 635/1265] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:10:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:10:54.499069 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21774d1-d699-4088-8678-516f0aedf8ca None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:54.586458 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:54.606991 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21774d1-d699-4088-8678-516f0aedf8ca None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:54.639585 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d50ae4-74bc-40f5-94a6-0be9a6a5eefc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:54.640192 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d50ae4-74bc-40f5-94a6-0be9a6a5eefc None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:54.640498 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d50ae4-74bc-40f5-94a6-0be9a6a5eefc None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:54.640772 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d50ae4-74bc-40f5-94a6-0be9a6a5eefc None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:54.641452 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d50ae4-74bc-40f5-94a6-0be9a6a5eefc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:10:54.641750 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d50ae4-74bc-40f5-94a6-0be9a6a5eefc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:54.643112 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d50ae4-74bc-40f5-94a6-0be9a6a5eefc None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:54.655024 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 631/1266] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:10:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:10:54.660658 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7439c-47d4-4fc1-be89-3f750e508316 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:54.756561 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d7439c-47d4-4fc1-be89-3f750e508316 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:54.776568 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:54.790514 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc73c9-a386-40a7-94f8-d3af5a52144b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:54.791135 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc73c9-a386-40a7-94f8-d3af5a52144b None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:54.791415 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc73c9-a386-40a7-94f8-d3af5a52144b None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:54.791687 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9bc73c9-a386-40a7-94f8-d3af5a52144b None admin] PATH_INFO: `/v3/users/placement` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:54.799667 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc73c9-a386-40a7-94f8-d3af5a52144b None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:54.801125 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9bc73c9-a386-40a7-94f8-d3af5a52144b None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:54.812224 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-e9bc73c9-a386-40a7-94f8-d3af5a52144b None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 05 02:10:54.812224 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:10:54.812224 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:10:54.812224 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:10:54.812224 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:10:54.812224 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:10:54.812224 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:10:54.812224 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:10:54.812224 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:10:54.812224 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:10:54.812224 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:10:54.812224 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:10:54.812224 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:10:54.812224 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:10:54.812224 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:10:54.812224 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:10:54.813330 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:10:54.813330 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:10:54.813330 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:10:54.813330 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:10:54.813330 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:10:54.813330 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:10:54.813330 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:10:54.813330 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:10:54.813330 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:10:54.813330 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:10:54.813330 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:10:54.813330 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:10:54.813330 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:10:54.813330 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:10:54.813330 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:10:54.813330 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:10:54.813330 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:10:54.813330 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:10:54.814563 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:10:54.814563 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:10:54.814563 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:10:54.814563 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:10:54.814563 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:10:54.814563 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:10:54.814563 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:10:54.814563 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:10:54.814563 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 05 02:10:54.814563 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:10:54.814563 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 636/1267] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:10:54 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:10:54.819088 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d50ae4-74bc-40f5-94a6-0be9a6a5eefc None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:54.917729 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d50ae4-74bc-40f5-94a6-0be9a6a5eefc None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:54.951171 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c98b2-47e7-4522-b702-b747e68f5c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:54.951778 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c98b2-47e7-4522-b702-b747e68f5c78 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:54.952058 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c98b2-47e7-4522-b702-b747e68f5c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:54.952355 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793c98b2-47e7-4522-b702-b747e68f5c78 None admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:54.953141 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793c98b2-47e7-4522-b702-b747e68f5c78 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:10:54.953452 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793c98b2-47e7-4522-b702-b747e68f5c78 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:54.954855 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793c98b2-47e7-4522-b702-b747e68f5c78 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:54.963333 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:54.972031 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 632/1268] 10.222.0.15 () {56 vars in 1143 bytes} [Fri Aug 5 02:10:54 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:10:54.977639 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc73c9-a386-40a7-94f8-d3af5a52144b None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:55.074750 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9bc73c9-a386-40a7-94f8-d3af5a52144b None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:55.108902 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60d026-a4ae-4102-b269-ed8bf788801e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:55.109532 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60d026-a4ae-4102-b269-ed8bf788801e None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:55.109812 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60d026-a4ae-4102-b269-ed8bf788801e None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:55.110085 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb60d026-a4ae-4102-b269-ed8bf788801e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:55.120538 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb60d026-a4ae-4102-b269-ed8bf788801e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:55.121977 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb60d026-a4ae-4102-b269-ed8bf788801e None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:55.135832 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-cb60d026-a4ae-4102-b269-ed8bf788801e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:10:55.135832 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:10:55.135832 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:10:55.135832 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:10:55.135832 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:10:55.135832 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:10:55.135832 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:10:55.135832 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:10:55.135832 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:10:55.135832 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:10:55.135832 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:10:55.135832 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:10:55.135832 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:10:55.135832 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:10:55.135832 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:10:55.136924 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:10:55.136924 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:10:55.136924 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:10:55.136924 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:10:55.136924 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:10:55.136924 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:10:55.136924 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:10:55.136924 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:10:55.136924 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:10:55.136924 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:10:55.136924 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:10:55.136924 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:10:55.136924 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:10:55.136924 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:10:55.136924 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:10:55.136924 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:10:55.136924 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:10:55.138196 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:10:55.138196 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:10:55.138196 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:10:55.138196 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:10:55.138196 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 637/1269] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:10:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:10:55.142662 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c98b2-47e7-4522-b702-b747e68f5c78 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:55.240141 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793c98b2-47e7-4522-b702-b747e68f5c78 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:55.272189 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09571a8-41f8-4ce3-8228-08594dd1220e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:55.272821 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09571a8-41f8-4ce3-8228-08594dd1220e None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:55.273100 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09571a8-41f8-4ce3-8228-08594dd1220e None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:55.273370 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09571a8-41f8-4ce3-8228-08594dd1220e None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:55.274048 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09571a8-41f8-4ce3-8228-08594dd1220e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:10:55.274348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09571a8-41f8-4ce3-8228-08594dd1220e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:55.276231 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09571a8-41f8-4ce3-8228-08594dd1220e None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:55.287028 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 633/1270] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:10:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:10:55.293327 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60d026-a4ae-4102-b269-ed8bf788801e None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:55.324778 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:55.391513 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb60d026-a4ae-4102-b269-ed8bf788801e None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:55.424450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f091f-9525-403f-a5d5-456f0e9e2fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:55.425077 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f091f-9525-403f-a5d5-456f0e9e2fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:55.425357 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f091f-9525-403f-a5d5-456f0e9e2fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:55.425633 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9f091f-9525-403f-a5d5-456f0e9e2fc7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:55.432106 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f091f-9525-403f-a5d5-456f0e9e2fc7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:55.433573 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9f091f-9525-403f-a5d5-456f0e9e2fc7 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:55.444674 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-5b9f091f-9525-403f-a5d5-456f0e9e2fc7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:10:55.444674 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:10:55.444674 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:10:55.444674 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:10:55.444674 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:10:55.444674 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:10:55.444674 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:10:55.444674 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:10:55.444674 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:10:55.444674 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:10:55.444674 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:10:55.444674 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:10:55.444674 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:10:55.444674 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:10:55.444674 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:10:55.445545 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:10:55.445545 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:10:55.445545 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:10:55.445545 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:10:55.445545 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:10:55.445545 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:10:55.445545 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:10:55.445545 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:10:55.445545 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:10:55.445545 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:10:55.445545 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:10:55.445545 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:10:55.445545 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:10:55.445545 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:10:55.445545 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:10:55.445545 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:10:55.445545 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:10:55.446433 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:10:55.446433 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:10:55.446433 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:10:55.446433 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:10:55.446433 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:10:55.446433 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:10:55.446433 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:10:55.446433 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:10:55.446433 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 638/1271] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:10:55 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:10:55.452233 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09571a8-41f8-4ce3-8228-08594dd1220e None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:55.508952 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:55.558902 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09571a8-41f8-4ce3-8228-08594dd1220e None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:55.592616 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbea7a4-afce-483e-b92a-cd5d096b8426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:55.593479 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbea7a4-afce-483e-b92a-cd5d096b8426 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:55.593479 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbea7a4-afce-483e-b92a-cd5d096b8426 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:55.593712 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbea7a4-afce-483e-b92a-cd5d096b8426 None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:55.594457 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbea7a4-afce-483e-b92a-cd5d096b8426 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:10:55.594761 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbea7a4-afce-483e-b92a-cd5d096b8426 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:55.596163 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbea7a4-afce-483e-b92a-cd5d096b8426 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:55.608231 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 634/1272] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Aug 5 02:10:55 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:10:55.614209 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f091f-9525-403f-a5d5-456f0e9e2fc7 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:55.706736 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:55.716181 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9f091f-9525-403f-a5d5-456f0e9e2fc7 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:55.748006 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab0068c-2988-4884-bc4e-247581eec87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:55.748678 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0068c-2988-4884-bc4e-247581eec87d None admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:55.748959 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0068c-2988-4884-bc4e-247581eec87d None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:55.749229 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab0068c-2988-4884-bc4e-247581eec87d None admin] PATH_INFO: `/v3/projects/95d88dece7184bf1842c4f8d275d52cd/users/e84ea976b5914aea94c4d8f805139daf/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:55.751077 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0068c-2988-4884-bc4e-247581eec87d None admin] RBAC: Authorizing `identity:create_grant(project_id=95d88dece7184bf1842c4f8d275d52cd, user_id=e84ea976b5914aea94c4d8f805139daf, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:55.752576 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab0068c-2988-4884-bc4e-247581eec87d None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:55.764808 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 639/1273] 10.222.0.15 () {58 vars in 1439 bytes} [Fri Aug 5 02:10:55 2022] PUT /identity/v3/projects/95d88dece7184bf1842c4f8d275d52cd/users/e84ea976b5914aea94c4d8f805139daf/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:10:57.788700 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45260ab-e213-4590-9858-af603e1b4473 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:57.789259 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45260ab-e213-4590-9858-af603e1b4473 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:57.789259 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45260ab-e213-4590-9858-af603e1b4473 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:57.791123 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 635/1274] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:10:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:10:57.796253 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a9d65-5ba1-41ea-b42d-b1e2db7f09f7 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:57.796797 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a9d65-5ba1-41ea-b42d-b1e2db7f09f7 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:57.796900 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9a9d65-5ba1-41ea-b42d-b1e2db7f09f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:57.814594 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-ef9a9d65-5ba1-41ea-b42d-b1e2db7f09f7 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:10:57.815780 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-ef9a9d65-5ba1-41ea-b42d-b1e2db7f09f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:10:57.881260 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 640/1275] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:10:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:10:57.905169 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45260ab-e213-4590-9858-af603e1b4473 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:58.016431 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45260ab-e213-4590-9858-af603e1b4473 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:58.033104 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:58.049944 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b31fe-ce05-4c57-a68b-01c1919a3988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:58.050503 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b31fe-ce05-4c57-a68b-01c1919a3988 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:58.050777 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b31fe-ce05-4c57-a68b-01c1919a3988 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:58.051044 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b31fe-ce05-4c57-a68b-01c1919a3988 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:58.061670 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f84b31fe-ce05-4c57-a68b-01c1919a3988 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 05 02:10:58.066535 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-f84b31fe-ce05-4c57-a68b-01c1919a3988 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:10:58.066535 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:10:58.066535 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:10:58.066535 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:10:58.066535 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:10:58.066535 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:10:58.066535 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:10:58.066535 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:10:58.066535 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:10:58.066535 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:10:58.066535 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:10:58.066535 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:10:58.066535 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 05 02:10:58.066535 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 05 02:10:58.066535 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 05 02:10:58.066535 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 05 02:10:58.067632 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 05 02:10:58.067632 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 05 02:10:58.067632 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 05 02:10:58.067632 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 05 02:10:58.067632 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:10:58.067632 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:10:58.067632 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:10:58.067632 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:10:58.067632 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:10:58.067632 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:10:58.067632 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:10:58.067632 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:10:58.067632 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:10:58.067632 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:10:58.067632 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:10:58.067632 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:10:58.068645 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:10:58.068645 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:10:58.068645 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:10:58.068645 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:10:58.068645 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 05 02:10:58.068645 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 05 02:10:58.068645 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 05 02:10:58.068645 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 05 02:10:58.068645 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 05 02:10:58.068645 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 05 02:10:58.068645 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 05 02:10:58.068645 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:10:58.068645 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 636/1276] 10.222.0.15 () {56 vars in 1096 bytes} [Fri Aug 5 02:10:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:10:58.074693 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a9d65-5ba1-41ea-b42d-b1e2db7f09f7 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:58.152346 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:58.170822 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9a9d65-5ba1-41ea-b42d-b1e2db7f09f7 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:58.204976 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa9a59-f85b-48a5-a009-08418f445fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:58.205575 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa9a59-f85b-48a5-a009-08418f445fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:58.205853 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa9a59-f85b-48a5-a009-08418f445fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:58.206125 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51fa9a59-f85b-48a5-a009-08418f445fd7 None admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:58.206829 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa9a59-f85b-48a5-a009-08418f445fd7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:10:58.207129 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa9a59-f85b-48a5-a009-08418f445fd7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:58.208538 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51fa9a59-f85b-48a5-a009-08418f445fd7 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:58.216761 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 641/1277] 10.222.0.15 () {56 vars in 1099 bytes} [Fri Aug 5 02:10:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:10:58.222377 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b31fe-ce05-4c57-a68b-01c1919a3988 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:58.325837 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b31fe-ce05-4c57-a68b-01c1919a3988 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:58.359485 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0152c9-0745-4b9b-bcdc-908f1fb058a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:58.360116 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0152c9-0745-4b9b-bcdc-908f1fb058a3 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:58.360421 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0152c9-0745-4b9b-bcdc-908f1fb058a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:58.360695 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0152c9-0745-4b9b-bcdc-908f1fb058a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:58.371304 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0152c9-0745-4b9b-bcdc-908f1fb058a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:58.372774 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba0152c9-0745-4b9b-bcdc-908f1fb058a3 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:58.387200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-ba0152c9-0745-4b9b-bcdc-908f1fb058a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:10:58.387200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:10:58.387200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:10:58.387200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:10:58.387200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:10:58.387200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:10:58.387200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:10:58.387200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:10:58.387200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:10:58.387200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:10:58.387200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:10:58.387200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:10:58.387200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:10:58.387200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:10:58.387200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:10:58.388251 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:10:58.388251 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:10:58.388251 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:10:58.388251 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:10:58.388251 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:10:58.388251 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:10:58.388251 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:10:58.388251 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:10:58.388251 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:10:58.388251 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:10:58.388251 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:10:58.388251 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:10:58.388251 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:10:58.388251 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:10:58.388251 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:10:58.388251 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:10:58.388251 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:10:58.393437 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:10:58.393437 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:10:58.393437 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:10:58.393437 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:10:58.393437 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 637/1278] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:10:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:10:58.394153 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa9a59-f85b-48a5-a009-08418f445fd7 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:58.490403 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51fa9a59-f85b-48a5-a009-08418f445fd7 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:58.522985 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8aa3fa-9eed-487d-8ada-981a0e3c15c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:58.523767 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8aa3fa-9eed-487d-8ada-981a0e3c15c3 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:58.524088 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8aa3fa-9eed-487d-8ada-981a0e3c15c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:58.524428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8aa3fa-9eed-487d-8ada-981a0e3c15c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:58.525320 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8aa3fa-9eed-487d-8ada-981a0e3c15c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:10:58.525681 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8aa3fa-9eed-487d-8ada-981a0e3c15c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:58.527232 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee8aa3fa-9eed-487d-8ada-981a0e3c15c3 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:58.540008 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 642/1279] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:10:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:10:58.547052 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0152c9-0745-4b9b-bcdc-908f1fb058a3 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:58.578140 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:58.646303 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0152c9-0745-4b9b-bcdc-908f1fb058a3 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:58.679363 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e28f5-0981-4354-840b-05ec6e496f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:58.679988 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e28f5-0981-4354-840b-05ec6e496f21 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:58.680271 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e28f5-0981-4354-840b-05ec6e496f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:58.680574 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553e28f5-0981-4354-840b-05ec6e496f21 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:58.687783 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e28f5-0981-4354-840b-05ec6e496f21 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:58.689240 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553e28f5-0981-4354-840b-05ec6e496f21 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:58.700252 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-553e28f5-0981-4354-840b-05ec6e496f21 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 05 02:10:58.700252 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:10:58.700252 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:10:58.700252 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:10:58.700252 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:10:58.700252 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:10:58.700252 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:10:58.700252 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:10:58.700252 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:10:58.700252 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:10:58.700252 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:10:58.700252 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:10:58.700252 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 05 02:10:58.700252 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 05 02:10:58.700252 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 05 02:10:58.700252 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 05 02:10:58.701205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:10:58.701205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:10:58.701205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 05 02:10:58.701205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:10:58.701205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 05 02:10:58.701205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 05 02:10:58.701205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:10:58.701205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:10:58.701205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:10:58.701205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:10:58.701205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:10:58.701205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:10:58.701205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:10:58.701205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:10:58.701205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:10:58.701205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:10:58.701205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:10:58.701205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:10:58.702187 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:10:58.702187 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:10:58.702187 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 05 02:10:58.702187 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 05 02:10:58.702187 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 05 02:10:58.702187 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 05 02:10:58.702187 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 05 02:10:58.702187 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 05 02:10:58.702187 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 05 02:10:58.702187 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:10:58.702187 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 638/1280] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:10:58 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:10:58.707083 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8aa3fa-9eed-487d-8ada-981a0e3c15c3 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:58.710802 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:58.805226 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee8aa3fa-9eed-487d-8ada-981a0e3c15c3 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:58.838442 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd6de01-129f-4044-8013-a8c9774507fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:58.839313 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6de01-129f-4044-8013-a8c9774507fb None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:58.839593 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6de01-129f-4044-8013-a8c9774507fb None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:58.839868 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd6de01-129f-4044-8013-a8c9774507fb None admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:58.840693 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd6de01-129f-4044-8013-a8c9774507fb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:10:58.841000 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd6de01-129f-4044-8013-a8c9774507fb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:58.842454 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bd6de01-129f-4044-8013-a8c9774507fb None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:58.859395 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 643/1281] 10.222.0.15 () {56 vars in 1143 bytes} [Fri Aug 5 02:10:58 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:10:58.865016 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e28f5-0981-4354-840b-05ec6e496f21 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:58.951685 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:58.961022 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553e28f5-0981-4354-840b-05ec6e496f21 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:58.994516 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55608d-7e57-4758-8190-d39e3e636857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:58.995112 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55608d-7e57-4758-8190-d39e3e636857 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:58.995390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55608d-7e57-4758-8190-d39e3e636857 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:58.995660 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55608d-7e57-4758-8190-d39e3e636857 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:59.060095 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e55608d-7e57-4758-8190-d39e3e636857 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:59.061543 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e55608d-7e57-4758-8190-d39e3e636857 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:59.146489 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:59.156994 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 639/1282] 10.222.0.15 () {58 vars in 1282 bytes} [Fri Aug 5 02:10:58 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 05 02:10:59.162738 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd6de01-129f-4044-8013-a8c9774507fb None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:59.222524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:59.261468 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd6de01-129f-4044-8013-a8c9774507fb None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:59.295081 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99392496-303d-4dc4-bb98-6303386f4e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:59.295713 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99392496-303d-4dc4-bb98-6303386f4e26 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:59.295992 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99392496-303d-4dc4-bb98-6303386f4e26 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:59.296267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99392496-303d-4dc4-bb98-6303386f4e26 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:59.306261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99392496-303d-4dc4-bb98-6303386f4e26 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:59.307892 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99392496-303d-4dc4-bb98-6303386f4e26 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:59.324716 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-99392496-303d-4dc4-bb98-6303386f4e26 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:10:59.324716 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:10:59.324716 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:10:59.324716 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:10:59.324716 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:10:59.324716 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:10:59.324716 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:10:59.324716 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:10:59.324716 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:10:59.324716 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:10:59.324716 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:10:59.324716 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:10:59.324716 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 05 02:10:59.324716 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 05 02:10:59.324716 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 05 02:10:59.325743 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 05 02:10:59.325743 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:10:59.325743 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:10:59.325743 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:10:59.325743 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:10:59.325743 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:10:59.325743 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:10:59.325743 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:10:59.325743 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:10:59.325743 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:10:59.325743 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:10:59.325743 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:10:59.325743 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:10:59.325743 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:10:59.325743 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:10:59.325743 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:10:59.325743 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:10:59.327011 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 05 02:10:59.327011 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 05 02:10:59.327011 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 05 02:10:59.327011 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:10:59.328477 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 644/1283] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:10:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:10:59.331498 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55608d-7e57-4758-8190-d39e3e636857 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:59.427494 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55608d-7e57-4758-8190-d39e3e636857 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:59.461019 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851dfd7-2dd0-4d6c-9bd9-59f88ec60eb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:59.461629 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851dfd7-2dd0-4d6c-9bd9-59f88ec60eb5 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:59.461908 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851dfd7-2dd0-4d6c-9bd9-59f88ec60eb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:59.462179 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8851dfd7-2dd0-4d6c-9bd9-59f88ec60eb5 None admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:59.462973 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8851dfd7-2dd0-4d6c-9bd9-59f88ec60eb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:10:59.463268 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8851dfd7-2dd0-4d6c-9bd9-59f88ec60eb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:59.464908 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8851dfd7-2dd0-4d6c-9bd9-59f88ec60eb5 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:59.475671 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 640/1284] 10.222.0.15 () {56 vars in 1109 bytes} [Fri Aug 5 02:10:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:10:59.481256 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99392496-303d-4dc4-bb98-6303386f4e26 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:59.587740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99392496-303d-4dc4-bb98-6303386f4e26 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:59.601749 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:59.622181 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40832e50-524f-493b-9bdb-596b86609aa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:59.622808 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40832e50-524f-493b-9bdb-596b86609aa0 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:59.623087 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40832e50-524f-493b-9bdb-596b86609aa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:59.623359 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40832e50-524f-493b-9bdb-596b86609aa0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:59.631541 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40832e50-524f-493b-9bdb-596b86609aa0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:59.633014 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40832e50-524f-493b-9bdb-596b86609aa0 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:59.645676 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application [None req-40832e50-524f-493b-9bdb-596b86609aa0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:10:59.645676 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:10:59.645676 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:10:59.645676 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:10:59.645676 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:10:59.645676 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:10:59.645676 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:10:59.645676 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:10:59.645676 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:10:59.645676 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:10:59.645676 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:10:59.645676 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:10:59.645676 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 05 02:10:59.645676 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 05 02:10:59.645676 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 05 02:10:59.646619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 05 02:10:59.646619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:10:59.646619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:10:59.646619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:10:59.646619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:10:59.646619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:10:59.646619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:10:59.646619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:10:59.646619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application with Lock( Aug 05 02:10:59.646619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:10:59.646619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:10:59.646619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:10:59.646619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:10:59.646619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:10:59.646619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:10:59.646619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:10:59.646619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:10:59.647524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 05 02:10:59.647524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 05 02:10:59.647524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 05 02:10:59.647524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 05 02:10:59.647524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 05 02:10:59.647524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 05 02:10:59.647524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 05 02:10:59.647524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: ERROR keystone.server.flask.application Aug 05 02:10:59.647524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 645/1285] 10.222.0.15 () {56 vars in 1111 bytes} [Fri Aug 5 02:10:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:10:59.652712 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851dfd7-2dd0-4d6c-9bd9-59f88ec60eb5 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:59.701560 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:10:59.750398 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8851dfd7-2dd0-4d6c-9bd9-59f88ec60eb5 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:59.782675 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d40687-c3bb-496c-a43c-8f60a670f24a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:59.783276 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d40687-c3bb-496c-a43c-8f60a670f24a None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:59.783556 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d40687-c3bb-496c-a43c-8f60a670f24a None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:59.783831 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d40687-c3bb-496c-a43c-8f60a670f24a None admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:59.784602 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d40687-c3bb-496c-a43c-8f60a670f24a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:10:59.784909 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d40687-c3bb-496c-a43c-8f60a670f24a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:59.786313 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d40687-c3bb-496c-a43c-8f60a670f24a None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:59.798298 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 641/1286] 10.222.0.15 () {56 vars in 1148 bytes} [Fri Aug 5 02:10:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:10:59.804275 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40832e50-524f-493b-9bdb-596b86609aa0 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:10:59.904677 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40832e50-524f-493b-9bdb-596b86609aa0 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:10:59.938425 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3efe0bbb-590d-411f-9b2c-f07dd08f9fd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:10:59.939028 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe0bbb-590d-411f-9b2c-f07dd08f9fd6 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:10:59.939308 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe0bbb-590d-411f-9b2c-f07dd08f9fd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:10:59.939582 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3efe0bbb-590d-411f-9b2c-f07dd08f9fd6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:10:59.940377 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe0bbb-590d-411f-9b2c-f07dd08f9fd6 None admin] RBAC: Adding query filter params (role.id=e1b75d5eea2a43b2b1b14cf0515350fa, scope.project.id=95d88dece7184bf1842c4f8d275d52cd, user.id=e84ea976b5914aea94c4d8f805139daf) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:10:59.940688 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe0bbb-590d-411f-9b2c-f07dd08f9fd6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:10:59.942098 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3efe0bbb-590d-411f-9b2c-f07dd08f9fd6 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:10:59.948087 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 646/1287] 10.222.0.15 () {56 vars in 1374 bytes} [Fri Aug 5 02:10:59 2022] GET /identity/v3/role_assignments?user.id=e84ea976b5914aea94c4d8f805139daf&scope.project.id=95d88dece7184bf1842c4f8d275d52cd&role.id=e1b75d5eea2a43b2b1b14cf0515350fa => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:11:01.973060 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a2a91-37f9-4914-9156-01da49e72299 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:11:01.973606 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a2a91-37f9-4914-9156-01da49e72299 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:11:01.973606 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34a2a91-37f9-4914-9156-01da49e72299 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:11:01.974959 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 642/1288] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:11:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:11:01.980183 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff8942-2c09-4bab-97c5-322e585d4bc7 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:11:01.980620 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff8942-2c09-4bab-97c5-322e585d4bc7 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:11:01.980770 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ff8942-2c09-4bab-97c5-322e585d4bc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:11:01.999143 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-e2ff8942-2c09-4bab-97c5-322e585d4bc7 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:11:02.000369 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-e2ff8942-2c09-4bab-97c5-322e585d4bc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:11:02.029918 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:11:02.067296 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 647/1289] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:11:01 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:11:02.090429 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a2a91-37f9-4914-9156-01da49e72299 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:11:02.188039 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34a2a91-37f9-4914-9156-01da49e72299 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:11:02.198862 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:11:02.222349 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e57b00-5cc2-4531-8c90-d8c5cc5c3f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:11:02.222969 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e57b00-5cc2-4531-8c90-d8c5cc5c3f0d None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:11:02.223244 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e57b00-5cc2-4531-8c90-d8c5cc5c3f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:11:02.223512 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9e57b00-5cc2-4531-8c90-d8c5cc5c3f0d None admin] PATH_INFO: `/v3/services/placement` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:11:02.224124 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e57b00-5cc2-4531-8c90-d8c5cc5c3f0d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:11:02.225492 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9e57b00-5cc2-4531-8c90-d8c5cc5c3f0d None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:11:02.234205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-b9e57b00-5cc2-4531-8c90-d8c5cc5c3f0d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 02:11:02.234205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:11:02.234205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:11:02.234205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:11:02.234205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:11:02.234205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:11:02.234205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:11:02.234205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:11:02.234205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 02:11:02.234205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:11:02.234205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:11:02.234205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:11:02.234205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:11:02.234205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:11:02.234205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:11:02.234205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:11:02.234205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:11:02.235431 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:11:02.235431 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:11:02.235431 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:11:02.235431 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:11:02.235431 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:11:02.235431 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:11:02.235431 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:11:02.235431 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:11:02.235431 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:11:02.235431 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:11:02.235431 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:11:02.235431 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:11:02.235431 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:11:02.235431 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:11:02.235431 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:11:02.235431 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:11:02.236507 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:11:02.236507 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:11:02.236507 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:11:02.236507 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:11:02.236507 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:11:02.236507 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:11:02.236507 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:11:02.236507 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:11:02.236507 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:11:02.236507 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:11:02.236507 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:11:02.236507 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:11:02.236507 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 02:11:02.236507 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:11:02.236507 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 643/1290] 10.222.0.15 () {56 vars in 1117 bytes} [Fri Aug 5 02:11:02 2022] GET /identity/v3/services/placement => generated 90 bytes in 145 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:11:02.241348 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff8942-2c09-4bab-97c5-322e585d4bc7 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:11:02.336346 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ff8942-2c09-4bab-97c5-322e585d4bc7 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:11:02.369446 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3db4b1-44a9-49f9-88d8-b390e31e7f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:11:02.370127 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3db4b1-44a9-49f9-88d8-b390e31e7f2e None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:11:02.370410 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3db4b1-44a9-49f9-88d8-b390e31e7f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:11:02.370682 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3db4b1-44a9-49f9-88d8-b390e31e7f2e None admin] PATH_INFO: `/v3/services` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:11:02.371345 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3db4b1-44a9-49f9-88d8-b390e31e7f2e None admin] RBAC: Adding query filter params (name=placement) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:11:02.371645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3db4b1-44a9-49f9-88d8-b390e31e7f2e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:11:02.373019 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3db4b1-44a9-49f9-88d8-b390e31e7f2e None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:11:02.377642 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 648/1291] 10.222.0.15 () {56 vars in 1116 bytes} [Fri Aug 5 02:11:02 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:11:02.383241 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e57b00-5cc2-4531-8c90-d8c5cc5c3f0d None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:11:02.480805 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9e57b00-5cc2-4531-8c90-d8c5cc5c3f0d None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:11:02.513432 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b3093f1-eeb3-45f3-ab71-b25798eadaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:11:02.514021 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3093f1-eeb3-45f3-ab71-b25798eadaf0 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:11:02.514299 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3093f1-eeb3-45f3-ab71-b25798eadaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:11:02.514571 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b3093f1-eeb3-45f3-ab71-b25798eadaf0 None admin] PATH_INFO: `/v3/services` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:11:02.515234 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3093f1-eeb3-45f3-ab71-b25798eadaf0 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:11:02.515534 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3093f1-eeb3-45f3-ab71-b25798eadaf0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:11:02.516904 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b3093f1-eeb3-45f3-ab71-b25798eadaf0 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:11:02.521233 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 644/1292] 10.222.0.15 () {56 vars in 1116 bytes} [Fri Aug 5 02:11:02 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:11:04.501587 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374ec77-4cd2-4b36-92ed-6299932e1ac5 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:11:04.502197 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374ec77-4cd2-4b36-92ed-6299932e1ac5 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:11:04.502197 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3374ec77-4cd2-4b36-92ed-6299932e1ac5 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:11:04.503476 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 649/1293] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:11:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:11:04.508551 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c4ebb-96c1-445b-b2c5-0e4e7b0db724 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:11:04.509678 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c4ebb-96c1-445b-b2c5-0e4e7b0db724 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:11:04.509831 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1c4ebb-96c1-445b-b2c5-0e4e7b0db724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:11:04.528606 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-be1c4ebb-96c1-445b-b2c5-0e4e7b0db724 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:11:04.529806 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-be1c4ebb-96c1-445b-b2c5-0e4e7b0db724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:11:04.558688 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:11:04.596673 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 645/1294] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:11:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:11:04.619931 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374ec77-4cd2-4b36-92ed-6299932e1ac5 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:11:04.651169 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:11:04.720543 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3374ec77-4cd2-4b36-92ed-6299932e1ac5 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:11:04.753640 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aea31c1-a474-46f4-a4a8-8e7d68637906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:11:04.754187 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea31c1-a474-46f4-a4a8-8e7d68637906 None admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:11:04.754470 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea31c1-a474-46f4-a4a8-8e7d68637906 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:11:04.754747 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aea31c1-a474-46f4-a4a8-8e7d68637906 None admin] PATH_INFO: `/v3/services` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:11:04.755437 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea31c1-a474-46f4-a4a8-8e7d68637906 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:11:04.756826 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aea31c1-a474-46f4-a4a8-8e7d68637906 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:11:04.770586 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 650/1295] 10.222.0.15 () {60 vars in 1141 bytes} [Fri Aug 5 02:11:04 2022] POST /identity/v3/services => generated 246 bytes in 151 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:11:06.748019 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a631e0-7110-4bae-8565-59da84a0a669 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:11:06.748610 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a631e0-7110-4bae-8565-59da84a0a669 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:11:06.748610 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39a631e0-7110-4bae-8565-59da84a0a669 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:11:06.749970 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 646/1296] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:11:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:11:06.754921 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d02bd-881b-4b83-817b-3cb843dbb65c None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:11:06.755338 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d02bd-881b-4b83-817b-3cb843dbb65c None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:11:06.755515 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65d02bd-881b-4b83-817b-3cb843dbb65c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:11:06.773600 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-f65d02bd-881b-4b83-817b-3cb843dbb65c None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:11:06.775761 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-f65d02bd-881b-4b83-817b-3cb843dbb65c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:11:06.846847 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 651/1297] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:11:06 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:11:06.868877 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a631e0-7110-4bae-8565-59da84a0a669 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:11:06.968154 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39a631e0-7110-4bae-8565-59da84a0a669 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:11:07.001084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec2f1d-9a54-4549-897a-9fbeb6fa1160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:11:07.001644 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec2f1d-9a54-4549-897a-9fbeb6fa1160 None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:11:07.001923 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec2f1d-9a54-4549-897a-9fbeb6fa1160 None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:11:07.002192 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ec2f1d-9a54-4549-897a-9fbeb6fa1160 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:11:07.002808 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec2f1d-9a54-4549-897a-9fbeb6fa1160 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:11:07.004155 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ec2f1d-9a54-4549-897a-9fbeb6fa1160 None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:11:07.013587 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-32ec2f1d-9a54-4549-897a-9fbeb6fa1160 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 02:11:07.013587 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:11:07.013587 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:11:07.013587 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:11:07.013587 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:11:07.013587 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:11:07.013587 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:11:07.013587 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:11:07.013587 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 02:11:07.013587 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:11:07.013587 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:11:07.013587 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:11:07.013587 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:11:07.013587 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:11:07.013587 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:11:07.013587 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:11:07.013587 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:11:07.014835 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:11:07.014835 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:11:07.014835 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:11:07.014835 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:11:07.014835 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:11:07.014835 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:11:07.014835 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:11:07.014835 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:11:07.014835 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:11:07.014835 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:11:07.014835 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:11:07.014835 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:11:07.014835 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:11:07.014835 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:11:07.014835 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:11:07.014835 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:11:07.015782 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:11:07.015782 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:11:07.015782 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:11:07.015782 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:11:07.015782 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:11:07.015782 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:11:07.015782 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:11:07.015782 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:11:07.015782 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:11:07.015782 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:11:07.015782 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:11:07.015782 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:11:07.015782 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 02:11:07.015782 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:11:07.015782 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 647/1298] 10.222.0.15 () {56 vars in 1117 bytes} [Fri Aug 5 02:11:06 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:11:07.020789 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d02bd-881b-4b83-817b-3cb843dbb65c None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:11:07.038554 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:11:07.117295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65d02bd-881b-4b83-817b-3cb843dbb65c None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:11:07.150944 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebef6b4-e699-4640-a500-6d3fa46f02e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:11:07.151536 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebef6b4-e699-4640-a500-6d3fa46f02e6 None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:11:07.151812 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebef6b4-e699-4640-a500-6d3fa46f02e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:11:07.152082 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebef6b4-e699-4640-a500-6d3fa46f02e6 None admin] PATH_INFO: `/v3/services` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:11:07.152777 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebef6b4-e699-4640-a500-6d3fa46f02e6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:11:07.153072 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebef6b4-e699-4640-a500-6d3fa46f02e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:11:07.154418 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ebef6b4-e699-4640-a500-6d3fa46f02e6 None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:11:07.159335 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 652/1299] 10.222.0.15 () {56 vars in 1116 bytes} [Fri Aug 5 02:11:07 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:11:07.165874 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec2f1d-9a54-4549-897a-9fbeb6fa1160 None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:11:07.196559 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:11:07.267675 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ec2f1d-9a54-4549-897a-9fbeb6fa1160 None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:11:07.300238 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c469822f-959a-4425-9445-122b01bf012a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:11:07.300864 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469822f-959a-4425-9445-122b01bf012a None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:11:07.301139 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469822f-959a-4425-9445-122b01bf012a None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:11:07.301402 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c469822f-959a-4425-9445-122b01bf012a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:11:07.302142 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c469822f-959a-4425-9445-122b01bf012a None admin] RBAC: Adding query filter params (interface=public, service_id=4d0eed3191f34fadb0092df7695f98b7, region_id=RegionOne) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:11:07.302443 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c469822f-959a-4425-9445-122b01bf012a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:11:07.303771 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c469822f-959a-4425-9445-122b01bf012a None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:11:07.308752 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 648/1300] 10.222.0.15 () {56 vars in 1251 bytes} [Fri Aug 5 02:11:07 2022] GET /identity/v3/endpoints?service_id=4d0eed3191f34fadb0092df7695f98b7&interface=public®ion_id=RegionOne => generated 194 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:11:07.314564 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebef6b4-e699-4640-a500-6d3fa46f02e6 None admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:11:07.395023 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:11:07.413999 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ebef6b4-e699-4640-a500-6d3fa46f02e6 None admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:11:07.448058 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f95ff3-c4c6-48aa-8521-2b07225f316c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:11:07.448681 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f95ff3-c4c6-48aa-8521-2b07225f316c None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:11:07.448961 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f95ff3-c4c6-48aa-8521-2b07225f316c None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:11:07.449232 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f95ff3-c4c6-48aa-8521-2b07225f316c None admin] PATH_INFO: `/v3/services` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:11:07.449869 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f95ff3-c4c6-48aa-8521-2b07225f316c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:11:07.451213 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f95ff3-c4c6-48aa-8521-2b07225f316c None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:11:07.458083 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 653/1301] 10.222.0.15 () {56 vars in 1087 bytes} [Fri Aug 5 02:11:07 2022] GET /identity/v3/services => generated 2191 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:11:09.446459 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfedf6c-04c8-4490-b98e-7d04dbb76e10 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:11:09.447019 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfedf6c-04c8-4490-b98e-7d04dbb76e10 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:11:09.447019 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dfedf6c-04c8-4490-b98e-7d04dbb76e10 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:11:09.448685 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 649/1302] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:11:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:11:09.453752 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4987bc-dd94-49e4-a35b-85c9c3945bf9 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:11:09.454176 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4987bc-dd94-49e4-a35b-85c9c3945bf9 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:11:09.454298 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4987bc-dd94-49e4-a35b-85c9c3945bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:11:09.472935 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-0c4987bc-dd94-49e4-a35b-85c9c3945bf9 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:11:09.474102 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-0c4987bc-dd94-49e4-a35b-85c9c3945bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:11:09.549208 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 654/1303] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:11:09 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 05 02:11:09.576164 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfedf6c-04c8-4490-b98e-7d04dbb76e10 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:11:09.675000 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:11:09.681802 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dfedf6c-04c8-4490-b98e-7d04dbb76e10 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:11:09.716339 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d578cc1-34e3-4633-867a-ed60500fdb9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:11:09.716924 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d578cc1-34e3-4633-867a-ed60500fdb9e None admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:11:09.717204 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d578cc1-34e3-4633-867a-ed60500fdb9e None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:11:09.717474 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d578cc1-34e3-4633-867a-ed60500fdb9e None admin] PATH_INFO: `/v3/services/placement` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:11:09.718090 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d578cc1-34e3-4633-867a-ed60500fdb9e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:11:09.719425 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d578cc1-34e3-4633-867a-ed60500fdb9e None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:11:09.728176 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application [None req-2d578cc1-34e3-4633-867a-ed60500fdb9e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 02:11:09.728176 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:11:09.728176 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 05 02:11:09.728176 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 05 02:11:09.728176 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 05 02:11:09.728176 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 05 02:11:09.728176 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 05 02:11:09.728176 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:11:09.728176 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 02:11:09.728176 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:11:09.728176 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 05 02:11:09.728176 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:11:09.728176 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 05 02:11:09.728176 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1517, in full_dispatch_request Aug 05 02:11:09.728176 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 05 02:11:09.728176 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1503, in dispatch_request Aug 05 02:11:09.728176 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Aug 05 02:11:09.729286 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 05 02:11:09.729286 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 05 02:11:09.729286 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Aug 05 02:11:09.729286 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Aug 05 02:11:09.729286 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 05 02:11:09.729286 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 05 02:11:09.729286 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 05 02:11:09.729286 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 05 02:11:09.729286 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 05 02:11:09.729286 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 05 02:11:09.729286 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 05 02:11:09.729286 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 05 02:11:09.729286 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 05 02:11:09.729286 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 05 02:11:09.729286 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 05 02:11:09.729286 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.get_or_create( Aug 05 02:11:09.730962 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 05 02:11:09.730962 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application with Lock( Aug 05 02:11:09.730962 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 05 02:11:09.730962 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self._enter() Aug 05 02:11:09.730962 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 05 02:11:09.730962 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 05 02:11:09.730962 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 05 02:11:09.730962 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application return self.creator() Aug 05 02:11:09.730962 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 05 02:11:09.730962 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application created_value = creator( Aug 05 02:11:09.730962 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 05 02:11:09.730962 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 05 02:11:09.730962 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 05 02:11:09.730962 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: ERROR keystone.server.flask.application Aug 05 02:11:09.730962 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 650/1304] 10.222.0.15 () {56 vars in 1117 bytes} [Fri Aug 5 02:11:09 2022] GET /identity/v3/services/placement => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 05 02:11:09.736766 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4987bc-dd94-49e4-a35b-85c9c3945bf9 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:11:09.809858 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:11:09.832555 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4987bc-dd94-49e4-a35b-85c9c3945bf9 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:11:09.865833 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4488b176-51a4-495b-8b4b-4da37b5a8adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:11:09.866437 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488b176-51a4-495b-8b4b-4da37b5a8adb None admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:11:09.866714 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488b176-51a4-495b-8b4b-4da37b5a8adb None admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:11:09.866985 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4488b176-51a4-495b-8b4b-4da37b5a8adb None admin] PATH_INFO: `/v3/services` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:11:09.867667 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488b176-51a4-495b-8b4b-4da37b5a8adb None admin] RBAC: Adding query filter params (name=placement) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:11:09.868028 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488b176-51a4-495b-8b4b-4da37b5a8adb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:11:09.869348 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4488b176-51a4-495b-8b4b-4da37b5a8adb None admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:11:09.874294 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 655/1305] 10.222.0.15 () {56 vars in 1116 bytes} [Fri Aug 5 02:11:09 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:11:09.880019 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d578cc1-34e3-4633-867a-ed60500fdb9e None admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:11:09.977790 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d578cc1-34e3-4633-867a-ed60500fdb9e None admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:11:10.012060 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de60b5c-0824-439b-addd-e0979b71025a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:11:10.012692 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de60b5c-0824-439b-addd-e0979b71025a None admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:11:10.012972 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de60b5c-0824-439b-addd-e0979b71025a None admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:11:10.013242 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de60b5c-0824-439b-addd-e0979b71025a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:11:10.013954 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de60b5c-0824-439b-addd-e0979b71025a None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:11:10.015286 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de60b5c-0824-439b-addd-e0979b71025a None admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:11:10.033545 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 651/1306] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:11:09 2022] POST /identity/v3/endpoints => generated 331 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:11:19.871343 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=30 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:11:20.029389 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:12:13.039035 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4fb455-493c-4915-a466-8f07c0649bb8 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:12:13.039498 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4fb455-493c-4915-a466-8f07c0649bb8 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:12:13.039743 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4fb455-493c-4915-a466-8f07c0649bb8 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:12:13.046542 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e4354-612e-4fbd-9dce-0c760cc11038 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:12:13.046956 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e4354-612e-4fbd-9dce-0c760cc11038 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:12:13.047200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445e4354-612e-4fbd-9dce-0c760cc11038 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:12:13.052109 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 656/1307] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:12:13 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:12:13.132736 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-445e4354-612e-4fbd-9dce-0c760cc11038 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:12:13.133965 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-445e4354-612e-4fbd-9dce-0c760cc11038 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:12:13.262880 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 652/1308] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:12:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:12:13.313908 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b2d39-4f5d-49db-8327-91449d62252a None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:12:13.314186 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b2d39-4f5d-49db-8327-91449d62252a None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:12:13.314663 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a0b2d39-4f5d-49db-8327-91449d62252a None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:12:13.316251 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 657/1309] 10.222.0.15 () {54 vars in 965 bytes} [Fri Aug 5 02:12:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:12:13.323032 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f80d97-50cd-4870-90f1-c531e89bb4d4 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:12:13.323337 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f80d97-50cd-4870-90f1-c531e89bb4d4 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:12:13.323728 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f80d97-50cd-4870-90f1-c531e89bb4d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:12:13.403864 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-f2f80d97-50cd-4870-90f1-c531e89bb4d4 None None] MFA Rules not processed for user `f81daf3da9b34e7380c61005019a53bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:12:13.405029 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-f2f80d97-50cd-4870-90f1-c531e89bb4d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:12:13.426425 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:12:13.486186 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 653/1310] 10.222.0.15 () {58 vars in 1062 bytes} [Fri Aug 5 02:12:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:12:13.495587 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b2d39-4f5d-49db-8327-91449d62252a None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:12:13.497526 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-2a0b2d39-4f5d-49db-8327-91449d62252a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:12:13.612422 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a0b2d39-4f5d-49db-8327-91449d62252a None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:12:13.692211 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84eadb79-7b64-49c3-9242-d83e7c183bc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:12:13.692901 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eadb79-7b64-49c3-9242-d83e7c183bc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:12:13.693182 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eadb79-7b64-49c3-9242-d83e7c183bc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:12:13.693458 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84eadb79-7b64-49c3-9242-d83e7c183bc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:12:13.695237 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-84eadb79-7b64-49c3-9242-d83e7c183bc9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:12:13.763543 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:12:13.827635 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eadb79-7b64-49c3-9242-d83e7c183bc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:12:13.829296 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84eadb79-7b64-49c3-9242-d83e7c183bc9 service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:12:13.856596 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 658/1311] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:12:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 362 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:12:16.161210 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce61d8c-3d7a-4029-a9e2-fef6adeb5af9 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:12:16.161740 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce61d8c-3d7a-4029-a9e2-fef6adeb5af9 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:12:16.161740 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce61d8c-3d7a-4029-a9e2-fef6adeb5af9 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:12:16.163200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 654/1312] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:12:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:12:16.169558 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983615f4-786e-45e4-bd20-23e7dff5423c None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:12:16.170067 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983615f4-786e-45e4-bd20-23e7dff5423c None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:12:16.170146 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983615f4-786e-45e4-bd20-23e7dff5423c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:12:16.253962 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-983615f4-786e-45e4-bd20-23e7dff5423c None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:12:16.255475 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-983615f4-786e-45e4-bd20-23e7dff5423c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:12:16.366655 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 659/1313] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:12:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:12:16.407604 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce61d8c-3d7a-4029-a9e2-fef6adeb5af9 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:12:16.409514 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-cce61d8c-3d7a-4029-a9e2-fef6adeb5af9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:12:16.535230 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce61d8c-3d7a-4029-a9e2-fef6adeb5af9 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:12:16.620491 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:12:16.623250 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff2d5dd-3d5d-41c9-9202-487035e99132 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:12:16.623910 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2d5dd-3d5d-41c9-9202-487035e99132 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:12:16.624395 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2d5dd-3d5d-41c9-9202-487035e99132 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:12:16.624712 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff2d5dd-3d5d-41c9-9202-487035e99132 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:12:16.626689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-8ff2d5dd-3d5d-41c9-9202-487035e99132 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:12:16.735606 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff2d5dd-3d5d-41c9-9202-487035e99132 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:12:16.737069 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff2d5dd-3d5d-41c9-9202-487035e99132 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:12:16.755134 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 655/1314] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:12:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:12:19.062016 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf2519-13f1-4eb6-8196-3ba72116f44c None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:12:19.062581 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf2519-13f1-4eb6-8196-3ba72116f44c None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:12:19.062581 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cf2519-13f1-4eb6-8196-3ba72116f44c None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:12:19.063929 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 660/1315] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:12:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:12:19.068916 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59437d2-90ac-43c5-a74b-7fe7665b7278 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:12:19.069351 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59437d2-90ac-43c5-a74b-7fe7665b7278 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:12:19.069446 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59437d2-90ac-43c5-a74b-7fe7665b7278 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:12:19.142002 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-e59437d2-90ac-43c5-a74b-7fe7665b7278 None None] MFA Rules not processed for user `d91b409307d64b3fb23df25bc6e6dfdc`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:12:19.143126 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-e59437d2-90ac-43c5-a74b-7fe7665b7278 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:12:19.194764 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:12:19.239666 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 656/1316] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:12:19 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:12:19.279919 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf2519-13f1-4eb6-8196-3ba72116f44c None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:12:19.281491 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-39cf2519-13f1-4eb6-8196-3ba72116f44c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:12:19.291621 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:12:19.385053 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cf2519-13f1-4eb6-8196-3ba72116f44c None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:12:19.456847 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a3ebd0f-45a6-4b08-85bf-8d9c34e425b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:12:19.457447 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ebd0f-45a6-4b08-85bf-8d9c34e425b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:12:19.457724 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ebd0f-45a6-4b08-85bf-8d9c34e425b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:12:19.457996 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a3ebd0f-45a6-4b08-85bf-8d9c34e425b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:12:19.459594 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-8a3ebd0f-45a6-4b08-85bf-8d9c34e425b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:12:19.520869 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:12:19.569093 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ebd0f-45a6-4b08-85bf-8d9c34e425b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:12:19.570520 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a3ebd0f-45a6-4b08-85bf-8d9c34e425b5 service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:12:19.590043 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 661/1317] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:12:19 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:12:22.171543 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff315bf3-676c-4208-af98-757f75f41fc6 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:12:22.172060 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff315bf3-676c-4208-af98-757f75f41fc6 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:12:22.172060 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff315bf3-676c-4208-af98-757f75f41fc6 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:12:22.173407 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 657/1318] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:12:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:12:22.178759 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9aa167-90bf-4d19-ad94-37d052c7af63 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:12:22.179178 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9aa167-90bf-4d19-ad94-37d052c7af63 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:12:22.179292 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9aa167-90bf-4d19-ad94-37d052c7af63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:12:22.244732 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-6e9aa167-90bf-4d19-ad94-37d052c7af63 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:12:22.245941 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-6e9aa167-90bf-4d19-ad94-37d052c7af63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:12:22.340431 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 662/1319] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:12:22 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:12:22.379508 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff315bf3-676c-4208-af98-757f75f41fc6 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:12:22.381087 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-ff315bf3-676c-4208-af98-757f75f41fc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:12:22.482579 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff315bf3-676c-4208-af98-757f75f41fc6 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:12:22.554753 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed13ecb-11b9-4198-910e-de7beee7083f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:12:22.555367 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed13ecb-11b9-4198-910e-de7beee7083f service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:12:22.555647 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed13ecb-11b9-4198-910e-de7beee7083f service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:12:22.555921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed13ecb-11b9-4198-910e-de7beee7083f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:12:22.557630 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9ed13ecb-11b9-4198-910e-de7beee7083f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:12:22.564908 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:12:22.665829 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed13ecb-11b9-4198-910e-de7beee7083f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:12:22.667523 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed13ecb-11b9-4198-910e-de7beee7083f service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:12:22.685585 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 658/1320] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:12:22 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:12:25.342374 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3fa9c-0b8f-4caa-a793-adb3875377d9 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:12:25.342952 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3fa9c-0b8f-4caa-a793-adb3875377d9 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:12:25.342952 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f3fa9c-0b8f-4caa-a793-adb3875377d9 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:12:25.344272 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 663/1321] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:12:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:12:25.349413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b1ab0-04ec-4150-96e7-1758c6a5daf7 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:12:25.349841 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b1ab0-04ec-4150-96e7-1758c6a5daf7 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:12:25.349978 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-628b1ab0-04ec-4150-96e7-1758c6a5daf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:12:25.416034 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-628b1ab0-04ec-4150-96e7-1758c6a5daf7 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:12:25.417522 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-628b1ab0-04ec-4150-96e7-1758c6a5daf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:12:25.480259 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:12:25.522579 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 659/1322] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:12:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:12:25.559770 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f3fa9c-0b8f-4caa-a793-adb3875377d9 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:12:25.561349 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-30f3fa9c-0b8f-4caa-a793-adb3875377d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:12:25.582252 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:12:25.677312 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f3fa9c-0b8f-4caa-a793-adb3875377d9 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:12:25.751948 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e5f260-086c-4a89-b2e7-4c43e5c01b91 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:12:25.752594 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5f260-086c-4a89-b2e7-4c43e5c01b91 service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:12:25.752879 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5f260-086c-4a89-b2e7-4c43e5c01b91 service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:12:25.753156 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e5f260-086c-4a89-b2e7-4c43e5c01b91 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:12:25.754826 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-63e5f260-086c-4a89-b2e7-4c43e5c01b91 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:12:25.827133 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:12:25.867423 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e5f260-086c-4a89-b2e7-4c43e5c01b91 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:12:25.868801 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e5f260-086c-4a89-b2e7-4c43e5c01b91 service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:12:25.887439 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 664/1323] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:12:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:12:27.945111 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c840c4-8548-42fd-9d6d-09871c4805b6 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:12:27.945645 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c840c4-8548-42fd-9d6d-09871c4805b6 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:12:27.945645 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78c840c4-8548-42fd-9d6d-09871c4805b6 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:12:27.946924 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 660/1324] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:12:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:12:27.953131 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b94a3-bd71-4196-b898-86688615957b None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:12:27.953548 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b94a3-bd71-4196-b898-86688615957b None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:12:27.953702 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64b94a3-bd71-4196-b898-86688615957b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:12:28.022229 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-b64b94a3-bd71-4196-b898-86688615957b None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:12:28.023441 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-b64b94a3-bd71-4196-b898-86688615957b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:12:28.124279 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 665/1325] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:12:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:12:28.160244 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c840c4-8548-42fd-9d6d-09871c4805b6 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:12:28.161817 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-78c840c4-8548-42fd-9d6d-09871c4805b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:12:28.266000 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78c840c4-8548-42fd-9d6d-09871c4805b6 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:12:28.339545 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d925ea-c600-446a-a05c-4552966b609f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:12:28.340170 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d925ea-c600-446a-a05c-4552966b609f service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:12:28.340483 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d925ea-c600-446a-a05c-4552966b609f service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:12:28.340754 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d925ea-c600-446a-a05c-4552966b609f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:12:28.342740 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-80d925ea-c600-446a-a05c-4552966b609f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:12:28.362095 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:12:28.456107 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d925ea-c600-446a-a05c-4552966b609f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:12:28.457566 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d925ea-c600-446a-a05c-4552966b609f service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:12:28.475639 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 661/1326] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:12:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:12:30.578859 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a1f0d-bf34-46ed-aeb8-af4ed603d396 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:12:30.579371 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a1f0d-bf34-46ed-aeb8-af4ed603d396 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:12:30.579461 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a1f0d-bf34-46ed-aeb8-af4ed603d396 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:12:30.580790 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 666/1327] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:12:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:12:30.585936 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9b36a-c52a-43b4-8a44-b67346d39ca1 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:12:30.586359 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9b36a-c52a-43b4-8a44-b67346d39ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:12:30.586486 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c9b36a-c52a-43b4-8a44-b67346d39ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:12:30.655553 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-d2c9b36a-c52a-43b4-8a44-b67346d39ca1 None None] MFA Rules not processed for user `d91b409307d64b3fb23df25bc6e6dfdc`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:12:30.656847 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-d2c9b36a-c52a-43b4-8a44-b67346d39ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:12:30.724204 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:12:30.757789 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 662/1328] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:12:30 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:12:30.796500 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a1f0d-bf34-46ed-aeb8-af4ed603d396 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:12:30.798041 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-e94a1f0d-bf34-46ed-aeb8-af4ed603d396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:12:30.830385 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:12:30.903367 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e94a1f0d-bf34-46ed-aeb8-af4ed603d396 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:12:30.976862 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0692a54f-f536-4c7a-b50d-7419b1b41e90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:12:30.977484 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692a54f-f536-4c7a-b50d-7419b1b41e90 service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:12:30.977764 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692a54f-f536-4c7a-b50d-7419b1b41e90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:12:30.978040 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0692a54f-f536-4c7a-b50d-7419b1b41e90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:12:30.980062 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-0692a54f-f536-4c7a-b50d-7419b1b41e90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:12:31.059586 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:12:31.092347 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0692a54f-f536-4c7a-b50d-7419b1b41e90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:12:31.093808 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0692a54f-f536-4c7a-b50d-7419b1b41e90 service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:12:31.111512 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 667/1329] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:12:30 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:12:33.375162 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9a1ed-6c59-464d-9142-a42626c3029f None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:12:33.375692 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9a1ed-6c59-464d-9142-a42626c3029f None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:12:33.375692 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddf9a1ed-6c59-464d-9142-a42626c3029f None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:12:33.377047 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 663/1330] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:12:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:12:33.382025 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3e238-91b7-4f18-b697-7bfda0e78909 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:12:33.382455 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3e238-91b7-4f18-b697-7bfda0e78909 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:12:33.382574 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55c3e238-91b7-4f18-b697-7bfda0e78909 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:12:33.447237 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-55c3e238-91b7-4f18-b697-7bfda0e78909 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:12:33.448503 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-55c3e238-91b7-4f18-b697-7bfda0e78909 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:12:33.545289 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 668/1331] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:12:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:12:33.580716 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9a1ed-6c59-464d-9142-a42626c3029f None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:12:33.582279 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-ddf9a1ed-6c59-464d-9142-a42626c3029f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:12:33.684874 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddf9a1ed-6c59-464d-9142-a42626c3029f None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:12:33.757489 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390a89a3-6d35-4431-aa5f-7708c0832637 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:12:33.758103 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a89a3-6d35-4431-aa5f-7708c0832637 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:12:33.758383 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a89a3-6d35-4431-aa5f-7708c0832637 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:12:33.758656 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390a89a3-6d35-4431-aa5f-7708c0832637 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:12:33.760880 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-390a89a3-6d35-4431-aa5f-7708c0832637 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:12:33.787514 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:12:33.870234 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a89a3-6d35-4431-aa5f-7708c0832637 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:12:33.871652 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390a89a3-6d35-4431-aa5f-7708c0832637 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:12:33.889762 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 664/1332] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:12:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:12:35.919749 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da22392-1340-4948-93f9-4b9a02e496e3 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:12:35.920353 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da22392-1340-4948-93f9-4b9a02e496e3 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:12:35.920353 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da22392-1340-4948-93f9-4b9a02e496e3 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:12:35.921602 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 669/1333] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:12:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:12:35.926770 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6202b6-fe79-4d4c-a7ca-d903817776c8 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:12:35.927204 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6202b6-fe79-4d4c-a7ca-d903817776c8 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:12:35.927316 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6202b6-fe79-4d4c-a7ca-d903817776c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:12:35.993072 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-9a6202b6-fe79-4d4c-a7ca-d903817776c8 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:12:35.994276 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9a6202b6-fe79-4d4c-a7ca-d903817776c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:12:36.068046 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:12:36.090972 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 665/1334] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:12:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:12:36.134982 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da22392-1340-4948-93f9-4b9a02e496e3 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:12:36.137335 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-1da22392-1340-4948-93f9-4b9a02e496e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:12:36.177040 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:12:36.240888 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da22392-1340-4948-93f9-4b9a02e496e3 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:12:36.312905 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e2bb9a5-2321-4da6-8043-6eb61e40dcc3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:12:36.313508 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bb9a5-2321-4da6-8043-6eb61e40dcc3 service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:12:36.313786 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bb9a5-2321-4da6-8043-6eb61e40dcc3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:12:36.314056 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e2bb9a5-2321-4da6-8043-6eb61e40dcc3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:12:36.315662 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-0e2bb9a5-2321-4da6-8043-6eb61e40dcc3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:12:36.397329 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:12:36.422136 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2bb9a5-2321-4da6-8043-6eb61e40dcc3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:12:36.423560 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e2bb9a5-2321-4da6-8043-6eb61e40dcc3 service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:12:36.441410 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 670/1335] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:12:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:12:38.771635 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873512ee-117d-45de-b368-e4ddf31ca963 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:12:38.772194 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873512ee-117d-45de-b368-e4ddf31ca963 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:12:38.772194 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873512ee-117d-45de-b368-e4ddf31ca963 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:12:38.773581 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 666/1336] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:12:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:12:38.779011 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28c63e-cf5c-4c51-9a90-ec4a9ac97eeb None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:12:38.779450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28c63e-cf5c-4c51-9a90-ec4a9ac97eeb None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:12:38.779557 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a28c63e-cf5c-4c51-9a90-ec4a9ac97eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:12:38.845331 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-8a28c63e-cf5c-4c51-9a90-ec4a9ac97eeb None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:12:38.846523 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-8a28c63e-cf5c-4c51-9a90-ec4a9ac97eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:12:38.940812 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 671/1337] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:12:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:12:38.978376 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873512ee-117d-45de-b368-e4ddf31ca963 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:12:38.980528 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-873512ee-117d-45de-b368-e4ddf31ca963 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:12:39.082474 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873512ee-117d-45de-b368-e4ddf31ca963 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:12:39.154438 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323232cf-117e-41f8-a9cb-c90755e82529 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:12:39.155047 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323232cf-117e-41f8-a9cb-c90755e82529 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:12:39.155327 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323232cf-117e-41f8-a9cb-c90755e82529 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:12:39.155600 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323232cf-117e-41f8-a9cb-c90755e82529 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:12:39.157264 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-323232cf-117e-41f8-a9cb-c90755e82529 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:12:39.191833 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:12:39.264800 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323232cf-117e-41f8-a9cb-c90755e82529 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:12:39.266208 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323232cf-117e-41f8-a9cb-c90755e82529 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:12:39.284166 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 667/1338] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:12:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:12:43.161750 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57024389-6a4d-473c-b3fe-4ab59b16b1ce None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:12:43.162286 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57024389-6a4d-473c-b3fe-4ab59b16b1ce None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:12:43.162286 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57024389-6a4d-473c-b3fe-4ab59b16b1ce None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:12:43.163663 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 672/1339] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:12:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:12:43.169492 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad615c30-749f-42bb-90b4-9199e568a313 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:12:43.169921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad615c30-749f-42bb-90b4-9199e568a313 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:12:43.170162 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad615c30-749f-42bb-90b4-9199e568a313 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:12:43.236604 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-ad615c30-749f-42bb-90b4-9199e568a313 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:12:43.237799 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-ad615c30-749f-42bb-90b4-9199e568a313 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:12:43.326714 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:12:43.338296 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 668/1340] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:12:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:12:43.378976 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57024389-6a4d-473c-b3fe-4ab59b16b1ce None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:12:43.380739 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-57024389-6a4d-473c-b3fe-4ab59b16b1ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:12:43.429431 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:12:43.487785 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57024389-6a4d-473c-b3fe-4ab59b16b1ce None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:12:43.561823 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3867c282-7c09-4e83-8b93-b67823ece519 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:12:43.562447 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867c282-7c09-4e83-8b93-b67823ece519 service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:12:43.562734 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867c282-7c09-4e83-8b93-b67823ece519 service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:12:43.563008 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3867c282-7c09-4e83-8b93-b67823ece519 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:12:43.564665 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-3867c282-7c09-4e83-8b93-b67823ece519 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:12:43.657791 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:12:43.674802 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3867c282-7c09-4e83-8b93-b67823ece519 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:12:43.676240 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3867c282-7c09-4e83-8b93-b67823ece519 service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:12:43.693967 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 673/1341] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:12:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:12:46.448650 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9947e-52b8-413d-aa67-c46c9226f467 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:12:46.449147 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9947e-52b8-413d-aa67-c46c9226f467 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:12:46.449241 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0d9947e-52b8-413d-aa67-c46c9226f467 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:12:46.450573 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 669/1342] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:12:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:12:46.458733 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16a959-87d5-4947-838b-1b825b889c16 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:12:46.459275 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16a959-87d5-4947-838b-1b825b889c16 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:12:46.459275 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16a959-87d5-4947-838b-1b825b889c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:12:46.528609 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-4d16a959-87d5-4947-838b-1b825b889c16 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:12:46.529992 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-4d16a959-87d5-4947-838b-1b825b889c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:12:46.627189 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 674/1343] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:12:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:12:46.664137 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9947e-52b8-413d-aa67-c46c9226f467 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:12:46.665717 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-e0d9947e-52b8-413d-aa67-c46c9226f467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:12:46.768621 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0d9947e-52b8-413d-aa67-c46c9226f467 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:12:46.845086 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c85149a-c4bd-4dc8-81b7-de37dc41b3b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:12:46.845706 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85149a-c4bd-4dc8-81b7-de37dc41b3b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:12:46.845981 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85149a-c4bd-4dc8-81b7-de37dc41b3b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:12:46.846250 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c85149a-c4bd-4dc8-81b7-de37dc41b3b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:12:46.847884 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-0c85149a-c4bd-4dc8-81b7-de37dc41b3b5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:12:46.891117 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:12:46.960077 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c85149a-c4bd-4dc8-81b7-de37dc41b3b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:12:46.961529 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c85149a-c4bd-4dc8-81b7-de37dc41b3b5 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:12:46.981285 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 670/1344] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:12:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:12:51.010174 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b2bc7-40c4-4648-96ce-1717ddf7c01c None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:12:51.011691 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b2bc7-40c4-4648-96ce-1717ddf7c01c None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:12:51.011691 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925b2bc7-40c4-4648-96ce-1717ddf7c01c None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:12:51.012865 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 675/1345] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:12:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:12:51.018380 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bdba5-6ee8-42f3-8109-2fe1f7b7f4c9 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:12:51.018887 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bdba5-6ee8-42f3-8109-2fe1f7b7f4c9 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:12:51.018986 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888bdba5-6ee8-42f3-8109-2fe1f7b7f4c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:12:51.085872 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-888bdba5-6ee8-42f3-8109-2fe1f7b7f4c9 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:12:51.087006 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-888bdba5-6ee8-42f3-8109-2fe1f7b7f4c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:12:51.184097 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:12:51.186700 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 671/1346] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:12:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:12:51.225215 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b2bc7-40c4-4648-96ce-1717ddf7c01c None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:12:51.226753 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-925b2bc7-40c4-4648-96ce-1717ddf7c01c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:12:51.302256 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:12:51.357636 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925b2bc7-40c4-4648-96ce-1717ddf7c01c None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:12:51.435630 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a5fed34-2670-4423-b9d6-6f9c5043cdd3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:12:51.436437 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fed34-2670-4423-b9d6-6f9c5043cdd3 service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:12:51.436724 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fed34-2670-4423-b9d6-6f9c5043cdd3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:12:51.436999 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a5fed34-2670-4423-b9d6-6f9c5043cdd3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:12:51.438724 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-5a5fed34-2670-4423-b9d6-6f9c5043cdd3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:12:51.552468 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:12:51.556877 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5fed34-2670-4423-b9d6-6f9c5043cdd3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:12:51.558889 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a5fed34-2670-4423-b9d6-6f9c5043cdd3 service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:12:51.578113 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 676/1347] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:12:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 353 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:12:56.502198 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd7e54-3795-4580-ab37-cfb3444c2ca2 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:12:56.502709 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd7e54-3795-4580-ab37-cfb3444c2ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:12:56.502825 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dcd7e54-3795-4580-ab37-cfb3444c2ca2 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:12:56.504273 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 672/1348] 10.222.0.15 () {54 vars in 921 bytes} [Fri Aug 5 02:12:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:12:56.511684 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05349502-da48-46d1-86a2-cc0681872cbc None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:12:56.513000 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05349502-da48-46d1-86a2-cc0681872cbc None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:12:56.513395 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05349502-da48-46d1-86a2-cc0681872cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:12:56.691587 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-05349502-da48-46d1-86a2-cc0681872cbc None None] MFA Rules not processed for user `e84ea976b5914aea94c4d8f805139daf`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:12:56.693199 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-05349502-da48-46d1-86a2-cc0681872cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:12:56.815995 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 677/1349] 10.222.0.15 () {58 vars in 1018 bytes} [Fri Aug 5 02:12:56 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:13:00.938422 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264ed00-96bf-47d8-b220-9c98fc7f54f7 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:00.939300 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264ed00-96bf-47d8-b220-9c98fc7f54f7 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:00.939597 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e264ed00-96bf-47d8-b220-9c98fc7f54f7 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:00.941163 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 673/1350] 10.222.0.15 () {54 vars in 921 bytes} [Fri Aug 5 02:13:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:13:00.946141 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c85af7-9147-4687-8bba-53ca14252e78 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:00.946557 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c85af7-9147-4687-8bba-53ca14252e78 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:00.946961 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c85af7-9147-4687-8bba-53ca14252e78 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:01.004119 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:01.031125 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-a4c85af7-9147-4687-8bba-53ca14252e78 None None] MFA Rules not processed for user `e84ea976b5914aea94c4d8f805139daf`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:13:01.032814 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-a4c85af7-9147-4687-8bba-53ca14252e78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:01.152551 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 678/1351] 10.222.0.15 () {58 vars in 1018 bytes} [Fri Aug 5 02:13:00 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:13:02.448378 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a31c5d-125b-47eb-b04a-f3b8937f2159 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:02.449458 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a31c5d-125b-47eb-b04a-f3b8937f2159 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:02.449458 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a31c5d-125b-47eb-b04a-f3b8937f2159 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:02.451014 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 674/1352] 10.222.0.15 () {54 vars in 921 bytes} [Fri Aug 5 02:13:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:13:02.456273 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0ff56-bb6f-43ce-87b5-f26f0e41f386 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:02.456730 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0ff56-bb6f-43ce-87b5-f26f0e41f386 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:02.456839 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db0ff56-bb6f-43ce-87b5-f26f0e41f386 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:02.535801 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-9db0ff56-bb6f-43ce-87b5-f26f0e41f386 None None] MFA Rules not processed for user `e84ea976b5914aea94c4d8f805139daf`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:13:02.537044 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-9db0ff56-bb6f-43ce-87b5-f26f0e41f386 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:02.580173 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:02.648298 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 679/1353] 10.222.0.15 () {58 vars in 1018 bytes} [Fri Aug 5 02:13:02 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:13:06.079924 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637c210-3692-4a6e-a025-8c84c2fbb005 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:06.081248 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637c210-3692-4a6e-a025-8c84c2fbb005 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:06.081703 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2637c210-3692-4a6e-a025-8c84c2fbb005 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:06.083272 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 675/1354] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:13:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:13:06.088839 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76984a7c-8ea3-4057-8605-19ed4cacad47 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:06.090360 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76984a7c-8ea3-4057-8605-19ed4cacad47 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:06.090845 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76984a7c-8ea3-4057-8605-19ed4cacad47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:06.172119 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-76984a7c-8ea3-4057-8605-19ed4cacad47 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:13:06.173377 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-76984a7c-8ea3-4057-8605-19ed4cacad47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:06.276868 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 680/1355] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:13:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:13:06.332899 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99dec1-d546-414d-b86a-df0aca852279 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:06.333550 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99dec1-d546-414d-b86a-df0aca852279 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:06.334215 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f99dec1-d546-414d-b86a-df0aca852279 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:06.336207 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 676/1356] 10.222.0.15 () {54 vars in 962 bytes} [Fri Aug 5 02:13:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:13:06.344817 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0d971-85af-4efb-acf0-e4365b9b8874 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:06.345654 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0d971-85af-4efb-acf0-e4365b9b8874 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:06.346155 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb0d971-85af-4efb-acf0-e4365b9b8874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:06.369589 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:06.438050 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-9fb0d971-85af-4efb-acf0-e4365b9b8874 None None] MFA Rules not processed for user `4b5c0958604b436daa44b1f67c9dec26`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:13:06.439257 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-9fb0d971-85af-4efb-acf0-e4365b9b8874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:06.561394 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 681/1357] 10.222.0.15 () {58 vars in 1059 bytes} [Fri Aug 5 02:13:06 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:13:06.569337 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f99dec1-d546-414d-b86a-df0aca852279 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:13:06.570849 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9f99dec1-d546-414d-b86a-df0aca852279 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:06.742710 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f99dec1-d546-414d-b86a-df0aca852279 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:13:06.822011 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:06.879572 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1f4968-caa3-4c9d-b067-f33177f62033 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:13:06.880348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f4968-caa3-4c9d-b067-f33177f62033 service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:06.880701 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f4968-caa3-4c9d-b067-f33177f62033 service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:06.881048 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1f4968-caa3-4c9d-b067-f33177f62033 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:06.882754 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9d1f4968-caa3-4c9d-b067-f33177f62033 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:06.977353 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1f4968-caa3-4c9d-b067-f33177f62033 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:13:06.979045 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d1f4968-caa3-4c9d-b067-f33177f62033 service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:13:06.998643 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 677/1358] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:13:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 430 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:13:09.217547 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5ac16-f24c-45ca-8e00-bb67149eeb7a None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:09.218142 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5ac16-f24c-45ca-8e00-bb67149eeb7a None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:09.218142 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f5ac16-f24c-45ca-8e00-bb67149eeb7a None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:09.219680 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 682/1359] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:13:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:13:09.224983 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256355b-623d-4ef0-9294-a3b50ce94826 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:09.225411 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256355b-623d-4ef0-9294-a3b50ce94826 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:09.225531 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9256355b-623d-4ef0-9294-a3b50ce94826 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:09.304255 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-9256355b-623d-4ef0-9294-a3b50ce94826 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:13:09.305469 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9256355b-623d-4ef0-9294-a3b50ce94826 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:09.347349 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:09.416549 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 678/1360] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:13:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:13:09.462776 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f5ac16-f24c-45ca-8e00-bb67149eeb7a None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:13:09.464599 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-b7f5ac16-f24c-45ca-8e00-bb67149eeb7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:09.547538 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:09.655342 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f5ac16-f24c-45ca-8e00-bb67149eeb7a None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:13:09.781987 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6eb01a-f6d4-4419-9696-5c1546f29e7f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:13:09.782618 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6eb01a-f6d4-4419-9696-5c1546f29e7f service nova] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:09.782897 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6eb01a-f6d4-4419-9696-5c1546f29e7f service nova] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:09.783222 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6eb01a-f6d4-4419-9696-5c1546f29e7f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:09.784958 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-eb6eb01a-f6d4-4419-9696-5c1546f29e7f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:09.810136 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:09.883442 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6eb01a-f6d4-4419-9696-5c1546f29e7f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:13:09.885189 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6eb01a-f6d4-4419-9696-5c1546f29e7f service nova] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:13:09.904880 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 683/1361] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:13:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:13:12.279488 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381966a0-64ac-438d-994d-65ce3ee1f53b None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:12.280050 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381966a0-64ac-438d-994d-65ce3ee1f53b None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:12.280050 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381966a0-64ac-438d-994d-65ce3ee1f53b None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:12.281494 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 679/1362] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:13:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:13:12.286775 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c017a-2566-4cf0-892a-4a71bc67c38c None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:12.287554 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c017a-2566-4cf0-892a-4a71bc67c38c None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:12.287836 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-294c017a-2566-4cf0-892a-4a71bc67c38c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:12.369086 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-294c017a-2566-4cf0-892a-4a71bc67c38c None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:13:12.370315 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-294c017a-2566-4cf0-892a-4a71bc67c38c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:12.477226 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:12.479879 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 684/1363] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:13:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:13:12.528028 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e57f4-f34e-40c8-84fc-003cda3304b0 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:12.528447 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e57f4-f34e-40c8-84fc-003cda3304b0 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:12.528823 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523e57f4-f34e-40c8-84fc-003cda3304b0 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:12.530281 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 680/1364] 10.222.0.15 () {54 vars in 962 bytes} [Fri Aug 5 02:13:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:13:12.536446 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f2294-16b9-4f89-ac79-5298c9616877 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:12.536845 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f2294-16b9-4f89-ac79-5298c9616877 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:12.537076 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-583f2294-16b9-4f89-ac79-5298c9616877 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:12.618622 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-583f2294-16b9-4f89-ac79-5298c9616877 None None] MFA Rules not processed for user `4b5c0958604b436daa44b1f67c9dec26`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:13:12.619845 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-583f2294-16b9-4f89-ac79-5298c9616877 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:12.748006 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 685/1365] 10.222.0.15 () {58 vars in 1059 bytes} [Fri Aug 5 02:13:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:13:12.755822 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e57f4-f34e-40c8-84fc-003cda3304b0 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:13:12.757394 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-523e57f4-f34e-40c8-84fc-003cda3304b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:12.927858 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523e57f4-f34e-40c8-84fc-003cda3304b0 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:13:12.950322 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:13.050937 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496b0bd5-9f8e-4093-bbee-879cbb52e0c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:13:13.051458 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b0bd5-9f8e-4093-bbee-879cbb52e0c4 service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:13.051738 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b0bd5-9f8e-4093-bbee-879cbb52e0c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:13.052009 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496b0bd5-9f8e-4093-bbee-879cbb52e0c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:13.053694 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-496b0bd5-9f8e-4093-bbee-879cbb52e0c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:13.147702 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496b0bd5-9f8e-4093-bbee-879cbb52e0c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:13:13.149360 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496b0bd5-9f8e-4093-bbee-879cbb52e0c4 service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:13:13.170838 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 681/1366] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:13:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:13:14.249741 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561498e2-e298-47a1-81d1-76b25812e424 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:14.250278 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561498e2-e298-47a1-81d1-76b25812e424 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:14.250278 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561498e2-e298-47a1-81d1-76b25812e424 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:14.251677 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 686/1367] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:13:14.256841 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e7407-a901-4817-ae05-8981c9d4b839 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:14.257252 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e7407-a901-4817-ae05-8981c9d4b839 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:14.257426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c1e7407-a901-4817-ae05-8981c9d4b839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:14.291090 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:14.330549 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-6c1e7407-a901-4817-ae05-8981c9d4b839 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:13:14.331740 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-6c1e7407-a901-4817-ae05-8981c9d4b839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:14.441568 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 682/1368] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:13:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:13:14.798096 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf2dd9-213f-4a9b-9945-fd60ea2e6780 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:14.798547 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf2dd9-213f-4a9b-9945-fd60ea2e6780 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:14.798898 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25cf2dd9-213f-4a9b-9945-fd60ea2e6780 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:14.800569 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 687/1369] 10.222.0.15 () {54 vars in 964 bytes} [Fri Aug 5 02:13:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:13:14.805284 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4de0b-2b2b-4947-930e-2e8a1b65ebaa None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:14.805571 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4de0b-2b2b-4947-930e-2e8a1b65ebaa None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:14.805849 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d4de0b-2b2b-4947-930e-2e8a1b65ebaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:14.897195 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-a3d4de0b-2b2b-4947-930e-2e8a1b65ebaa None None] MFA Rules not processed for user `6a75ac3523564e1bb23469455fdba560`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:13:14.898723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-a3d4de0b-2b2b-4947-930e-2e8a1b65ebaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:14.953895 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:14.988256 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 683/1370] 10.222.0.15 () {58 vars in 1061 bytes} [Fri Aug 5 02:13:14 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:13:14.996878 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf2dd9-213f-4a9b-9945-fd60ea2e6780 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:13:14.998419 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-25cf2dd9-213f-4a9b-9945-fd60ea2e6780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:15.050183 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:15.107081 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25cf2dd9-213f-4a9b-9945-fd60ea2e6780 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:13:15.185139 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4480d-3a62-4ee1-bd42-465ed665ba7a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:13:15.185763 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4480d-3a62-4ee1-bd42-465ed665ba7a service cinder] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:15.186046 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4480d-3a62-4ee1-bd42-465ed665ba7a service cinder] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:15.186321 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4480d-3a62-4ee1-bd42-465ed665ba7a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:15.187977 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-dcb4480d-3a62-4ee1-bd42-465ed665ba7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:15.285718 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ee80c-155b-4b34-aefb-b1df08ff99df None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:15.286294 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ee80c-155b-4b34-aefb-b1df08ff99df None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:15.286294 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8ee80c-155b-4b34-aefb-b1df08ff99df None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:15.287881 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 684/1371] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:13:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:13:15.293562 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25904609-5597-4a1c-a497-ae3d653ceeb3 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:15.293958 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25904609-5597-4a1c-a497-ae3d653ceeb3 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:15.294142 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25904609-5597-4a1c-a497-ae3d653ceeb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:15.299932 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:15.315261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb4480d-3a62-4ee1-bd42-465ed665ba7a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:13:15.317456 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb4480d-3a62-4ee1-bd42-465ed665ba7a service cinder] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:13:15.341863 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 688/1372] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:13:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:13:15.373994 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-25904609-5597-4a1c-a497-ae3d653ceeb3 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:13:15.375481 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-25904609-5597-4a1c-a497-ae3d653ceeb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:15.489498 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 685/1373] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:13:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:13:15.538903 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4480d-3a62-4ee1-bd42-465ed665ba7a service cinder] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:13:15.540847 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-dcb4480d-3a62-4ee1-bd42-465ed665ba7a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:15.659722 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4480d-3a62-4ee1-bd42-465ed665ba7a service cinder] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:13:15.764420 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:15.776744 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06efc783-77d6-40a4-b832-026ed7957a1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:13:15.777457 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efc783-77d6-40a4-b832-026ed7957a1f service nova] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:15.777849 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efc783-77d6-40a4-b832-026ed7957a1f service nova] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:15.778136 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06efc783-77d6-40a4-b832-026ed7957a1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:15.779775 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-06efc783-77d6-40a4-b832-026ed7957a1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:15.878731 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06efc783-77d6-40a4-b832-026ed7957a1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:13:15.880248 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06efc783-77d6-40a4-b832-026ed7957a1f service nova] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:13:15.898453 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 689/1374] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:13:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 360 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:13:17.954353 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f9858-b969-45af-9dfc-ff878aaffbbe None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:17.955248 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f9858-b969-45af-9dfc-ff878aaffbbe None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:17.955530 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6f9858-b969-45af-9dfc-ff878aaffbbe None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:17.956940 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 686/1375] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:13:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:13:17.962166 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e125da6-fe61-4b3d-9433-8b2f11f456e9 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:17.962584 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e125da6-fe61-4b3d-9433-8b2f11f456e9 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:17.962711 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e125da6-fe61-4b3d-9433-8b2f11f456e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:18.034863 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-6e125da6-fe61-4b3d-9433-8b2f11f456e9 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:13:18.036083 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-6e125da6-fe61-4b3d-9433-8b2f11f456e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:18.099414 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:18.143233 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 690/1376] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:13:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:13:18.188769 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f9858-b969-45af-9dfc-ff878aaffbbe None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:13:18.190302 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9f6f9858-b969-45af-9dfc-ff878aaffbbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:18.243228 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:18.350877 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6f9858-b969-45af-9dfc-ff878aaffbbe None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:13:18.485491 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bf93af-3656-441f-a0a8-b90e1cad98de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:13:18.486107 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf93af-3656-441f-a0a8-b90e1cad98de service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:18.486386 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf93af-3656-441f-a0a8-b90e1cad98de service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:18.486657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bf93af-3656-441f-a0a8-b90e1cad98de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:18.488275 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-29bf93af-3656-441f-a0a8-b90e1cad98de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:18.500031 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:18.580881 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf93af-3656-441f-a0a8-b90e1cad98de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:13:18.582634 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bf93af-3656-441f-a0a8-b90e1cad98de service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:13:18.600560 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 687/1377] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:13:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:13:20.676586 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fb95e-bcd7-4eb0-bc82-3379026c5370 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:20.677158 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fb95e-bcd7-4eb0-bc82-3379026c5370 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:20.677158 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250fb95e-bcd7-4eb0-bc82-3379026c5370 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:20.678642 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 691/1378] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:13:20.683959 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09e61e-df8d-43a8-9da1-d921c19b53c4 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:20.684455 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09e61e-df8d-43a8-9da1-d921c19b53c4 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:20.684723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e09e61e-df8d-43a8-9da1-d921c19b53c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:20.758663 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-1e09e61e-df8d-43a8-9da1-d921c19b53c4 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:13:20.759875 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-1e09e61e-df8d-43a8-9da1-d921c19b53c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:20.858268 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:20.873058 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 688/1379] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:13:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:13:20.918436 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fb95e-bcd7-4eb0-bc82-3379026c5370 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:13:20.920075 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-250fb95e-bcd7-4eb0-bc82-3379026c5370 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:21.091565 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250fb95e-bcd7-4eb0-bc82-3379026c5370 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:13:21.141994 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:21.212653 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046ae48f-0be1-4983-9c7a-f6bddda8c1f2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:13:21.213271 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ae48f-0be1-4983-9c7a-f6bddda8c1f2 service nova] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:21.213690 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ae48f-0be1-4983-9c7a-f6bddda8c1f2 service nova] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:21.213973 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046ae48f-0be1-4983-9c7a-f6bddda8c1f2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:21.215714 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-046ae48f-0be1-4983-9c7a-f6bddda8c1f2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:21.315814 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046ae48f-0be1-4983-9c7a-f6bddda8c1f2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:13:21.317446 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046ae48f-0be1-4983-9c7a-f6bddda8c1f2 service nova] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:13:21.336366 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 692/1380] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:13:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:13:23.400356 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0803c-ceb4-46e0-a19d-5ce1ad596b36 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:23.400926 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0803c-ceb4-46e0-a19d-5ce1ad596b36 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:23.401096 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c0803c-ceb4-46e0-a19d-5ce1ad596b36 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:23.403588 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 689/1381] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:13:23 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:13:23.408819 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c3df7-9ce9-421b-9569-c5993462acef None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:23.409251 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c3df7-9ce9-421b-9569-c5993462acef None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:23.409361 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68c3df7-9ce9-421b-9569-c5993462acef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:23.486223 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-b68c3df7-9ce9-421b-9569-c5993462acef None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:13:23.487805 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-b68c3df7-9ce9-421b-9569-c5993462acef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:23.490420 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:23.596991 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 693/1382] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:13:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:13:23.641103 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0803c-ceb4-46e0-a19d-5ce1ad596b36 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:13:23.642681 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-66c0803c-ceb4-46e0-a19d-5ce1ad596b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:23.797911 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c0803c-ceb4-46e0-a19d-5ce1ad596b36 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:13:23.864098 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:23.917037 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f6a54-cb6b-4e66-bbf1-65e07e602b56 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:13:23.917657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f6a54-cb6b-4e66-bbf1-65e07e602b56 service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:23.918717 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f6a54-cb6b-4e66-bbf1-65e07e602b56 service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:23.918978 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f6a54-cb6b-4e66-bbf1-65e07e602b56 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:23.920592 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-1c8f6a54-cb6b-4e66-bbf1-65e07e602b56 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:24.010820 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f6a54-cb6b-4e66-bbf1-65e07e602b56 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:13:24.012569 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f6a54-cb6b-4e66-bbf1-65e07e602b56 service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:13:24.030962 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 690/1383] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:13:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:13:26.154651 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf6f26-06ea-4317-ae9a-fedaa02cede2 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:26.155231 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf6f26-06ea-4317-ae9a-fedaa02cede2 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:26.155231 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdcf6f26-06ea-4317-ae9a-fedaa02cede2 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:26.156593 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 694/1384] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:13:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:13:26.162740 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd47ff-875a-4e8d-9bbb-413c5ec7cb20 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:26.163158 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd47ff-875a-4e8d-9bbb-413c5ec7cb20 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:26.163293 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5fd47ff-875a-4e8d-9bbb-413c5ec7cb20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:26.234564 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-e5fd47ff-875a-4e8d-9bbb-413c5ec7cb20 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:13:26.235804 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-e5fd47ff-875a-4e8d-9bbb-413c5ec7cb20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:26.261184 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:26.335508 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 691/1385] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:13:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:13:26.384525 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf6f26-06ea-4317-ae9a-fedaa02cede2 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:13:26.386049 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-fdcf6f26-06ea-4317-ae9a-fedaa02cede2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:26.522646 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:26.541890 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdcf6f26-06ea-4317-ae9a-fedaa02cede2 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:13:26.658693 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7df2ab9-19ac-43a0-a3f0-df722c4ac5bc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:13:26.659310 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df2ab9-19ac-43a0-a3f0-df722c4ac5bc service nova] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:26.659606 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df2ab9-19ac-43a0-a3f0-df722c4ac5bc service nova] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:26.659862 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7df2ab9-19ac-43a0-a3f0-df722c4ac5bc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:26.661519 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-a7df2ab9-19ac-43a0-a3f0-df722c4ac5bc service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:26.755982 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df2ab9-19ac-43a0-a3f0-df722c4ac5bc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:13:26.757646 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7df2ab9-19ac-43a0-a3f0-df722c4ac5bc service nova] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:13:26.763242 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:26.778065 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 695/1386] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:13:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:13:29.095543 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0f852-5037-44a9-9e20-9ad293cb7b89 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:29.096106 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0f852-5037-44a9-9e20-9ad293cb7b89 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:29.096106 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc0f852-5037-44a9-9e20-9ad293cb7b89 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:29.097402 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 692/1387] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:13:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:13:29.102508 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51dfde-fb5f-46e1-a58a-5ebd61583601 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:29.102921 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51dfde-fb5f-46e1-a58a-5ebd61583601 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:29.103065 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea51dfde-fb5f-46e1-a58a-5ebd61583601 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:29.172553 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-ea51dfde-fb5f-46e1-a58a-5ebd61583601 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:13:29.173797 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-ea51dfde-fb5f-46e1-a58a-5ebd61583601 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:29.271084 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 696/1388] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:13:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:13:29.315438 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0f852-5037-44a9-9e20-9ad293cb7b89 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:13:29.316985 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9fc0f852-5037-44a9-9e20-9ad293cb7b89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:29.465516 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc0f852-5037-44a9-9e20-9ad293cb7b89 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:13:29.474932 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:29.584860 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f7e9352-e66d-41df-b8dc-f9baabec4929 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:13:29.585478 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e9352-e66d-41df-b8dc-f9baabec4929 service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:29.585755 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e9352-e66d-41df-b8dc-f9baabec4929 service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:29.586025 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f7e9352-e66d-41df-b8dc-f9baabec4929 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:29.587646 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9f7e9352-e66d-41df-b8dc-f9baabec4929 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:29.677383 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e9352-e66d-41df-b8dc-f9baabec4929 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:13:29.678998 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f7e9352-e66d-41df-b8dc-f9baabec4929 service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:13:29.698073 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 693/1389] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:13:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 383 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:13:30.466243 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfeca2e-b3f4-4a13-8158-8efaa599f755 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:30.466793 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfeca2e-b3f4-4a13-8158-8efaa599f755 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:30.466793 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfeca2e-b3f4-4a13-8158-8efaa599f755 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:30.468135 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 697/1390] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:13:30.473586 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51676a58-32ae-49dd-8aee-e466968b61e1 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:30.474042 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51676a58-32ae-49dd-8aee-e466968b61e1 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:30.474135 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51676a58-32ae-49dd-8aee-e466968b61e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:30.490255 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:30.544931 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-51676a58-32ae-49dd-8aee-e466968b61e1 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:13:30.546160 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-51676a58-32ae-49dd-8aee-e466968b61e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:30.643888 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 694/1391] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:13:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:13:30.700575 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9ec16-03cc-42eb-9adb-26e8bbbbcb7b None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:30.700932 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9ec16-03cc-42eb-9adb-26e8bbbbcb7b None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:30.701223 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb9ec16-03cc-42eb-9adb-26e8bbbbcb7b None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:30.702641 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 698/1392] 10.222.0.15 () {54 vars in 966 bytes} [Fri Aug 5 02:13:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:13:30.707918 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d0c8a-08be-4780-a01e-8eaf63b95291 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:30.708369 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d0c8a-08be-4780-a01e-8eaf63b95291 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:30.708651 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94d0c8a-08be-4780-a01e-8eaf63b95291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:30.786752 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-e94d0c8a-08be-4780-a01e-8eaf63b95291 None None] MFA Rules not processed for user `5c09080c507f4c35b81d482cfbaa6a88`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:13:30.787856 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-e94d0c8a-08be-4780-a01e-8eaf63b95291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:30.823021 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:30.869341 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 695/1393] 10.222.0.15 () {58 vars in 1063 bytes} [Fri Aug 5 02:13:30 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:13:30.876789 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9ec16-03cc-42eb-9adb-26e8bbbbcb7b None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:13:30.878395 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-0cb9ec16-03cc-42eb-9adb-26e8bbbbcb7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:30.951969 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:30.983545 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb9ec16-03cc-42eb-9adb-26e8bbbbcb7b None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:13:31.056155 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a01f9-4e3f-4bdd-a624-53eb383f61ac service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c09080c507f4c35b81d482cfbaa6a88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:13:31.056834 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a01f9-4e3f-4bdd-a624-53eb383f61ac service glance] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:31.057114 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a01f9-4e3f-4bdd-a624-53eb383f61ac service glance] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:31.057384 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a01f9-4e3f-4bdd-a624-53eb383f61ac service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:31.059065 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-c08a01f9-4e3f-4bdd-a624-53eb383f61ac service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:31.170360 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a01f9-4e3f-4bdd-a624-53eb383f61ac service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:13:31.171819 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c08a01f9-4e3f-4bdd-a624-53eb383f61ac service glance] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:13:31.187665 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:31.190955 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 699/1394] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:13:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:13:31.725988 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d667da-ea67-4316-9a1e-47ce57d5c644 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:31.726516 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d667da-ea67-4316-9a1e-47ce57d5c644 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:31.726625 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d667da-ea67-4316-9a1e-47ce57d5c644 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:31.727915 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 696/1395] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:13:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:13:31.733252 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a313ff-1c22-4562-9d47-f6fd899ccab9 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:31.733707 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a313ff-1c22-4562-9d47-f6fd899ccab9 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:31.733810 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a313ff-1c22-4562-9d47-f6fd899ccab9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:31.803955 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-34a313ff-1c22-4562-9d47-f6fd899ccab9 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:13:31.805276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-34a313ff-1c22-4562-9d47-f6fd899ccab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:31.914159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 700/1396] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:13:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:13:31.956632 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b45c0c-7660-4735-84a3-4e0a61334f23 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:31.956924 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b45c0c-7660-4735-84a3-4e0a61334f23 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:31.957207 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b45c0c-7660-4735-84a3-4e0a61334f23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:31.959170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a313ff-1c22-4562-9d47-f6fd899ccab9 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:13:31.960410 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-34a313ff-1c22-4562-9d47-f6fd899ccab9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:32.025624 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-f4b45c0c-7660-4735-84a3-4e0a61334f23 None None] MFA Rules not processed for user `36970f0778384576b599cd7217b5084d`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:13:32.026894 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-f4b45c0c-7660-4735-84a3-4e0a61334f23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:32.038013 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:32.078696 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a313ff-1c22-4562-9d47-f6fd899ccab9 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:13:32.118376 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 697/1397] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Aug 5 02:13:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:13:32.161856 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11bfa0-1d3d-412b-a2f3-e3ff0590a4d6 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:32.162148 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11bfa0-1d3d-412b-a2f3-e3ff0590a4d6 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:32.162430 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d11bfa0-1d3d-412b-a2f3-e3ff0590a4d6 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:32.163842 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 698/1398] 10.222.0.15 () {54 vars in 943 bytes} [Fri Aug 5 02:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:13:32.170765 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fec2aa-ce96-4193-95e6-a15b2e757215 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:32.171052 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fec2aa-ce96-4193-95e6-a15b2e757215 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:32.171355 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05fec2aa-ce96-4193-95e6-a15b2e757215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:32.199011 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86fc7e-4d6c-4d8a-92df-7fd11f53ea17 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:13:32.200099 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86fc7e-4d6c-4d8a-92df-7fd11f53ea17 service nova] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:32.200410 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86fc7e-4d6c-4d8a-92df-7fd11f53ea17 service nova] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:32.200692 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c86fc7e-4d6c-4d8a-92df-7fd11f53ea17 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:32.202340 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-5c86fc7e-4d6c-4d8a-92df-7fd11f53ea17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:32.235177 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:32.254900 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-05fec2aa-ce96-4193-95e6-a15b2e757215 None None] MFA Rules not processed for user `f03233b0ee3540cdb5105f6603cfdff5`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:13:32.256119 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-05fec2aa-ce96-4193-95e6-a15b2e757215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:32.280796 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:32.297426 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86fc7e-4d6c-4d8a-92df-7fd11f53ea17 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:13:32.299027 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c86fc7e-4d6c-4d8a-92df-7fd11f53ea17 service nova] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:13:32.321358 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 701/1399] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:13:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:13:32.372153 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 699/1400] 10.222.0.15 () {58 vars in 1040 bytes} [Fri Aug 5 02:13:32 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:13:32.382307 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86fc7e-4d6c-4d8a-92df-7fd11f53ea17 service nova] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:13:32.383544 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-5c86fc7e-4d6c-4d8a-92df-7fd11f53ea17 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:32.479181 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c86fc7e-4d6c-4d8a-92df-7fd11f53ea17 service nova] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:13:32.595441 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0187bc01-e691-4e99-8b1a-6ab16ec9e613 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f03233b0ee3540cdb5105f6603cfdff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:13:32.596094 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187bc01-e691-4e99-8b1a-6ab16ec9e613 service swift] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:32.596407 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187bc01-e691-4e99-8b1a-6ab16ec9e613 service swift] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:32.596688 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0187bc01-e691-4e99-8b1a-6ab16ec9e613 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:32.598385 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-0187bc01-e691-4e99-8b1a-6ab16ec9e613 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:32.605804 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:32.683003 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0187bc01-e691-4e99-8b1a-6ab16ec9e613 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:13:32.685408 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0187bc01-e691-4e99-8b1a-6ab16ec9e613 service swift] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:13:32.693569 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 702/1401] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Aug 5 02:13:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 02:13:34.375261 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278f726-7147-441f-b2e6-52705283021f None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:34.375847 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278f726-7147-441f-b2e6-52705283021f None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:34.375847 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9278f726-7147-441f-b2e6-52705283021f None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:34.377402 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 700/1402] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:13:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:13:34.382350 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e1a25-5926-4e93-8800-d1e85147d330 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:34.382801 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e1a25-5926-4e93-8800-d1e85147d330 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:34.382898 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d0e1a25-5926-4e93-8800-d1e85147d330 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:34.453764 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-5d0e1a25-5926-4e93-8800-d1e85147d330 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:13:34.454995 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-5d0e1a25-5926-4e93-8800-d1e85147d330 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:34.598943 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:34.602077 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 703/1403] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:13:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:13:34.647996 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278f726-7147-441f-b2e6-52705283021f None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:13:34.649635 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9278f726-7147-441f-b2e6-52705283021f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:34.768408 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:34.819827 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9278f726-7147-441f-b2e6-52705283021f None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:13:34.960903 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab2361a3-eddc-4470-b021-dc0ec83862a4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:13:34.961735 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2361a3-eddc-4470-b021-dc0ec83862a4 service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:34.961981 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2361a3-eddc-4470-b021-dc0ec83862a4 service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:34.962317 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2361a3-eddc-4470-b021-dc0ec83862a4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:34.964058 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-ab2361a3-eddc-4470-b021-dc0ec83862a4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:35.046769 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:35.068427 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2361a3-eddc-4470-b021-dc0ec83862a4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:13:35.070088 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab2361a3-eddc-4470-b021-dc0ec83862a4 service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:13:35.088640 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 701/1404] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:13:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:13:37.198390 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ce639-56a8-4066-b3ae-7cd47571457f None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:37.198995 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ce639-56a8-4066-b3ae-7cd47571457f None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:37.198995 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44ce639-56a8-4066-b3ae-7cd47571457f None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:37.202855 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 704/1405] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:13:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:13:37.208339 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eca226-8769-428e-8359-8e0acf55b73b None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:37.208831 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eca226-8769-428e-8359-8e0acf55b73b None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:37.208921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1eca226-8769-428e-8359-8e0acf55b73b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:37.286633 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-b1eca226-8769-428e-8359-8e0acf55b73b None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:13:37.287973 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-b1eca226-8769-428e-8359-8e0acf55b73b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:37.396476 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 702/1406] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:13:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:13:37.438227 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ce639-56a8-4066-b3ae-7cd47571457f None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:13:37.439955 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-e44ce639-56a8-4066-b3ae-7cd47571457f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:37.606784 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44ce639-56a8-4066-b3ae-7cd47571457f None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:13:37.692341 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:37.736310 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3eab60-066b-4a03-ae18-9f2d53a5fe4a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:13:37.736977 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3eab60-066b-4a03-ae18-9f2d53a5fe4a service nova] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:37.737246 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3eab60-066b-4a03-ae18-9f2d53a5fe4a service nova] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:37.737512 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3eab60-066b-4a03-ae18-9f2d53a5fe4a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:37.739140 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-2a3eab60-066b-4a03-ae18-9f2d53a5fe4a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:37.842070 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3eab60-066b-4a03-ae18-9f2d53a5fe4a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:13:37.843786 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3eab60-066b-4a03-ae18-9f2d53a5fe4a service nova] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:13:37.865853 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 705/1407] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:13:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:13:47.392090 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=79 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:47.863120 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=62 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:55.216716 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca62b63-8ab1-4d1e-8ac9-141c17409dd1 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:55.217261 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca62b63-8ab1-4d1e-8ac9-141c17409dd1 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:55.217390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca62b63-8ab1-4d1e-8ac9-141c17409dd1 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:55.218670 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 703/1408] 10.222.0.15 () {54 vars in 918 bytes} [Fri Aug 5 02:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:13:55.224132 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc486014-6dcb-417d-a191-b780e81a520d None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:55.224584 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc486014-6dcb-417d-a191-b780e81a520d None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:55.224712 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc486014-6dcb-417d-a191-b780e81a520d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:55.300643 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-cc486014-6dcb-417d-a191-b780e81a520d None None] MFA Rules not processed for user `e84ea976b5914aea94c4d8f805139daf`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:13:55.301842 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-cc486014-6dcb-417d-a191-b780e81a520d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:55.408241 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 706/1409] 10.222.0.15 () {58 vars in 1015 bytes} [Fri Aug 5 02:13:55 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:13:55.423357 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78c7bd-004f-4a1c-8613-b65aa8d57b56 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:55.423728 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78c7bd-004f-4a1c-8613-b65aa8d57b56 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:55.424000 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a78c7bd-004f-4a1c-8613-b65aa8d57b56 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:55.425377 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 704/1410] 10.222.0.15 () {54 vars in 918 bytes} [Fri Aug 5 02:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:13:55.429828 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825ab1b-f5a2-4289-9d27-7c10abb5946f None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:55.430119 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825ab1b-f5a2-4289-9d27-7c10abb5946f None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:55.430398 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7825ab1b-f5a2-4289-9d27-7c10abb5946f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:55.504403 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:55.507709 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-7825ab1b-f5a2-4289-9d27-7c10abb5946f None None] MFA Rules not processed for user `4b5c0958604b436daa44b1f67c9dec26`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:13:55.509077 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-7825ab1b-f5a2-4289-9d27-7c10abb5946f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:55.626081 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 707/1411] 10.222.0.15 () {58 vars in 1015 bytes} [Fri Aug 5 02:13:55 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:13:58.131571 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315757f7-0147-493d-bb22-4c411af836ff None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:58.132090 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315757f7-0147-493d-bb22-4c411af836ff None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:58.132090 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-315757f7-0147-493d-bb22-4c411af836ff None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:58.133422 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 705/1412] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 02:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:13:58.139150 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f3913-2c5f-4921-b92c-8f57a70ef163 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:58.139605 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f3913-2c5f-4921-b92c-8f57a70ef163 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:58.139703 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144f3913-2c5f-4921-b92c-8f57a70ef163 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:58.205313 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-144f3913-2c5f-4921-b92c-8f57a70ef163 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:13:58.206505 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-144f3913-2c5f-4921-b92c-8f57a70ef163 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:58.260221 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:58.302796 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 708/1413] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 02:13:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:13:58.346966 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315757f7-0147-493d-bb22-4c411af836ff None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:13:58.348533 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-315757f7-0147-493d-bb22-4c411af836ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:58.492551 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-315757f7-0147-493d-bb22-4c411af836ff None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:13:58.564287 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:58.606156 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6663da7-3712-4e6f-878a-33655a879b82 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:13:58.606986 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6663da7-3712-4e6f-878a-33655a879b82 service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:58.607367 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6663da7-3712-4e6f-878a-33655a879b82 service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:58.607523 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6663da7-3712-4e6f-878a-33655a879b82 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:58.609195 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-e6663da7-3712-4e6f-878a-33655a879b82 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:58.696073 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6663da7-3712-4e6f-878a-33655a879b82 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:13:58.697749 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6663da7-3712-4e6f-878a-33655a879b82 service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:13:58.716560 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 706/1414] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:13:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:13:59.619644 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7989c-75d3-49c4-b5e7-d2eab219cfc1 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:59.620165 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7989c-75d3-49c4-b5e7-d2eab219cfc1 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:59.620263 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df7989c-75d3-49c4-b5e7-d2eab219cfc1 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:59.621588 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 709/1415] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 02:13:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:13:59.626409 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bec0a6-9d33-49fb-a5c8-e19296f98132 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:13:59.626815 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bec0a6-9d33-49fb-a5c8-e19296f98132 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:13:59.626959 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3bec0a6-9d33-49fb-a5c8-e19296f98132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:13:59.703330 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-b3bec0a6-9d33-49fb-a5c8-e19296f98132 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:13:59.704559 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-b3bec0a6-9d33-49fb-a5c8-e19296f98132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:13:59.731572 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:13:59.800880 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 707/1416] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 02:13:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:13:59.959719 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7989c-75d3-49c4-b5e7-d2eab219cfc1 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:13:59.961294 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-3df7989c-75d3-49c4-b5e7-d2eab219cfc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:00.106407 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df7989c-75d3-49c4-b5e7-d2eab219cfc1 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:14:00.147055 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:14:00.221524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-419fb6fb-d1b2-45aa-a326-864a11e21609 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:14:00.222047 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fb6fb-d1b2-45aa-a326-864a11e21609 service nova] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:00.222324 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fb6fb-d1b2-45aa-a326-864a11e21609 service nova] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:00.222596 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-419fb6fb-d1b2-45aa-a326-864a11e21609 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:00.224268 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-419fb6fb-d1b2-45aa-a326-864a11e21609 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:00.315056 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419fb6fb-d1b2-45aa-a326-864a11e21609 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:14:00.316693 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-419fb6fb-d1b2-45aa-a326-864a11e21609 service nova] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:14:00.334675 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 710/1417] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:13:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:14:01.217739 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0f354-1179-4b67-a36f-76a2bb44254a None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:01.218326 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0f354-1179-4b67-a36f-76a2bb44254a None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:01.218326 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0f354-1179-4b67-a36f-76a2bb44254a None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:01.219636 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 708/1418] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 02:14:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:14:01.224912 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003da69-a9f4-4fa4-ad0f-e0db100d4fec None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:01.225403 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003da69-a9f4-4fa4-ad0f-e0db100d4fec None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:01.225500 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3003da69-a9f4-4fa4-ad0f-e0db100d4fec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:01.280182 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:14:01.302448 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-3003da69-a9f4-4fa4-ad0f-e0db100d4fec None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:14:01.303673 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-3003da69-a9f4-4fa4-ad0f-e0db100d4fec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:01.400406 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 711/1419] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 02:14:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:14:01.553657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0f354-1179-4b67-a36f-76a2bb44254a None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:14:01.555132 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-0fc0f354-1179-4b67-a36f-76a2bb44254a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:01.699129 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0f354-1179-4b67-a36f-76a2bb44254a None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:14:01.710983 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:14:01.812185 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74e43c2-d83d-4030-86f4-46302170cfe3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:14:01.812753 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e43c2-d83d-4030-86f4-46302170cfe3 service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:01.813038 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e43c2-d83d-4030-86f4-46302170cfe3 service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:01.813331 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74e43c2-d83d-4030-86f4-46302170cfe3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:01.814958 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-e74e43c2-d83d-4030-86f4-46302170cfe3 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:01.902735 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74e43c2-d83d-4030-86f4-46302170cfe3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:14:01.904303 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74e43c2-d83d-4030-86f4-46302170cfe3 service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:14:01.923145 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 709/1420] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:14:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:14:02.777066 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a4ca1-ace9-401a-abec-c0ff38001610 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:02.778092 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a4ca1-ace9-401a-abec-c0ff38001610 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:02.778092 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-010a4ca1-ace9-401a-abec-c0ff38001610 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:02.779145 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 712/1421] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 02:14:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:14:02.783892 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897aa2a-0bb3-475c-88c2-548526ec9fc1 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:02.784299 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897aa2a-0bb3-475c-88c2-548526ec9fc1 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:02.784474 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c897aa2a-0bb3-475c-88c2-548526ec9fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:02.805215 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:14:02.864789 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-c897aa2a-0bb3-475c-88c2-548526ec9fc1 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:14:02.865937 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-c897aa2a-0bb3-475c-88c2-548526ec9fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:02.960968 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 710/1422] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 02:14:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:14:03.112841 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a4ca1-ace9-401a-abec-c0ff38001610 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:14:03.114381 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-010a4ca1-ace9-401a-abec-c0ff38001610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:03.223864 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:14:03.261182 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-010a4ca1-ace9-401a-abec-c0ff38001610 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:14:03.375074 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0b3990-8d03-4c2b-b7fa-e997fc4af6da service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:14:03.375685 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b3990-8d03-4c2b-b7fa-e997fc4af6da service nova] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:03.375962 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b3990-8d03-4c2b-b7fa-e997fc4af6da service nova] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:03.376230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0b3990-8d03-4c2b-b7fa-e997fc4af6da service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:03.377896 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-1e0b3990-8d03-4c2b-b7fa-e997fc4af6da service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:03.574235 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:14:03.588799 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b3990-8d03-4c2b-b7fa-e997fc4af6da service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:14:03.590475 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0b3990-8d03-4c2b-b7fa-e997fc4af6da service nova] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:14:03.609073 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 713/1423] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:14:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:14:04.472169 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30379e91-bf6b-45c2-b03d-5bada3569708 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:04.472757 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30379e91-bf6b-45c2-b03d-5bada3569708 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:04.472854 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30379e91-bf6b-45c2-b03d-5bada3569708 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:04.474165 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 711/1424] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 02:14:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:14:04.479040 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64af9a-abbf-41d6-a3e6-e9e415044694 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:04.479461 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64af9a-abbf-41d6-a3e6-e9e415044694 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:04.479578 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d64af9a-abbf-41d6-a3e6-e9e415044694 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:04.555245 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-0d64af9a-abbf-41d6-a3e6-e9e415044694 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:14:04.556556 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-0d64af9a-abbf-41d6-a3e6-e9e415044694 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:04.658161 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 714/1425] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 02:14:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:14:04.808089 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30379e91-bf6b-45c2-b03d-5bada3569708 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:14:04.810284 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-30379e91-bf6b-45c2-b03d-5bada3569708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:04.895531 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:14:04.960715 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30379e91-bf6b-45c2-b03d-5bada3569708 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:14:05.071022 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef30f36-abae-4107-a4cc-070809c4c1c1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:14:05.071557 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef30f36-abae-4107-a4cc-070809c4c1c1 service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:05.071832 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef30f36-abae-4107-a4cc-070809c4c1c1 service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:05.072101 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef30f36-abae-4107-a4cc-070809c4c1c1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:05.073749 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-eef30f36-abae-4107-a4cc-070809c4c1c1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:05.122514 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:14:05.166185 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef30f36-abae-4107-a4cc-070809c4c1c1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:14:05.167785 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef30f36-abae-4107-a4cc-070809c4c1c1 service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:14:05.188197 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 712/1426] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:14:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:14:05.991524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7bcacb-8c32-4b2a-8282-d551a1dfac2e None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:05.992095 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7bcacb-8c32-4b2a-8282-d551a1dfac2e None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:05.992095 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7bcacb-8c32-4b2a-8282-d551a1dfac2e None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:05.993477 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 715/1427] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 02:14:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:14:05.998338 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50a006-b871-45ee-8d14-f08bf6290de1 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:05.998758 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50a006-b871-45ee-8d14-f08bf6290de1 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:05.998888 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a50a006-b871-45ee-8d14-f08bf6290de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:06.073266 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-6a50a006-b871-45ee-8d14-f08bf6290de1 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:14:06.074466 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-6a50a006-b871-45ee-8d14-f08bf6290de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:06.169447 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 713/1428] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 02:14:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:14:06.319964 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7bcacb-8c32-4b2a-8282-d551a1dfac2e None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:14:06.321523 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-7e7bcacb-8c32-4b2a-8282-d551a1dfac2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:06.371805 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:14:06.466515 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7bcacb-8c32-4b2a-8282-d551a1dfac2e None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:14:06.578889 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80271f16-083d-45f1-a958-96cbfe92b2a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:14:06.579497 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80271f16-083d-45f1-a958-96cbfe92b2a6 service nova] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:06.579781 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80271f16-083d-45f1-a958-96cbfe92b2a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:06.580053 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80271f16-083d-45f1-a958-96cbfe92b2a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:06.581705 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-80271f16-083d-45f1-a958-96cbfe92b2a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:06.588539 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:14:06.673380 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80271f16-083d-45f1-a958-96cbfe92b2a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:14:06.674980 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80271f16-083d-45f1-a958-96cbfe92b2a6 service nova] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:14:06.694103 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 716/1429] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:14:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:14:07.507934 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a2e18-e523-4a7b-a200-668be1abb8e3 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:07.508655 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a2e18-e523-4a7b-a200-668be1abb8e3 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:07.508655 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4a2e18-e523-4a7b-a200-668be1abb8e3 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:07.509869 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 714/1430] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 02:14:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:14:07.515209 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135217e-8fb5-42dc-b4dd-1a2d3a4ffb1c None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:07.515690 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135217e-8fb5-42dc-b4dd-1a2d3a4ffb1c None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:07.515798 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b135217e-8fb5-42dc-b4dd-1a2d3a4ffb1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:07.590480 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-b135217e-8fb5-42dc-b4dd-1a2d3a4ffb1c None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:14:07.591777 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-b135217e-8fb5-42dc-b4dd-1a2d3a4ffb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:07.657793 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:14:07.686517 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 717/1431] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 02:14:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:14:07.836688 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a2e18-e523-4a7b-a200-668be1abb8e3 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:14:07.838231 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-1e4a2e18-e523-4a7b-a200-668be1abb8e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:07.856993 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:14:07.984345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4a2e18-e523-4a7b-a200-668be1abb8e3 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:14:08.072806 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:14:08.099511 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84753490-95be-468b-9be4-33846c851861 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:14:08.100064 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84753490-95be-468b-9be4-33846c851861 service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:08.100401 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84753490-95be-468b-9be4-33846c851861 service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:08.100677 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84753490-95be-468b-9be4-33846c851861 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:08.102291 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-84753490-95be-468b-9be4-33846c851861 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:08.190179 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84753490-95be-468b-9be4-33846c851861 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:14:08.191762 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84753490-95be-468b-9be4-33846c851861 service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:14:08.209385 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 715/1432] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:14:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:14:09.013902 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91480b-a094-414a-83db-662e40fe2a86 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:09.014478 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91480b-a094-414a-83db-662e40fe2a86 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:09.014478 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d91480b-a094-414a-83db-662e40fe2a86 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:09.015857 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 718/1433] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 02:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:14:09.020969 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cee7b-29b9-4a25-a000-c3f9e1e7110c None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:09.021417 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cee7b-29b9-4a25-a000-c3f9e1e7110c None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:09.021527 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051cee7b-29b9-4a25-a000-c3f9e1e7110c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:09.224613 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-051cee7b-29b9-4a25-a000-c3f9e1e7110c None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:14:09.225887 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-051cee7b-29b9-4a25-a000-c3f9e1e7110c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:09.267656 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:14:09.322641 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 716/1434] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 02:14:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:14:09.479425 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91480b-a094-414a-83db-662e40fe2a86 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:14:09.481135 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-2d91480b-a094-414a-83db-662e40fe2a86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:09.628878 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d91480b-a094-414a-83db-662e40fe2a86 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:14:09.682657 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:14:09.740960 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5862a528-ecd4-4838-ab55-8b3d471e6d11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:14:09.741567 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862a528-ecd4-4838-ab55-8b3d471e6d11 service nova] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:09.741843 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862a528-ecd4-4838-ab55-8b3d471e6d11 service nova] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:09.742113 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5862a528-ecd4-4838-ab55-8b3d471e6d11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:09.743756 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-5862a528-ecd4-4838-ab55-8b3d471e6d11 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:09.832889 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5862a528-ecd4-4838-ab55-8b3d471e6d11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:14:09.834493 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5862a528-ecd4-4838-ab55-8b3d471e6d11 service nova] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:14:09.852999 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 719/1435] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:14:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:14:10.653487 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7541a5-2f1f-4cb1-baa9-99ab35f2c4fe None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:10.653958 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7541a5-2f1f-4cb1-baa9-99ab35f2c4fe None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:10.654060 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c7541a5-2f1f-4cb1-baa9-99ab35f2c4fe None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:10.655423 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 717/1436] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 02:14:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:14:10.660248 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2f78d-4b05-4609-a11d-8183e065db6e None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:10.660750 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2f78d-4b05-4609-a11d-8183e065db6e None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:10.660860 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa2f78d-4b05-4609-a11d-8183e065db6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:10.736620 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-afa2f78d-4b05-4609-a11d-8183e065db6e None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:14:10.737826 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-afa2f78d-4b05-4609-a11d-8183e065db6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:10.739795 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:14:10.834450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 720/1437] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 02:14:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:14:10.985716 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7541a5-2f1f-4cb1-baa9-99ab35f2c4fe None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:14:10.987253 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-1c7541a5-2f1f-4cb1-baa9-99ab35f2c4fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:11.129701 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c7541a5-2f1f-4cb1-baa9-99ab35f2c4fe None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:14:11.157063 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:14:11.240795 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b7e040-88f6-4115-832a-917c4e708a16 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:14:11.241330 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7e040-88f6-4115-832a-917c4e708a16 service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:11.241603 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7e040-88f6-4115-832a-917c4e708a16 service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:11.241868 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b7e040-88f6-4115-832a-917c4e708a16 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:11.243471 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-b0b7e040-88f6-4115-832a-917c4e708a16 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:11.331425 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b7e040-88f6-4115-832a-917c4e708a16 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:14:11.333070 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b7e040-88f6-4115-832a-917c4e708a16 service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:14:11.351406 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 718/1438] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:14:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:14:13.262518 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6734a-a26b-45aa-ad44-1963f3ddf762 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:13.263068 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6734a-a26b-45aa-ad44-1963f3ddf762 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:13.263068 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f6734a-a26b-45aa-ad44-1963f3ddf762 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:13.264426 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 721/1439] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 02:14:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:14:13.269785 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaea2ee-ac9f-427f-8f62-08c36212ac62 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:13.270194 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaea2ee-ac9f-427f-8f62-08c36212ac62 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:13.270332 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddaea2ee-ac9f-427f-8f62-08c36212ac62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:13.312871 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:14:13.340193 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-ddaea2ee-ac9f-427f-8f62-08c36212ac62 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:14:13.341462 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-ddaea2ee-ac9f-427f-8f62-08c36212ac62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:13.435943 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 719/1440] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 02:14:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:14:13.490112 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bee353-8b90-4352-a352-7e9b1e7b8514 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:13.490488 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bee353-8b90-4352-a352-7e9b1e7b8514 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:13.490771 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4bee353-8b90-4352-a352-7e9b1e7b8514 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:13.492134 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 722/1441] 10.222.0.15 () {54 vars in 965 bytes} [Fri Aug 5 02:14:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:14:13.498301 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8381fbd-f554-4819-9b8d-e44be003cccc None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:13.498589 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8381fbd-f554-4819-9b8d-e44be003cccc None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:13.498868 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8381fbd-f554-4819-9b8d-e44be003cccc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:13.574158 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-d8381fbd-f554-4819-9b8d-e44be003cccc None None] MFA Rules not processed for user `f81daf3da9b34e7380c61005019a53bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:14:13.575367 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-d8381fbd-f554-4819-9b8d-e44be003cccc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:13.626815 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:14:13.650967 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 720/1442] 10.222.0.15 () {58 vars in 1062 bytes} [Fri Aug 5 02:14:13 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:14:13.660670 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bee353-8b90-4352-a352-7e9b1e7b8514 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:14:13.662260 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-f4bee353-8b90-4352-a352-7e9b1e7b8514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:13.765285 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4bee353-8b90-4352-a352-7e9b1e7b8514 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:14:13.797313 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:14:13.838817 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46b66c9-8e97-41a5-b5fa-90240fdafda7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:14:13.839429 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b66c9-8e97-41a5-b5fa-90240fdafda7 service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:13.839776 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b66c9-8e97-41a5-b5fa-90240fdafda7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:13.840684 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46b66c9-8e97-41a5-b5fa-90240fdafda7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:13.842404 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-c46b66c9-8e97-41a5-b5fa-90240fdafda7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:13.950729 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b66c9-8e97-41a5-b5fa-90240fdafda7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:14:13.952157 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46b66c9-8e97-41a5-b5fa-90240fdafda7 service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:14:13.970467 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 723/1443] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:14:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:14:16.523035 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d15330-4db7-42ac-a8f5-0b964460b434 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:16.523579 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d15330-4db7-42ac-a8f5-0b964460b434 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:16.523698 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10d15330-4db7-42ac-a8f5-0b964460b434 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:16.525080 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 721/1444] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 02:14:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:14:16.530471 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e81eeb-80ca-4944-9181-cad3aa4e174c None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:16.530885 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e81eeb-80ca-4944-9181-cad3aa4e174c None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:16.531028 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e81eeb-80ca-4944-9181-cad3aa4e174c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:16.599569 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-22e81eeb-80ca-4944-9181-cad3aa4e174c None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:14:16.600812 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-22e81eeb-80ca-4944-9181-cad3aa4e174c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:16.613587 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:14:16.700099 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 724/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 02:14:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:14:16.739133 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d15330-4db7-42ac-a8f5-0b964460b434 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:14:16.740710 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-10d15330-4db7-42ac-a8f5-0b964460b434 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:16.847010 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10d15330-4db7-42ac-a8f5-0b964460b434 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:14:16.920173 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96769a6-c54f-4a60-a0b4-beca29cdecca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:14:16.920819 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96769a6-c54f-4a60-a0b4-beca29cdecca service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:16.921099 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96769a6-c54f-4a60-a0b4-beca29cdecca service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:16.921371 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96769a6-c54f-4a60-a0b4-beca29cdecca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:16.923006 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-e96769a6-c54f-4a60-a0b4-beca29cdecca service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:16.953395 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:14:17.031360 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96769a6-c54f-4a60-a0b4-beca29cdecca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:14:17.032812 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96769a6-c54f-4a60-a0b4-beca29cdecca service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:14:17.050652 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 722/1446] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:14:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:14:19.420662 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34f35c-b6e7-41d3-89ba-f44cbbd73182 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:19.421219 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34f35c-b6e7-41d3-89ba-f44cbbd73182 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:19.421219 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d34f35c-b6e7-41d3-89ba-f44cbbd73182 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:19.422573 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 725/1447] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 02:14:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:14:19.427851 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae24d0b-e5af-40d3-a775-0c547d79202b None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:19.428275 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae24d0b-e5af-40d3-a775-0c547d79202b None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:19.428428 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae24d0b-e5af-40d3-a775-0c547d79202b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:19.494939 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-dae24d0b-e5af-40d3-a775-0c547d79202b None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:14:19.496161 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-dae24d0b-e5af-40d3-a775-0c547d79202b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:19.572736 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:14:19.595779 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 723/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 02:14:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:14:19.635104 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d34f35c-b6e7-41d3-89ba-f44cbbd73182 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:14:19.636716 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-1d34f35c-b6e7-41d3-89ba-f44cbbd73182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:19.738769 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d34f35c-b6e7-41d3-89ba-f44cbbd73182 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:14:19.778501 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:14:19.812758 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308c20fd-b00a-4e37-8144-891a7a180530 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:14:19.813371 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c20fd-b00a-4e37-8144-891a7a180530 service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:19.813652 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c20fd-b00a-4e37-8144-891a7a180530 service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:19.813924 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308c20fd-b00a-4e37-8144-891a7a180530 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:19.815550 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-308c20fd-b00a-4e37-8144-891a7a180530 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:19.926820 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308c20fd-b00a-4e37-8144-891a7a180530 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:14:19.928242 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308c20fd-b00a-4e37-8144-891a7a180530 service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:14:19.945958 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 726/1449] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:14:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:14:22.055851 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4badb75-760f-4472-8a84-85242322e8bc None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:22.056448 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4badb75-760f-4472-8a84-85242322e8bc None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:22.056448 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4badb75-760f-4472-8a84-85242322e8bc None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:22.057821 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 724/1450] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 02:14:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:14:22.063782 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be93cb-5ecb-48c8-967b-d152eac5afcf None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:22.064211 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be93cb-5ecb-48c8-967b-d152eac5afcf None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:22.064353 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be93cb-5ecb-48c8-967b-d152eac5afcf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:22.130579 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-48be93cb-5ecb-48c8-967b-d152eac5afcf None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:14:22.131704 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-48be93cb-5ecb-48c8-967b-d152eac5afcf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:22.151936 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:14:22.236778 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 727/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 02:14:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:14:22.277309 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4badb75-760f-4472-8a84-85242322e8bc None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:14:22.278845 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-c4badb75-760f-4472-8a84-85242322e8bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:22.385276 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4badb75-760f-4472-8a84-85242322e8bc None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:14:22.461859 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ab4d13a-22b2-4164-99ad-6719c3374164 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:14:22.462471 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4d13a-22b2-4164-99ad-6719c3374164 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:22.462746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4d13a-22b2-4164-99ad-6719c3374164 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:22.463011 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ab4d13a-22b2-4164-99ad-6719c3374164 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:22.464666 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-2ab4d13a-22b2-4164-99ad-6719c3374164 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:22.504300 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:14:22.572178 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4d13a-22b2-4164-99ad-6719c3374164 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:14:22.573622 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ab4d13a-22b2-4164-99ad-6719c3374164 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:14:22.592456 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 725/1452] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:14:22 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:14:24.650305 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55efa59-487d-4c74-9aff-0646c0ca9c08 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:24.650774 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55efa59-487d-4c74-9aff-0646c0ca9c08 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:24.650884 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f55efa59-487d-4c74-9aff-0646c0ca9c08 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:24.652184 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 728/1453] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 02:14:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:14:24.658083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e999ae-3fa0-490d-a54b-23926cd895b6 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:24.658530 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e999ae-3fa0-490d-a54b-23926cd895b6 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:24.658632 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e999ae-3fa0-490d-a54b-23926cd895b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:24.725345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-f4e999ae-3fa0-490d-a54b-23926cd895b6 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:14:24.726483 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-f4e999ae-3fa0-490d-a54b-23926cd895b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:24.816669 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:14:24.822826 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 726/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 02:14:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:14:24.861497 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55efa59-487d-4c74-9aff-0646c0ca9c08 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:14:24.863024 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-f55efa59-487d-4c74-9aff-0646c0ca9c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:24.965934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f55efa59-487d-4c74-9aff-0646c0ca9c08 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:14:25.015395 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:14:25.040063 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5131ca91-bd15-445c-b560-456e465158eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:14:25.040697 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131ca91-bd15-445c-b560-456e465158eb service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:25.040978 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131ca91-bd15-445c-b560-456e465158eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:25.041244 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5131ca91-bd15-445c-b560-456e465158eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:25.042850 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-5131ca91-bd15-445c-b560-456e465158eb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:25.150103 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5131ca91-bd15-445c-b560-456e465158eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:14:25.151541 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5131ca91-bd15-445c-b560-456e465158eb service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:14:25.170045 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 729/1455] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:14:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:14:27.250318 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b39d5-271c-4d43-b2ef-b2ffbb585807 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:27.250861 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b39d5-271c-4d43-b2ef-b2ffbb585807 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:27.250861 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856b39d5-271c-4d43-b2ef-b2ffbb585807 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:27.252228 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 727/1456] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 02:14:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:14:27.257526 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad20eec-7069-4656-9570-3f99bf001e4c None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:27.257936 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad20eec-7069-4656-9570-3f99bf001e4c None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:27.258087 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad20eec-7069-4656-9570-3f99bf001e4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:27.327275 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-9ad20eec-7069-4656-9570-3f99bf001e4c None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:14:27.328516 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-9ad20eec-7069-4656-9570-3f99bf001e4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:27.358192 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:14:27.425535 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 730/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 02:14:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:14:27.463700 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b39d5-271c-4d43-b2ef-b2ffbb585807 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:14:27.465371 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-856b39d5-271c-4d43-b2ef-b2ffbb585807 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:27.575786 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856b39d5-271c-4d43-b2ef-b2ffbb585807 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:14:27.648556 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f7f44e-d529-4d27-b82f-c617aa13fe10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:14:27.649170 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7f44e-d529-4d27-b82f-c617aa13fe10 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:27.649448 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7f44e-d529-4d27-b82f-c617aa13fe10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:27.649719 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f7f44e-d529-4d27-b82f-c617aa13fe10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:27.651337 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-f8f7f44e-d529-4d27-b82f-c617aa13fe10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:27.699553 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:14:27.760058 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f7f44e-d529-4d27-b82f-c617aa13fe10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:14:27.761497 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f7f44e-d529-4d27-b82f-c617aa13fe10 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:14:27.780109 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 728/1458] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:14:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:14:29.819673 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f7577-0781-4e5e-9639-ed6f1833de7e None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:29.820263 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f7577-0781-4e5e-9639-ed6f1833de7e None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:29.820263 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5f7577-0781-4e5e-9639-ed6f1833de7e None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:29.821591 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 731/1459] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 02:14:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:14:29.827333 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c10da-0590-49cb-8cb0-274a0131c3d1 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:29.827790 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c10da-0590-49cb-8cb0-274a0131c3d1 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:29.827905 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0c10da-0590-49cb-8cb0-274a0131c3d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:29.895022 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-bd0c10da-0590-49cb-8cb0-274a0131c3d1 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:14:29.896230 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-bd0c10da-0590-49cb-8cb0-274a0131c3d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:29.991668 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 729/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 02:14:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:14:30.029119 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f7577-0781-4e5e-9639-ed6f1833de7e None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:14:30.030690 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-2e5f7577-0781-4e5e-9639-ed6f1833de7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:30.132652 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5f7577-0781-4e5e-9639-ed6f1833de7e None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:14:30.187370 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:14:30.205719 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d71eff1-4beb-4ea5-bced-4e6d74d2bf1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:14:30.206334 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71eff1-4beb-4ea5-bced-4e6d74d2bf1b service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:30.206617 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71eff1-4beb-4ea5-bced-4e6d74d2bf1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:30.206895 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d71eff1-4beb-4ea5-bced-4e6d74d2bf1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:30.208572 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-6d71eff1-4beb-4ea5-bced-4e6d74d2bf1b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:30.325882 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71eff1-4beb-4ea5-bced-4e6d74d2bf1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:14:30.327310 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d71eff1-4beb-4ea5-bced-4e6d74d2bf1b service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:14:30.344728 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 732/1461] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:14:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:14:32.487395 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb58bac-a029-4c68-bc02-8a46bf824d6f None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:32.487949 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb58bac-a029-4c68-bc02-8a46bf824d6f None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:32.487949 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cb58bac-a029-4c68-bc02-8a46bf824d6f None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:32.489429 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 730/1462] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 02:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:14:32.494534 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602c416-e279-4b9f-9b02-60ecf0f93979 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:32.494946 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602c416-e279-4b9f-9b02-60ecf0f93979 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:32.495124 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602c416-e279-4b9f-9b02-60ecf0f93979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:32.562145 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-a602c416-e279-4b9f-9b02-60ecf0f93979 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:14:32.563341 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-a602c416-e279-4b9f-9b02-60ecf0f93979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:32.600522 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:14:32.659485 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 733/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 02:14:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:14:32.696521 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb58bac-a029-4c68-bc02-8a46bf824d6f None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:14:32.698049 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-6cb58bac-a029-4c68-bc02-8a46bf824d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:32.701953 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:14:32.800569 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cb58bac-a029-4c68-bc02-8a46bf824d6f None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:14:32.875282 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15660b1-8648-412a-8f6d-673576c39645 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:14:32.875901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15660b1-8648-412a-8f6d-673576c39645 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:32.876182 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15660b1-8648-412a-8f6d-673576c39645 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:32.876493 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15660b1-8648-412a-8f6d-673576c39645 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:32.878130 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-d15660b1-8648-412a-8f6d-673576c39645 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:32.935825 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:14:32.987305 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15660b1-8648-412a-8f6d-673576c39645 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:14:32.988784 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15660b1-8648-412a-8f6d-673576c39645 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:14:33.006670 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 731/1464] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:14:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:14:35.011977 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db365ce-e9b2-406c-8744-e9f3fb6d7d10 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:35.013086 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db365ce-e9b2-406c-8744-e9f3fb6d7d10 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:35.013086 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db365ce-e9b2-406c-8744-e9f3fb6d7d10 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:35.014412 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 734/1465] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 02:14:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:14:35.019749 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862cdc5-9cf7-4b7c-9a21-082db3a951b1 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:35.020180 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862cdc5-9cf7-4b7c-9a21-082db3a951b1 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:35.020309 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2862cdc5-9cf7-4b7c-9a21-082db3a951b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:35.100297 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-2862cdc5-9cf7-4b7c-9a21-082db3a951b1 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:14:35.101543 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-2862cdc5-9cf7-4b7c-9a21-082db3a951b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:35.201929 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 732/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 02:14:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:14:35.242054 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db365ce-e9b2-406c-8744-e9f3fb6d7d10 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:14:35.243679 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-0db365ce-e9b2-406c-8744-e9f3fb6d7d10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:35.347007 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db365ce-e9b2-406c-8744-e9f3fb6d7d10 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:14:35.412813 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:14:35.420162 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90281bff-6d44-47a8-bb75-97dc3aee6c10 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:14:35.420797 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90281bff-6d44-47a8-bb75-97dc3aee6c10 service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:35.421085 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90281bff-6d44-47a8-bb75-97dc3aee6c10 service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:35.421356 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90281bff-6d44-47a8-bb75-97dc3aee6c10 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:35.422997 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-90281bff-6d44-47a8-bb75-97dc3aee6c10 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:35.530372 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90281bff-6d44-47a8-bb75-97dc3aee6c10 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:14:35.531797 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90281bff-6d44-47a8-bb75-97dc3aee6c10 service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:14:35.550775 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 735/1467] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:14:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:14:37.550630 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164e065-5754-46f6-9ff2-d3075423cfac None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:37.551178 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164e065-5754-46f6-9ff2-d3075423cfac None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:37.551178 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b164e065-5754-46f6-9ff2-d3075423cfac None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:37.552543 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 733/1468] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 02:14:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:14:37.557773 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d8a9d-93b6-430e-a092-9b2e3d584b36 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:37.558201 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d8a9d-93b6-430e-a092-9b2e3d584b36 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:37.558313 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996d8a9d-93b6-430e-a092-9b2e3d584b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:37.628239 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-996d8a9d-93b6-430e-a092-9b2e3d584b36 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:14:37.629506 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-996d8a9d-93b6-430e-a092-9b2e3d584b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:37.678018 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:14:37.727904 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 736/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 02:14:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:14:37.764495 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164e065-5754-46f6-9ff2-d3075423cfac None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:14:37.765920 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-b164e065-5754-46f6-9ff2-d3075423cfac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:37.779378 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:14:37.869776 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b164e065-5754-46f6-9ff2-d3075423cfac None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:14:37.940874 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e3180-2b1e-4c0d-b394-c4d80014264b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:14:37.941484 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e3180-2b1e-4c0d-b394-c4d80014264b service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:37.941759 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e3180-2b1e-4c0d-b394-c4d80014264b service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:37.942027 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e3180-2b1e-4c0d-b394-c4d80014264b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:37.943659 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-376e3180-2b1e-4c0d-b394-c4d80014264b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:38.012752 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:14:38.055029 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e3180-2b1e-4c0d-b394-c4d80014264b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:14:38.056488 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e3180-2b1e-4c0d-b394-c4d80014264b service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:14:38.074616 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 734/1470] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:14:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:14:47.726089 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=22 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:14:48.072386 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=25 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:14:57.733918 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccadef-af42-4089-b586-38e451967bae None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:57.734463 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccadef-af42-4089-b586-38e451967bae None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:57.734463 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfccadef-af42-4089-b586-38e451967bae None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:57.735828 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 737/1471] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:14:57.741028 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e80db-f237-48ca-9126-b5531f9b0016 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:57.741455 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e80db-f237-48ca-9126-b5531f9b0016 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:57.741616 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-475e80db-f237-48ca-9126-b5531f9b0016 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:57.808128 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-475e80db-f237-48ca-9126-b5531f9b0016 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:14:57.809363 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-475e80db-f237-48ca-9126-b5531f9b0016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:57.908887 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 735/1472] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:14:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:14:57.992724 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebba2c6-481d-402b-814e-eadb58caad8b None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:57.993018 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebba2c6-481d-402b-814e-eadb58caad8b None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:57.993301 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ebba2c6-481d-402b-814e-eadb58caad8b None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:57.994639 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 738/1473] 10.222.0.15 () {54 vars in 966 bytes} [Fri Aug 5 02:14:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:14:58.000554 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6511ed9-1402-4f6a-947a-e5b4e4b7c828 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:58.000846 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6511ed9-1402-4f6a-947a-e5b4e4b7c828 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:58.001125 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6511ed9-1402-4f6a-947a-e5b4e4b7c828 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:58.078641 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-a6511ed9-1402-4f6a-947a-e5b4e4b7c828 None None] MFA Rules not processed for user `5c09080c507f4c35b81d482cfbaa6a88`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:14:58.079869 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-a6511ed9-1402-4f6a-947a-e5b4e4b7c828 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:58.100272 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:14:58.155497 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 736/1474] 10.222.0.15 () {58 vars in 1063 bytes} [Fri Aug 5 02:14:57 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:14:58.163246 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebba2c6-481d-402b-814e-eadb58caad8b None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:14:58.164834 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-3ebba2c6-481d-402b-814e-eadb58caad8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:58.270677 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ebba2c6-481d-402b-814e-eadb58caad8b None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:14:58.343130 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0d2c5c-05fa-439b-9269-4937f4b2014a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c09080c507f4c35b81d482cfbaa6a88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:14:58.343736 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d2c5c-05fa-439b-9269-4937f4b2014a service glance] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:14:58.344010 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d2c5c-05fa-439b-9269-4937f4b2014a service glance] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:14:58.344279 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0d2c5c-05fa-439b-9269-4937f4b2014a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:14:58.345936 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-6e0d2c5c-05fa-439b-9269-4937f4b2014a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:14:58.398314 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:14:58.452706 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d2c5c-05fa-439b-9269-4937f4b2014a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:14:58.454145 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0d2c5c-05fa-439b-9269-4937f4b2014a service glance] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:14:58.472973 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 739/1475] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:14:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:15:00.550354 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaafce4a-ba10-4108-8a02-20f3b964b83e None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:15:00.550948 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaafce4a-ba10-4108-8a02-20f3b964b83e None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:15:00.550948 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaafce4a-ba10-4108-8a02-20f3b964b83e None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:15:00.552266 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 737/1476] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:15:00.557699 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8a682-196b-4872-a256-ed14cccae7bd None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:15:00.558107 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8a682-196b-4872-a256-ed14cccae7bd None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:15:00.558247 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac8a682-196b-4872-a256-ed14cccae7bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:15:00.623647 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-aac8a682-196b-4872-a256-ed14cccae7bd None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:15:00.625162 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-aac8a682-196b-4872-a256-ed14cccae7bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:15:00.722097 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 740/1477] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:15:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:15:00.745180 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaafce4a-ba10-4108-8a02-20f3b964b83e None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:15:00.746700 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-eaafce4a-ba10-4108-8a02-20f3b964b83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:15:00.871971 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaafce4a-ba10-4108-8a02-20f3b964b83e None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:15:00.921314 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:15:00.965914 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45628299-0a9b-4ce8-af23-ed8db7ccd40e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:15:00.966533 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45628299-0a9b-4ce8-af23-ed8db7ccd40e admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:15:00.966843 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45628299-0a9b-4ce8-af23-ed8db7ccd40e admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:15:00.967115 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45628299-0a9b-4ce8-af23-ed8db7ccd40e admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:15:00.967809 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45628299-0a9b-4ce8-af23-ed8db7ccd40e admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:15:00.969566 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: WARNING py.warnings [None req-45628299-0a9b-4ce8-af23-ed8db7ccd40e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 02:15:00.969566 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: warnings.warn(msg) Aug 05 02:15:00.969566 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: Aug 05 02:15:00.970692 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45628299-0a9b-4ce8-af23-ed8db7ccd40e admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:15:00.990323 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 738/1478] 10.222.0.15 () {56 vars in 1108 bytes} [Fri Aug 5 02:15:00 2022] GET /identity/v3/projects => generated 2553 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:15:03.048895 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbdc53d-7f96-4a40-8735-70894986580f None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:15:03.049483 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbdc53d-7f96-4a40-8735-70894986580f None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:15:03.049483 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbdc53d-7f96-4a40-8735-70894986580f None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:15:03.050799 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 741/1479] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:15:03.056040 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152b581-b6c1-4b09-800c-5fd0b7e70066 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:15:03.056514 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152b581-b6c1-4b09-800c-5fd0b7e70066 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:15:03.056657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d152b581-b6c1-4b09-800c-5fd0b7e70066 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:15:03.124750 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-d152b581-b6c1-4b09-800c-5fd0b7e70066 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:15:03.125963 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-d152b581-b6c1-4b09-800c-5fd0b7e70066 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:15:03.221986 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 739/1480] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:15:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:15:03.266351 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbdc53d-7f96-4a40-8735-70894986580f None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:15:03.268159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-5bbdc53d-7f96-4a40-8735-70894986580f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:15:03.278226 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:15:03.414068 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbdc53d-7f96-4a40-8735-70894986580f None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:15:03.493405 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:15:03.526504 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4160a33f-803c-4130-b4c0-a163e13db84a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:15:03.527114 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160a33f-803c-4130-b4c0-a163e13db84a service nova] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:15:03.527395 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160a33f-803c-4130-b4c0-a163e13db84a service nova] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:15:03.527671 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4160a33f-803c-4130-b4c0-a163e13db84a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:15:03.529880 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-4160a33f-803c-4130-b4c0-a163e13db84a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:15:03.620490 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160a33f-803c-4130-b4c0-a163e13db84a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:15:03.622095 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4160a33f-803c-4130-b4c0-a163e13db84a service nova] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:15:03.639972 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 742/1481] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:15:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 374 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:15:05.811128 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9711fc-7997-486e-a2b4-5fbb07336a75 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:15:05.811750 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9711fc-7997-486e-a2b4-5fbb07336a75 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:15:05.811750 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9711fc-7997-486e-a2b4-5fbb07336a75 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:15:05.813082 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 740/1482] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:15:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:15:05.818381 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5b146-40d4-4ba3-876b-ae6b70c2c874 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:15:05.818832 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5b146-40d4-4ba3-876b-ae6b70c2c874 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:15:05.818939 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c5b146-40d4-4ba3-876b-ae6b70c2c874 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:15:05.884858 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-a4c5b146-40d4-4ba3-876b-ae6b70c2c874 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:15:05.886074 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-a4c5b146-40d4-4ba3-876b-ae6b70c2c874 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:15:05.931051 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:15:05.984141 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 743/1483] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:15:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:15:06.020928 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9711fc-7997-486e-a2b4-5fbb07336a75 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:15:06.022511 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-ee9711fc-7997-486e-a2b4-5fbb07336a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:15:06.045291 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:15:06.126276 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9711fc-7997-486e-a2b4-5fbb07336a75 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:15:06.200829 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fdf6ff0-4bee-4342-bace-d75957b4d323 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:15:06.202081 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf6ff0-4bee-4342-bace-d75957b4d323 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:15:06.202360 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf6ff0-4bee-4342-bace-d75957b4d323 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:15:06.202631 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fdf6ff0-4bee-4342-bace-d75957b4d323 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:15:06.204385 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-6fdf6ff0-4bee-4342-bace-d75957b4d323 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:15:06.285101 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:15:06.319889 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdf6ff0-4bee-4342-bace-d75957b4d323 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:15:06.321333 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fdf6ff0-4bee-4342-bace-d75957b4d323 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:15:06.339408 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 741/1484] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:15:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:15:08.378092 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0add75-19de-4168-8c2c-1e9cce4a619a None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:15:08.378807 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0add75-19de-4168-8c2c-1e9cce4a619a None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:15:08.378807 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c0add75-19de-4168-8c2c-1e9cce4a619a None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:15:08.379987 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 744/1485] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:15:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:15:08.385221 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83b48c-83b2-47ed-ab92-64b9babe5304 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:15:08.385674 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83b48c-83b2-47ed-ab92-64b9babe5304 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:15:08.385789 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d83b48c-83b2-47ed-ab92-64b9babe5304 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:15:08.452827 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-2d83b48c-83b2-47ed-ab92-64b9babe5304 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:15:08.454033 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-2d83b48c-83b2-47ed-ab92-64b9babe5304 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:15:08.554542 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 742/1486] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:15:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:15:08.593562 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0add75-19de-4168-8c2c-1e9cce4a619a None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:15:08.595097 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-8c0add75-19de-4168-8c2c-1e9cce4a619a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:15:08.698563 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c0add75-19de-4168-8c2c-1e9cce4a619a None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:15:08.770127 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:15:08.771874 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748ac56e-7507-4fa2-8338-7e97faa3609d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:15:08.772518 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ac56e-7507-4fa2-8338-7e97faa3609d service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:15:08.773021 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ac56e-7507-4fa2-8338-7e97faa3609d service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:15:08.773491 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748ac56e-7507-4fa2-8338-7e97faa3609d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:15:08.775288 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-748ac56e-7507-4fa2-8338-7e97faa3609d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:15:08.884935 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ac56e-7507-4fa2-8338-7e97faa3609d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:15:08.886368 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748ac56e-7507-4fa2-8338-7e97faa3609d service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:15:08.904838 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 745/1487] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:15:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:15:11.038677 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e746dbf-b6c5-4073-b840-a9c272ce7dab None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:15:11.039269 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e746dbf-b6c5-4073-b840-a9c272ce7dab None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:15:11.039269 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e746dbf-b6c5-4073-b840-a9c272ce7dab None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:15:11.040706 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 743/1488] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:15:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:15:11.045788 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413df8e-feb4-4060-a8d8-0e9daad7b5dc None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:15:11.046186 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413df8e-feb4-4060-a8d8-0e9daad7b5dc None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:15:11.046323 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8413df8e-feb4-4060-a8d8-0e9daad7b5dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:15:11.111352 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-8413df8e-feb4-4060-a8d8-0e9daad7b5dc None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:15:11.112567 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-8413df8e-feb4-4060-a8d8-0e9daad7b5dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:15:11.168110 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:15:11.211442 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 746/1489] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:15:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:15:11.251888 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e746dbf-b6c5-4073-b840-a9c272ce7dab None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:15:11.253471 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-4e746dbf-b6c5-4073-b840-a9c272ce7dab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:15:11.289451 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:15:11.356798 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e746dbf-b6c5-4073-b840-a9c272ce7dab None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:15:11.429022 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a6e296f-6048-4a75-b84d-5c8e8e5ae7a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:15:11.429629 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e296f-6048-4a75-b84d-5c8e8e5ae7a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:15:11.429903 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e296f-6048-4a75-b84d-5c8e8e5ae7a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:15:11.430170 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a6e296f-6048-4a75-b84d-5c8e8e5ae7a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:15:11.431783 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9a6e296f-6048-4a75-b84d-5c8e8e5ae7a1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:15:11.509235 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:15:11.538859 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e296f-6048-4a75-b84d-5c8e8e5ae7a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:15:11.540555 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a6e296f-6048-4a75-b84d-5c8e8e5ae7a1 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:15:11.558050 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 744/1490] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:15:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:15:13.744092 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f96065-7e9c-46d5-897f-7d6e14d5449e None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:15:13.744668 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f96065-7e9c-46d5-897f-7d6e14d5449e None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:15:13.744668 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f96065-7e9c-46d5-897f-7d6e14d5449e None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:15:13.746028 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 747/1491] 10.222.0.15 () {54 vars in 927 bytes} [Fri Aug 5 02:15:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:15:13.751171 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29845a4-73ca-4e58-a9f5-2ddd8d1f1b34 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:15:13.751623 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29845a4-73ca-4e58-a9f5-2ddd8d1f1b34 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:15:13.751720 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29845a4-73ca-4e58-a9f5-2ddd8d1f1b34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:15:13.817739 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-b29845a4-73ca-4e58-a9f5-2ddd8d1f1b34 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:15:13.818954 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-b29845a4-73ca-4e58-a9f5-2ddd8d1f1b34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:15:13.927516 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 745/1492] 10.222.0.15 () {58 vars in 1024 bytes} [Fri Aug 5 02:15:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:15:13.967590 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f96065-7e9c-46d5-897f-7d6e14d5449e None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:15:13.969298 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-d4f96065-7e9c-46d5-897f-7d6e14d5449e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:15:14.071380 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f96065-7e9c-46d5-897f-7d6e14d5449e None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:15:14.143791 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c802b2c7-aa85-489c-be02-8fc67b645052 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:15:14.144428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802b2c7-aa85-489c-be02-8fc67b645052 service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:15:14.144709 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802b2c7-aa85-489c-be02-8fc67b645052 service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:15:14.144983 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c802b2c7-aa85-489c-be02-8fc67b645052 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:15:14.146608 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-c802b2c7-aa85-489c-be02-8fc67b645052 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:15:14.156158 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:15:14.258355 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c802b2c7-aa85-489c-be02-8fc67b645052 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:15:14.259701 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c802b2c7-aa85-489c-be02-8fc67b645052 service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:15:14.277197 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 748/1493] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:15:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:15:23.925658 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=82 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:15:24.274900 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=50 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:16:50.592332 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdf159-3864-4f03-8abb-76b963479935 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:16:50.593861 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdf159-3864-4f03-8abb-76b963479935 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:16:50.593861 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fdf159-3864-4f03-8abb-76b963479935 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:16:50.668105 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-00fdf159-3864-4f03-8abb-76b963479935 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:16:50.669328 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-00fdf159-3864-4f03-8abb-76b963479935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:16:50.767180 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 746/1494] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:16:50.775272 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f78ecc-1191-4d5c-8a08-195d12c07b23 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:16:50.775781 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f78ecc-1191-4d5c-8a08-195d12c07b23 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:16:50.775891 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f78ecc-1191-4d5c-8a08-195d12c07b23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:16:50.852682 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-a4f78ecc-1191-4d5c-8a08-195d12c07b23 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:16:50.853838 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-a4f78ecc-1191-4d5c-8a08-195d12c07b23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:16:50.948802 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 749/1495] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:16:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:16:50.954383 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fdf159-3864-4f03-8abb-76b963479935 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:16:50.955601 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-00fdf159-3864-4f03-8abb-76b963479935 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:16:50.966977 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00fdf159-3864-4f03-8abb-76b963479935 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:16:51.029050 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:16:51.063400 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a0d63-6d3e-4be3-aeb0-021ede79e73f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:16:51.064048 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a0d63-6d3e-4be3-aeb0-021ede79e73f admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:16:51.064342 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a0d63-6d3e-4be3-aeb0-021ede79e73f admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:16:51.064640 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049a0d63-6d3e-4be3-aeb0-021ede79e73f admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:16:51.065331 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a0d63-6d3e-4be3-aeb0-021ede79e73f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:16:51.065633 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a0d63-6d3e-4be3-aeb0-021ede79e73f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:16:51.066630 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: WARNING py.warnings [None req-049a0d63-6d3e-4be3-aeb0-021ede79e73f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 02:16:51.066630 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: warnings.warn(msg) Aug 05 02:16:51.066630 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: Aug 05 02:16:51.067503 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049a0d63-6d3e-4be3-aeb0-021ede79e73f admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:16:51.078970 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 747/1496] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:16:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 125 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:16:51.087323 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f78ecc-1191-4d5c-8a08-195d12c07b23 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:16:51.097135 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f78ecc-1191-4d5c-8a08-195d12c07b23 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:16:51.158615 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:16:51.192092 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281aa11-30b1-42a4-ad6b-8ffb4bb1e917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:16:51.192732 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281aa11-30b1-42a4-ad6b-8ffb4bb1e917 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:16:51.193013 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281aa11-30b1-42a4-ad6b-8ffb4bb1e917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:16:51.193282 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b281aa11-30b1-42a4-ad6b-8ffb4bb1e917 admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:16:51.193939 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b281aa11-30b1-42a4-ad6b-8ffb4bb1e917 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:16:51.195763 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: WARNING py.warnings [None req-b281aa11-30b1-42a4-ad6b-8ffb4bb1e917 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 02:16:51.195763 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: warnings.warn(msg) Aug 05 02:16:51.195763 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: Aug 05 02:16:51.197112 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b281aa11-30b1-42a4-ad6b-8ffb4bb1e917 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:16:51.253427 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 750/1497] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:16:51 2022] POST /identity/v3/projects => generated 379 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:16:51.257797 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a0d63-6d3e-4be3-aeb0-021ede79e73f admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:16:51.259341 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-049a0d63-6d3e-4be3-aeb0-021ede79e73f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:16:51.297482 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049a0d63-6d3e-4be3-aeb0-021ede79e73f admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:16:51.401099 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52985e-7b21-4dd6-b43f-ce508fbb488f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:16:51.401729 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52985e-7b21-4dd6-b43f-ce508fbb488f admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:16:51.403262 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52985e-7b21-4dd6-b43f-ce508fbb488f admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:16:51.403533 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c52985e-7b21-4dd6-b43f-ce508fbb488f admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:16:51.404214 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c52985e-7b21-4dd6-b43f-ce508fbb488f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:16:51.406386 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: WARNING py.warnings [None req-4c52985e-7b21-4dd6-b43f-ce508fbb488f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 02:16:51.406386 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: warnings.warn(msg) Aug 05 02:16:51.406386 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: Aug 05 02:16:51.407980 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c52985e-7b21-4dd6-b43f-ce508fbb488f admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:16:51.461716 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 748/1498] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:16:51 2022] POST /identity/v3/users => generated 290 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:16:51.466767 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281aa11-30b1-42a4-ad6b-8ffb4bb1e917 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:16:51.469434 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-b281aa11-30b1-42a4-ad6b-8ffb4bb1e917 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:16:51.544579 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b281aa11-30b1-42a4-ad6b-8ffb4bb1e917 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:16:51.647086 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:16:51.661303 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e9c3d-74fc-4521-ad87-4b899dc4d0f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:16:51.662288 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e9c3d-74fc-4521-ad87-4b899dc4d0f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:16:51.662750 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e9c3d-74fc-4521-ad87-4b899dc4d0f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:16:51.663216 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e9c3d-74fc-4521-ad87-4b899dc4d0f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:16:51.664430 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e9c3d-74fc-4521-ad87-4b899dc4d0f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:16:51.666178 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: WARNING py.warnings [None req-114e9c3d-74fc-4521-ad87-4b899dc4d0f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 02:16:51.666178 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: warnings.warn(msg) Aug 05 02:16:51.666178 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: Aug 05 02:16:51.667694 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e9c3d-74fc-4521-ad87-4b899dc4d0f4 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:16:51.681743 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 751/1499] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:16:51.685987 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52985e-7b21-4dd6-b43f-ce508fbb488f admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:16:51.688553 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-4c52985e-7b21-4dd6-b43f-ce508fbb488f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:16:51.702969 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c52985e-7b21-4dd6-b43f-ce508fbb488f admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:16:51.733456 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:16:51.813191 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b2a86b-a408-4fc0-ba7a-b5486bd2fbab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:16:51.814258 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2a86b-a408-4fc0-ba7a-b5486bd2fbab admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:16:51.814651 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2a86b-a408-4fc0-ba7a-b5486bd2fbab admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:16:51.814927 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b2a86b-a408-4fc0-ba7a-b5486bd2fbab admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:16:51.815793 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2a86b-a408-4fc0-ba7a-b5486bd2fbab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:16:51.817303 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: WARNING py.warnings [None req-85b2a86b-a408-4fc0-ba7a-b5486bd2fbab admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 02:16:51.817303 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: warnings.warn(msg) Aug 05 02:16:51.817303 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: Aug 05 02:16:51.818777 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b2a86b-a408-4fc0-ba7a-b5486bd2fbab admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:16:51.834381 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 749/1500] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:16:51 2022] GET /identity/v3/roles => generated 1420 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:16:51.838643 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e9c3d-74fc-4521-ad87-4b899dc4d0f4 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:16:51.840248 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-114e9c3d-74fc-4521-ad87-4b899dc4d0f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:16:51.877072 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e9c3d-74fc-4521-ad87-4b899dc4d0f4 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:16:51.988523 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acff3081-83d4-443e-a86f-91e02e799563 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:16:51.989573 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff3081-83d4-443e-a86f-91e02e799563 admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:16:51.989939 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff3081-83d4-443e-a86f-91e02e799563 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:16:51.990220 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acff3081-83d4-443e-a86f-91e02e799563 admin admin] PATH_INFO: `/v3/projects/3a23da395c36438380af92255601bee9/users/6516f271f0e5498ca6412457e60deee5/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:16:52.017978 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff3081-83d4-443e-a86f-91e02e799563 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a23da395c36438380af92255601bee9, user_id=6516f271f0e5498ca6412457e60deee5, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:16:52.019080 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: WARNING py.warnings [None req-acff3081-83d4-443e-a86f-91e02e799563 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 02:16:52.019080 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: warnings.warn(msg) Aug 05 02:16:52.019080 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: Aug 05 02:16:52.021149 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acff3081-83d4-443e-a86f-91e02e799563 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:16:52.047412 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 752/1501] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:16:51 2022] PUT /identity/v3/projects/3a23da395c36438380af92255601bee9/users/6516f271f0e5498ca6412457e60deee5/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:16:52.059603 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f07a5-9821-447f-8124-8cabe1c37c4d None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:16:52.059890 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f07a5-9821-447f-8124-8cabe1c37c4d None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:16:52.060219 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5f07a5-9821-447f-8124-8cabe1c37c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:16:52.118961 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-1b5f07a5-9821-447f-8124-8cabe1c37c4d None None] MFA Rules not processed for user `6516f271f0e5498ca6412457e60deee5`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:16:52.120168 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-1b5f07a5-9821-447f-8124-8cabe1c37c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:16:52.199087 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 750/1502] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:16:52 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:16:52.212270 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082ae53-2343-445b-bc64-73dd5e46e197 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:16:52.212596 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082ae53-2343-445b-bc64-73dd5e46e197 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:16:52.212872 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0082ae53-2343-445b-bc64-73dd5e46e197 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:16:52.214212 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 753/1503] 10.222.0.15 () {54 vars in 964 bytes} [Fri Aug 5 02:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:16:52.219320 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac099a-d613-4f27-b2ac-7d28f7b8c6c2 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:16:52.219600 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac099a-d613-4f27-b2ac-7d28f7b8c6c2 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:16:52.219872 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18ac099a-d613-4f27-b2ac-7d28f7b8c6c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:16:52.252099 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:16:52.297601 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-18ac099a-d613-4f27-b2ac-7d28f7b8c6c2 None None] MFA Rules not processed for user `6a75ac3523564e1bb23469455fdba560`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:16:52.298907 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-18ac099a-d613-4f27-b2ac-7d28f7b8c6c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:16:52.378763 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 751/1504] 10.222.0.15 () {58 vars in 1061 bytes} [Fri Aug 5 02:16:52 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:16:52.386535 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082ae53-2343-445b-bc64-73dd5e46e197 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:16:52.388158 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-0082ae53-2343-445b-bc64-73dd5e46e197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:16:52.442980 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:16:52.496917 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0082ae53-2343-445b-bc64-73dd5e46e197 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:16:52.581570 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc06c8b6-7a6f-46b9-a05c-e7e83a7f7b03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:16:52.582108 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc06c8b6-7a6f-46b9-a05c-e7e83a7f7b03 service cinder] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:16:52.582386 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc06c8b6-7a6f-46b9-a05c-e7e83a7f7b03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:16:52.582658 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc06c8b6-7a6f-46b9-a05c-e7e83a7f7b03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:16:52.584281 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-fc06c8b6-7a6f-46b9-a05c-e7e83a7f7b03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:16:52.683894 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc06c8b6-7a6f-46b9-a05c-e7e83a7f7b03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:16:52.685377 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc06c8b6-7a6f-46b9-a05c-e7e83a7f7b03 service cinder] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:16:52.689474 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:16:52.704479 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 754/1505] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:16:52 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:16:52.750521 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803af877-8989-4d15-a886-bab71c241afa None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:16:52.750955 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803af877-8989-4d15-a886-bab71c241afa None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:16:52.751056 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803af877-8989-4d15-a886-bab71c241afa None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:16:52.752313 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 752/1506] 10.222.0.15 () {52 vars in 830 bytes} [Fri Aug 5 02:16:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:16:52.755850 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc06c8b6-7a6f-46b9-a05c-e7e83a7f7b03 service cinder] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:16:52.757204 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-fc06c8b6-7a6f-46b9-a05c-e7e83a7f7b03 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:16:52.856645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc06c8b6-7a6f-46b9-a05c-e7e83a7f7b03 service cinder] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:16:52.950307 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa938312-22a8-4a1a-8c00-b5b8b3727472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:16:52.950941 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa938312-22a8-4a1a-8c00-b5b8b3727472 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:16:52.951217 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa938312-22a8-4a1a-8c00-b5b8b3727472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:16:52.951488 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa938312-22a8-4a1a-8c00-b5b8b3727472 admin admin] PATH_INFO: `/v3/users/6516f271f0e5498ca6412457e60deee5` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:16:52.963557 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa938312-22a8-4a1a-8c00-b5b8b3727472 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6516f271f0e5498ca6412457e60deee5)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:16:52.964606 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: WARNING py.warnings [None req-fa938312-22a8-4a1a-8c00-b5b8b3727472 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 02:16:52.964606 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: warnings.warn(msg) Aug 05 02:16:52.964606 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: Aug 05 02:16:52.965819 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa938312-22a8-4a1a-8c00-b5b8b3727472 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:16:52.976042 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:16:53.031199 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-fa938312-22a8-4a1a-8c00-b5b8b3727472 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6516f271f0e5498ca6412457e60deee5'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:16:53.054557 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-fa938312-22a8-4a1a-8c00-b5b8b3727472 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6516f271f0e5498ca6412457e60deee5'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:16:53.055112 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-fa938312-22a8-4a1a-8c00-b5b8b3727472 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6516f271f0e5498ca6412457e60deee5'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:16:53.055532 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-fa938312-22a8-4a1a-8c00-b5b8b3727472 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6516f271f0e5498ca6412457e60deee5'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:16:53.065210 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-fa938312-22a8-4a1a-8c00-b5b8b3727472 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6516f271f0e5498ca6412457e60deee5'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:16:53.084498 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 755/1507] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:16:52 2022] DELETE /identity/v3/users/6516f271f0e5498ca6412457e60deee5 => generated 0 bytes in 329 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:16:53.088836 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ceaaf0-2fb7-4294-a3f5-5c0703a32c4d None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:16:53.089148 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ceaaf0-2fb7-4294-a3f5-5c0703a32c4d None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:16:53.089424 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ceaaf0-2fb7-4294-a3f5-5c0703a32c4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:16:53.147190 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-f2ceaaf0-2fb7-4294-a3f5-5c0703a32c4d None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:16:53.148421 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-f2ceaaf0-2fb7-4294-a3f5-5c0703a32c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:16:53.222003 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:16:53.234930 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 753/1508] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:16:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:16:53.244436 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa938312-22a8-4a1a-8c00-b5b8b3727472 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:16:53.245672 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-fa938312-22a8-4a1a-8c00-b5b8b3727472 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:16:53.350368 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa938312-22a8-4a1a-8c00-b5b8b3727472 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:16:53.405767 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:16:53.431796 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d35c02-5a8a-488d-b236-deecb7493e71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:16:53.432447 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d35c02-5a8a-488d-b236-deecb7493e71 service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:16:53.432757 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d35c02-5a8a-488d-b236-deecb7493e71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:16:53.433032 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d35c02-5a8a-488d-b236-deecb7493e71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:16:53.434669 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-67d35c02-5a8a-488d-b236-deecb7493e71 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:16:53.542638 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d35c02-5a8a-488d-b236-deecb7493e71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:16:53.544066 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d35c02-5a8a-488d-b236-deecb7493e71 service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:16:53.563320 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 756/1509] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:16:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:16:53.921865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ceaaf0-2fb7-4294-a3f5-5c0703a32c4d None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:16:53.924755 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-f2ceaaf0-2fb7-4294-a3f5-5c0703a32c4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:16:53.944943 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ceaaf0-2fb7-4294-a3f5-5c0703a32c4d None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:16:54.056990 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f4c03b-acb8-4425-b4ad-427b36bf39f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:16:54.057633 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4c03b-acb8-4425-b4ad-427b36bf39f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:16:54.057913 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4c03b-acb8-4425-b4ad-427b36bf39f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:16:54.058181 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f4c03b-acb8-4425-b4ad-427b36bf39f2 admin admin] PATH_INFO: `/v3/projects/3a23da395c36438380af92255601bee9` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:16:54.068003 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f4c03b-acb8-4425-b4ad-427b36bf39f2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a23da395c36438380af92255601bee9)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:16:54.069049 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: WARNING py.warnings [None req-14f4c03b-acb8-4425-b4ad-427b36bf39f2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 02:16:54.069049 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: warnings.warn(msg) Aug 05 02:16:54.069049 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: Aug 05 02:16:54.070232 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f4c03b-acb8-4425-b4ad-427b36bf39f2 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:16:54.128367 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-14f4c03b-acb8-4425-b4ad-427b36bf39f2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a23da395c36438380af92255601bee9', 'request_id': 'req-14f4c03b-acb8-4425-b4ad-427b36bf39f2'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:16:54.134189 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-14f4c03b-acb8-4425-b4ad-427b36bf39f2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a23da395c36438380af92255601bee9', 'request_id': 'req-14f4c03b-acb8-4425-b4ad-427b36bf39f2'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:16:54.143703 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-14f4c03b-acb8-4425-b4ad-427b36bf39f2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a23da395c36438380af92255601bee9', 'request_id': 'req-14f4c03b-acb8-4425-b4ad-427b36bf39f2'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:16:54.173657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-14f4c03b-acb8-4425-b4ad-427b36bf39f2 admin admin] The token cache is being invalidate because project 3a23da395c36438380af92255601bee9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:16:54.173938 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-14f4c03b-acb8-4425-b4ad-427b36bf39f2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:16:54.175368 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-14f4c03b-acb8-4425-b4ad-427b36bf39f2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:16:54.175787 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 754/1510] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:16:53 2022] DELETE /identity/v3/projects/3a23da395c36438380af92255601bee9 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:17:03.560518 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=62 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:17:04.171622 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:18:19.498193 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1dce23-0d24-4e02-9b64-2bff28ed0812 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:18:19.498798 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1dce23-0d24-4e02-9b64-2bff28ed0812 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:18:19.498798 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f1dce23-0d24-4e02-9b64-2bff28ed0812 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:18:19.500776 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 757/1511] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 02:18:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:18:19.505794 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d015f6-682c-4b53-a9a9-dc0324a83506 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:18:19.506239 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d015f6-682c-4b53-a9a9-dc0324a83506 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:18:19.506345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d015f6-682c-4b53-a9a9-dc0324a83506 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:18:19.586427 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-54d015f6-682c-4b53-a9a9-dc0324a83506 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:18:19.587619 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-54d015f6-682c-4b53-a9a9-dc0324a83506 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:18:19.689567 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 755/1512] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 02:18:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:18:19.839220 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1dce23-0d24-4e02-9b64-2bff28ed0812 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:18:19.841395 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-4f1dce23-0d24-4e02-9b64-2bff28ed0812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:18:19.960896 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f1dce23-0d24-4e02-9b64-2bff28ed0812 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:18:19.966195 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ad368-cbb7-4365-b1ce-e0d6a2461366 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:18:19.967120 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ad368-cbb7-4365-b1ce-e0d6a2461366 service nova] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:18:19.967399 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ad368-cbb7-4365-b1ce-e0d6a2461366 service nova] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:18:19.967671 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ad368-cbb7-4365-b1ce-e0d6a2461366 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:18:19.976479 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ad368-cbb7-4365-b1ce-e0d6a2461366 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:18:19.978053 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9ad368-cbb7-4365-b1ce-e0d6a2461366 service nova] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:18:19.987146 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 758/1513] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:18:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:18:20.807808 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bd767-7556-4e07-add5-d0aaa5a9b688 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:18:20.808380 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bd767-7556-4e07-add5-d0aaa5a9b688 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:18:20.808380 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82bd767-7556-4e07-add5-d0aaa5a9b688 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:18:20.809735 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 756/1514] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 02:18:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:18:20.814464 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d221900-06df-4c31-9d24-bbff8c5450a6 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:18:20.814905 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d221900-06df-4c31-9d24-bbff8c5450a6 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:18:20.815032 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d221900-06df-4c31-9d24-bbff8c5450a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:18:20.834902 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-3d221900-06df-4c31-9d24-bbff8c5450a6 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:18:20.836114 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-3d221900-06df-4c31-9d24-bbff8c5450a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:18:20.845539 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 759/1515] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 02:18:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:18:20.993991 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82bd767-7556-4e07-add5-d0aaa5a9b688 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:18:21.009268 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82bd767-7556-4e07-add5-d0aaa5a9b688 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:18:21.014460 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6201c320-c001-4d76-9d7c-c59f34687933 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:18:21.015065 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201c320-c001-4d76-9d7c-c59f34687933 service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:18:21.015342 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201c320-c001-4d76-9d7c-c59f34687933 service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:18:21.016172 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6201c320-c001-4d76-9d7c-c59f34687933 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:18:21.024157 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6201c320-c001-4d76-9d7c-c59f34687933 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:18:21.025746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6201c320-c001-4d76-9d7c-c59f34687933 service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:18:21.034945 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 757/1516] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:18:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:18:21.249819 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84918c2-be0b-447a-9eab-4c49f1e00d93 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:18:21.250989 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84918c2-be0b-447a-9eab-4c49f1e00d93 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:18:21.250989 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84918c2-be0b-447a-9eab-4c49f1e00d93 None None] PATH_INFO: `/v3` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:18:21.252204 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 760/1517] 10.222.0.45 () {54 vars in 925 bytes} [Fri Aug 5 02:18:21 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:18:21.258446 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535ffcb-b18d-440e-b51b-788e8453bc39 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:18:21.258734 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535ffcb-b18d-440e-b51b-788e8453bc39 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:18:21.259014 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a535ffcb-b18d-440e-b51b-788e8453bc39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:18:21.319458 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-a535ffcb-b18d-440e-b51b-788e8453bc39 None None] MFA Rules not processed for user `e84ea976b5914aea94c4d8f805139daf`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:18:21.320637 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-a535ffcb-b18d-440e-b51b-788e8453bc39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:18:21.337515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:18:21.394649 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 758/1518] 10.222.0.45 () {58 vars in 1015 bytes} [Fri Aug 5 02:18:21 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:18:30.295500 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dcff0e-8b90-45f7-afae-8172c310c91e None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:18:30.296069 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dcff0e-8b90-45f7-afae-8172c310c91e None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:18:30.296069 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12dcff0e-8b90-45f7-afae-8172c310c91e None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:18:30.298039 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 761/1519] 10.222.0.15 () {54 vars in 961 bytes} [Fri Aug 5 02:18:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:18:30.303039 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a3234-daf4-4df5-af99-55b9ca1e386f None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:18:30.303453 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a3234-daf4-4df5-af99-55b9ca1e386f None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:18:30.303589 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc6a3234-daf4-4df5-af99-55b9ca1e386f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:18:30.323199 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-fc6a3234-daf4-4df5-af99-55b9ca1e386f None None] MFA Rules not processed for user `e84ea976b5914aea94c4d8f805139daf`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:18:30.324433 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-fc6a3234-daf4-4df5-af99-55b9ca1e386f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:18:30.333625 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 759/1520] 10.222.0.15 () {58 vars in 1058 bytes} [Fri Aug 5 02:18:30 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:18:30.340960 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dcff0e-8b90-45f7-afae-8172c310c91e None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:18:30.354181 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12dcff0e-8b90-45f7-afae-8172c310c91e None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:18:30.359213 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f53ceb50-84fc-4e93-9c79-cfc6f53c30d5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e84ea976b5914aea94c4d8f805139daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:18:30.360401 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ceb50-84fc-4e93-9c79-cfc6f53c30d5 service placement] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:18:30.360750 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ceb50-84fc-4e93-9c79-cfc6f53c30d5 service placement] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:18:30.361032 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f53ceb50-84fc-4e93-9c79-cfc6f53c30d5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:18:30.369278 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ceb50-84fc-4e93-9c79-cfc6f53c30d5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:18:30.370850 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f53ceb50-84fc-4e93-9c79-cfc6f53c30d5 service placement] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:18:30.380938 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 762/1521] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:18:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:18:32.270400 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb96bd-fe57-4256-8319-75ba853df9cd None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:18:32.270969 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb96bd-fe57-4256-8319-75ba853df9cd None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:18:32.270969 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bb96bd-fe57-4256-8319-75ba853df9cd None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:18:32.272305 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 760/1522] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 02:18:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:18:32.277127 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a4cca-115f-4230-9cb6-3de7fd31c732 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:18:32.277547 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a4cca-115f-4230-9cb6-3de7fd31c732 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:18:32.277675 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a4cca-115f-4230-9cb6-3de7fd31c732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:18:32.297325 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-bf3a4cca-115f-4230-9cb6-3de7fd31c732 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:18:32.299255 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-bf3a4cca-115f-4230-9cb6-3de7fd31c732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:18:32.307063 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 763/1523] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 02:18:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:18:32.459438 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb96bd-fe57-4256-8319-75ba853df9cd None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:18:32.474720 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bb96bd-fe57-4256-8319-75ba853df9cd None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:18:32.479996 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9481ef2-1d94-44b7-987a-8650ccb7a57f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:18:32.480622 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9481ef2-1d94-44b7-987a-8650ccb7a57f service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:18:32.480898 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9481ef2-1d94-44b7-987a-8650ccb7a57f service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:18:32.481168 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9481ef2-1d94-44b7-987a-8650ccb7a57f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:18:32.489858 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9481ef2-1d94-44b7-987a-8650ccb7a57f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:18:32.491411 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9481ef2-1d94-44b7-987a-8650ccb7a57f service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:18:32.500545 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 761/1524] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:18:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:18:33.317039 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb1bf3-4b14-4c05-9bcb-14156e07ceb8 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:18:33.317615 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb1bf3-4b14-4c05-9bcb-14156e07ceb8 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:18:33.317615 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb1bf3-4b14-4c05-9bcb-14156e07ceb8 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:18:33.318938 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 764/1525] 127.0.0.1 () {54 vars in 901 bytes} [Fri Aug 5 02:18:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:18:33.323709 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8854e8e-4189-438b-a309-56ec974c379b None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:18:33.324127 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8854e8e-4189-438b-a309-56ec974c379b None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:18:33.324301 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8854e8e-4189-438b-a309-56ec974c379b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:18:33.343653 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-d8854e8e-4189-438b-a309-56ec974c379b None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:18:33.344869 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-d8854e8e-4189-438b-a309-56ec974c379b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:18:33.353434 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 762/1526] 127.0.0.1 () {58 vars in 998 bytes} [Fri Aug 5 02:18:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:18:33.515296 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb1bf3-4b14-4c05-9bcb-14156e07ceb8 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:18:33.530120 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb1bf3-4b14-4c05-9bcb-14156e07ceb8 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:18:33.536201 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c342fa-3307-45e4-9483-273c5104d46a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:18:33.536832 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c342fa-3307-45e4-9483-273c5104d46a service nova] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:18:33.537114 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c342fa-3307-45e4-9483-273c5104d46a service nova] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:18:33.537392 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c342fa-3307-45e4-9483-273c5104d46a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:18:33.545470 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c342fa-3307-45e4-9483-273c5104d46a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:18:33.547043 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c342fa-3307-45e4-9483-273c5104d46a service nova] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:18:33.556705 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 765/1527] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:18:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:18:37.358296 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e199230-1a2e-4e12-8feb-1399abdf0d2a None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:18:37.358890 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e199230-1a2e-4e12-8feb-1399abdf0d2a None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:18:37.358890 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e199230-1a2e-4e12-8feb-1399abdf0d2a None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:18:37.360208 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 763/1528] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 02:18:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:18:37.365866 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7461a2a-0739-45c8-b6cf-2795438adbe7 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:18:37.366300 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7461a2a-0739-45c8-b6cf-2795438adbe7 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:18:37.366413 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7461a2a-0739-45c8-b6cf-2795438adbe7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:18:37.385880 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-c7461a2a-0739-45c8-b6cf-2795438adbe7 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:18:37.387064 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-c7461a2a-0739-45c8-b6cf-2795438adbe7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:18:37.394989 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 766/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 02:18:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:18:37.467400 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e199230-1a2e-4e12-8feb-1399abdf0d2a None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:18:37.469160 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-7e199230-1a2e-4e12-8feb-1399abdf0d2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:18:37.548099 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e199230-1a2e-4e12-8feb-1399abdf0d2a None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:18:37.552738 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d275ee7f-fbaf-4358-97bf-98e1c59d84a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:18:37.553343 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275ee7f-fbaf-4358-97bf-98e1c59d84a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:18:37.553624 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275ee7f-fbaf-4358-97bf-98e1c59d84a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:18:37.553899 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d275ee7f-fbaf-4358-97bf-98e1c59d84a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:18:37.562737 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d275ee7f-fbaf-4358-97bf-98e1c59d84a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:18:37.564156 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d275ee7f-fbaf-4358-97bf-98e1c59d84a6 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:18:37.573763 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 764/1530] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:18:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:18:39.610046 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f6aa7-8547-4573-abc0-8b303917f7a1 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:18:39.610594 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f6aa7-8547-4573-abc0-8b303917f7a1 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:18:39.610594 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242f6aa7-8547-4573-abc0-8b303917f7a1 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:18:39.612440 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 767/1531] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 02:18:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:18:39.618450 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d83669-c39d-4f28-804a-d46133bb7902 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:18:39.618846 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d83669-c39d-4f28-804a-d46133bb7902 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:18:39.618978 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d83669-c39d-4f28-804a-d46133bb7902 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:18:39.638690 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-09d83669-c39d-4f28-804a-d46133bb7902 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:18:39.639873 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-09d83669-c39d-4f28-804a-d46133bb7902 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:18:39.647750 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 765/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 02:18:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:18:39.684511 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f6aa7-8547-4573-abc0-8b303917f7a1 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:18:39.695887 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242f6aa7-8547-4573-abc0-8b303917f7a1 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:18:39.699376 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647c9bce-53aa-4fea-833f-c77778e7445b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:18:39.699973 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c9bce-53aa-4fea-833f-c77778e7445b service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:18:39.700248 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c9bce-53aa-4fea-833f-c77778e7445b service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:18:39.700550 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647c9bce-53aa-4fea-833f-c77778e7445b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:18:39.709346 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c9bce-53aa-4fea-833f-c77778e7445b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:18:39.710821 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647c9bce-53aa-4fea-833f-c77778e7445b service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:18:39.720223 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 768/1533] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:18:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:18:43.234409 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc007615-fd1d-4b3a-a824-8d7a5484c54b None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:18:43.234965 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc007615-fd1d-4b3a-a824-8d7a5484c54b None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:18:43.234965 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc007615-fd1d-4b3a-a824-8d7a5484c54b None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:18:43.236973 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 766/1534] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 02:18:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:18:43.242121 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a011e8-d96c-4730-842b-3c8e85ea8093 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:18:43.242555 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a011e8-d96c-4730-842b-3c8e85ea8093 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:18:43.242736 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a011e8-d96c-4730-842b-3c8e85ea8093 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:18:43.261709 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-71a011e8-d96c-4730-842b-3c8e85ea8093 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:18:43.262915 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-71a011e8-d96c-4730-842b-3c8e85ea8093 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:18:43.271588 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 769/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 02:18:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:18:43.575828 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc007615-fd1d-4b3a-a824-8d7a5484c54b None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:18:43.577489 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-fc007615-fd1d-4b3a-a824-8d7a5484c54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:18:43.641571 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:18:43.655702 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc007615-fd1d-4b3a-a824-8d7a5484c54b None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:18:43.659327 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6443a941-656b-4237-a75f-03ba3968ac58 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:18:43.659929 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443a941-656b-4237-a75f-03ba3968ac58 service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:18:43.660207 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443a941-656b-4237-a75f-03ba3968ac58 service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:18:43.660512 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6443a941-656b-4237-a75f-03ba3968ac58 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:18:43.669790 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443a941-656b-4237-a75f-03ba3968ac58 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:18:43.671198 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6443a941-656b-4237-a75f-03ba3968ac58 service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:18:43.680528 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 767/1536] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:18:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:18:45.715123 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d57f1-f6d0-41c3-841d-34c1e1e43016 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:18:45.715702 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d57f1-f6d0-41c3-841d-34c1e1e43016 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:18:45.715702 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9d57f1-f6d0-41c3-841d-34c1e1e43016 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:18:45.717110 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 770/1537] 127.0.0.1 () {54 vars in 917 bytes} [Fri Aug 5 02:18:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:18:45.722408 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2894c-e7a1-4f9f-b694-19604d713456 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:18:45.722827 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2894c-e7a1-4f9f-b694-19604d713456 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:18:45.722977 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f2894c-e7a1-4f9f-b694-19604d713456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:18:45.742200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-c9f2894c-e7a1-4f9f-b694-19604d713456 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:18:45.743453 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-c9f2894c-e7a1-4f9f-b694-19604d713456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:18:45.751043 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 768/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Fri Aug 5 02:18:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:18:46.054971 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d57f1-f6d0-41c3-841d-34c1e1e43016 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:18:46.056672 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-de9d57f1-f6d0-41c3-841d-34c1e1e43016 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:18:46.064022 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=84 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:18:46.071200 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9d57f1-f6d0-41c3-841d-34c1e1e43016 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:18:46.074629 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a4e08-bd40-40d6-ad7d-0c0cc3b3239c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:18:46.075224 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a4e08-bd40-40d6-ad7d-0c0cc3b3239c service cinder] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:18:46.075501 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a4e08-bd40-40d6-ad7d-0c0cc3b3239c service cinder] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:18:46.075770 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a4e08-bd40-40d6-ad7d-0c0cc3b3239c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:18:46.085021 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a4e08-bd40-40d6-ad7d-0c0cc3b3239c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:18:46.086372 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a4e08-bd40-40d6-ad7d-0c0cc3b3239c service cinder] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:18:46.096039 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 771/1539] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:18:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:18:55.737566 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=11 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:18:56.091522 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=5 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:08.944588 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd37a13-c44f-47d0-af11-783aaad6c8ff None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:08.946140 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd37a13-c44f-47d0-af11-783aaad6c8ff None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:08.946140 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd37a13-c44f-47d0-af11-783aaad6c8ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:08.973622 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-6bd37a13-c44f-47d0-af11-783aaad6c8ff None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:08.975060 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-6bd37a13-c44f-47d0-af11-783aaad6c8ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:08.986806 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 769/1540] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:08.996021 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b2cf5-029e-47b4-9633-622122041875 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:08.996656 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b2cf5-029e-47b4-9633-622122041875 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:08.996656 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16b2cf5-029e-47b4-9633-622122041875 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:09.025330 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26de157-d07c-4dfd-bb8c-ad9a977d202a None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:09.025852 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26de157-d07c-4dfd-bb8c-ad9a977d202a None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:09.026135 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26de157-d07c-4dfd-bb8c-ad9a977d202a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:09.026559 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-a16b2cf5-029e-47b4-9633-622122041875 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:09.027775 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-a16b2cf5-029e-47b4-9633-622122041875 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:09.044079 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 772/1541] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:09.049764 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b2cf5-029e-47b4-9633-622122041875 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:09.059747 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a16b2cf5-029e-47b4-9633-622122041875 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:09.060183 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-b26de157-d07c-4dfd-bb8c-ad9a977d202a None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:09.061897 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-b26de157-d07c-4dfd-bb8c-ad9a977d202a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:09.072680 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61374fe5-1863-45ee-b588-1852597a58f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:09.072884 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 770/1542] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:09.073251 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61374fe5-1863-45ee-b588-1852597a58f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:09.073540 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61374fe5-1863-45ee-b588-1852597a58f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:09.073812 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61374fe5-1863-45ee-b588-1852597a58f4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:09.074779 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61374fe5-1863-45ee-b588-1852597a58f4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:20:09.075106 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61374fe5-1863-45ee-b588-1852597a58f4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:09.076278 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: WARNING py.warnings [None req-61374fe5-1863-45ee-b588-1852597a58f4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 05 02:20:09.076278 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: warnings.warn(msg) Aug 05 02:20:09.076278 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: Aug 05 02:20:09.077841 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61374fe5-1863-45ee-b588-1852597a58f4 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:09.082070 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a27c4-d74b-4711-8e0c-72728c2ec534 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:09.082360 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a27c4-d74b-4711-8e0c-72728c2ec534 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:09.082640 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948a27c4-d74b-4711-8e0c-72728c2ec534 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:09.097999 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 773/1543] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:20:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:20:09.106843 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61374fe5-1863-45ee-b588-1852597a58f4 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:09.112952 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-948a27c4-d74b-4711-8e0c-72728c2ec534 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:09.114162 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-948a27c4-d74b-4711-8e0c-72728c2ec534 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:09.122280 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61374fe5-1863-45ee-b588-1852597a58f4 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:09.128227 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 771/1544] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:20:09.132742 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a27c4-d74b-4711-8e0c-72728c2ec534 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:09.136501 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63068b7e-f9f4-4ef2-a5c2-c3a9ae447e1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:09.137139 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63068b7e-f9f4-4ef2-a5c2-c3a9ae447e1e admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:09.137419 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63068b7e-f9f4-4ef2-a5c2-c3a9ae447e1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:09.137683 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63068b7e-f9f4-4ef2-a5c2-c3a9ae447e1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:09.138353 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63068b7e-f9f4-4ef2-a5c2-c3a9ae447e1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:09.140810 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63068b7e-f9f4-4ef2-a5c2-c3a9ae447e1e admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:09.149581 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948a27c4-d74b-4711-8e0c-72728c2ec534 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:09.158472 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-514712ee-ffbb-4a64-8420-4a4117b134d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:09.159103 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514712ee-ffbb-4a64-8420-4a4117b134d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:09.159385 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514712ee-ffbb-4a64-8420-4a4117b134d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:09.159660 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-514712ee-ffbb-4a64-8420-4a4117b134d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:09.160408 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514712ee-ffbb-4a64-8420-4a4117b134d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:20:09.160915 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514712ee-ffbb-4a64-8420-4a4117b134d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:09.162525 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-514712ee-ffbb-4a64-8420-4a4117b134d6 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:09.183309 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 772/1545] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:20:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:20:09.184626 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531dcbbd-62b7-4cf8-9958-23e61f74909e None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:09.184914 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531dcbbd-62b7-4cf8-9958-23e61f74909e None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:09.185182 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-531dcbbd-62b7-4cf8-9958-23e61f74909e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:09.216770 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-531dcbbd-62b7-4cf8-9958-23e61f74909e None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:09.218058 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-531dcbbd-62b7-4cf8-9958-23e61f74909e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:09.231027 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 774/1546] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:20:09 2022] POST /identity/v3/projects => generated 393 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:20:09.232099 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 773/1547] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:09.233189 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ae33f-597e-47ec-a0c8-27d92bf29813 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:09.233485 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ae33f-597e-47ec-a0c8-27d92bf29813 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:09.234282 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531dcbbd-62b7-4cf8-9958-23e61f74909e None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:09.235199 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b93ae33f-597e-47ec-a0c8-27d92bf29813 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:09.253151 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-531dcbbd-62b7-4cf8-9958-23e61f74909e None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:09.270562 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-b93ae33f-597e-47ec-a0c8-27d92bf29813 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:09.271970 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-b93ae33f-597e-47ec-a0c8-27d92bf29813 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:09.319042 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5465cecb-a24e-48f1-8a72-ae45a8447365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:09.319583 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465cecb-a24e-48f1-8a72-ae45a8447365 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:09.319864 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465cecb-a24e-48f1-8a72-ae45a8447365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:09.320138 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5465cecb-a24e-48f1-8a72-ae45a8447365 admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:09.320865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5465cecb-a24e-48f1-8a72-ae45a8447365 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:09.322134 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: WARNING py.warnings [None req-5465cecb-a24e-48f1-8a72-ae45a8447365 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 02:20:09.322134 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: warnings.warn(msg) Aug 05 02:20:09.322134 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: Aug 05 02:20:09.323400 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5465cecb-a24e-48f1-8a72-ae45a8447365 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:09.350415 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 775/1548] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:09.351246 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ae33f-597e-47ec-a0c8-27d92bf29813 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:09.352639 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 774/1549] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:20:09 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:20:09.353997 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cba099-09c5-48c8-9b96-fc98dc3d004b None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:09.354312 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cba099-09c5-48c8-9b96-fc98dc3d004b None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:09.354585 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68cba099-09c5-48c8-9b96-fc98dc3d004b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:09.363827 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b93ae33f-597e-47ec-a0c8-27d92bf29813 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:09.376241 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-68cba099-09c5-48c8-9b96-fc98dc3d004b None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:09.377486 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-68cba099-09c5-48c8-9b96-fc98dc3d004b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:09.422322 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eee3a8f-4657-48fa-9294-c4844aaa9861 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:09.422961 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee3a8f-4657-48fa-9294-c4844aaa9861 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:09.423243 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee3a8f-4657-48fa-9294-c4844aaa9861 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:09.423524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eee3a8f-4657-48fa-9294-c4844aaa9861 admin admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:09.424186 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee3a8f-4657-48fa-9294-c4844aaa9861 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:09.425267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: WARNING py.warnings [None req-8eee3a8f-4657-48fa-9294-c4844aaa9861 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 02:20:09.425267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: warnings.warn(msg) Aug 05 02:20:09.425267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: Aug 05 02:20:09.426468 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eee3a8f-4657-48fa-9294-c4844aaa9861 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:09.438301 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 775/1550] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:09.439591 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bff2b9-85c9-4402-84ef-872e35742a59 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:09.439868 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bff2b9-85c9-4402-84ef-872e35742a59 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:09.440146 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9bff2b9-85c9-4402-84ef-872e35742a59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:09.455996 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 776/1551] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:20:09 2022] POST /identity/v3/users => generated 297 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:20:09.457503 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c998042-3353-49bb-835b-c87e3ac61b20 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:09.457795 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c998042-3353-49bb-835b-c87e3ac61b20 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:09.458072 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c998042-3353-49bb-835b-c87e3ac61b20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:09.462827 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-a9bff2b9-85c9-4402-84ef-872e35742a59 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:09.464030 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-a9bff2b9-85c9-4402-84ef-872e35742a59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:09.473806 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 776/1552] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:09.474821 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31d48e-e3d9-4513-8c32-f7732f56c2fd None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:09.475099 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31d48e-e3d9-4513-8c32-f7732f56c2fd None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:09.475370 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d31d48e-e3d9-4513-8c32-f7732f56c2fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:09.481285 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-9c998042-3353-49bb-835b-c87e3ac61b20 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:09.482491 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-9c998042-3353-49bb-835b-c87e3ac61b20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:09.491776 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 777/1553] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:09.493099 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ccb4b-506a-4479-97a3-b76f3c13f5e7 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:09.493404 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ccb4b-506a-4479-97a3-b76f3c13f5e7 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:09.493671 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533ccb4b-506a-4479-97a3-b76f3c13f5e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:09.495502 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-6d31d48e-e3d9-4513-8c32-f7732f56c2fd None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:09.496777 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-6d31d48e-e3d9-4513-8c32-f7732f56c2fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:09.505584 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 777/1554] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:09.506361 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31d48e-e3d9-4513-8c32-f7732f56c2fd None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:09.514782 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-533ccb4b-506a-4479-97a3-b76f3c13f5e7 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:09.515875 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d31d48e-e3d9-4513-8c32-f7732f56c2fd None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:09.517050 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-533ccb4b-506a-4479-97a3-b76f3c13f5e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:09.520494 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5761c374-3520-43a1-b712-ff438c439694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:09.521099 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761c374-3520-43a1-b712-ff438c439694 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:09.521377 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761c374-3520-43a1-b712-ff438c439694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:09.521652 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5761c374-3520-43a1-b712-ff438c439694 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:09.522308 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5761c374-3520-43a1-b712-ff438c439694 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:09.524202 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5761c374-3520-43a1-b712-ff438c439694 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:09.525135 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 778/1555] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:09.526543 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2cd4e-161e-44d4-8857-9e31b31b6f09 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:09.526832 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2cd4e-161e-44d4-8857-9e31b31b6f09 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:09.527106 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe2cd4e-161e-44d4-8857-9e31b31b6f09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:09.549629 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-2fe2cd4e-161e-44d4-8857-9e31b31b6f09 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:09.550843 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-2fe2cd4e-161e-44d4-8857-9e31b31b6f09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:09.552302 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 778/1556] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:20:09 2022] POST /identity/v3/users => generated 288 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:20:09.553601 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd69200-36ff-40d0-b0d7-2fbef7beeb13 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:09.553884 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd69200-36ff-40d0-b0d7-2fbef7beeb13 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:09.554159 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd69200-36ff-40d0-b0d7-2fbef7beeb13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:09.561506 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 779/1557] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:09.562599 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe2cd4e-161e-44d4-8857-9e31b31b6f09 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:09.572698 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe2cd4e-161e-44d4-8857-9e31b31b6f09 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:09.577896 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f6a665-e022-4bea-8d0e-c35b5bdbc2ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:09.578232 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-ffd69200-36ff-40d0-b0d7-2fbef7beeb13 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:09.578656 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6a665-e022-4bea-8d0e-c35b5bdbc2ce admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:09.578941 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6a665-e022-4bea-8d0e-c35b5bdbc2ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:09.579318 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f6a665-e022-4bea-8d0e-c35b5bdbc2ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:09.579458 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-ffd69200-36ff-40d0-b0d7-2fbef7beeb13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:09.580039 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6a665-e022-4bea-8d0e-c35b5bdbc2ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:09.581718 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f6a665-e022-4bea-8d0e-c35b5bdbc2ce admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:09.588089 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 779/1558] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:09.588904 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd69200-36ff-40d0-b0d7-2fbef7beeb13 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:09.592208 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 780/1559] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:20:09.594598 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ca8dd-2ff5-42b6-82a2-79ccb94f3b56 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:09.594892 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ca8dd-2ff5-42b6-82a2-79ccb94f3b56 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:09.595168 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8ca8dd-2ff5-42b6-82a2-79ccb94f3b56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:09.603033 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd69200-36ff-40d0-b0d7-2fbef7beeb13 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:09.608596 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1e6fb0-9e8c-4251-8991-a702994f8196 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:09.609507 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e6fb0-9e8c-4251-8991-a702994f8196 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:09.609920 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e6fb0-9e8c-4251-8991-a702994f8196 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:09.610394 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1e6fb0-9e8c-4251-8991-a702994f8196 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:09.611244 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1e6fb0-9e8c-4251-8991-a702994f8196 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:20:09.611655 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1e6fb0-9e8c-4251-8991-a702994f8196 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:09.613396 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1e6fb0-9e8c-4251-8991-a702994f8196 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:09.615104 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-3c8ca8dd-2ff5-42b6-82a2-79ccb94f3b56 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:09.616189 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:09.616357 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-3c8ca8dd-2ff5-42b6-82a2-79ccb94f3b56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:09.626017 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 781/1560] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:09.627088 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7ee1e-75e3-4e19-9cf7-bc0af86e2e28 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:09.627445 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7ee1e-75e3-4e19-9cf7-bc0af86e2e28 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:09.627791 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7ee1e-75e3-4e19-9cf7-bc0af86e2e28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:09.629016 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 780/1561] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:20:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:20:09.630455 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685bc38-38dd-4971-8e0d-50d31141ad09 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:09.630816 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685bc38-38dd-4971-8e0d-50d31141ad09 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:09.631164 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5685bc38-38dd-4971-8e0d-50d31141ad09 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:09.636164 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:09.650145 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-bdc7ee1e-75e3-4e19-9cf7-bc0af86e2e28 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:09.651387 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-bdc7ee1e-75e3-4e19-9cf7-bc0af86e2e28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:09.652452 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-5685bc38-38dd-4971-8e0d-50d31141ad09 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:09.653631 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-5685bc38-38dd-4971-8e0d-50d31141ad09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:09.659980 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 782/1562] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:09.660842 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7ee1e-75e3-4e19-9cf7-bc0af86e2e28 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:09.665568 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 781/1563] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:09.666420 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685bc38-38dd-4971-8e0d-50d31141ad09 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:09.675135 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7ee1e-75e3-4e19-9cf7-bc0af86e2e28 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:09.676451 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5685bc38-38dd-4971-8e0d-50d31141ad09 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:09.679879 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682f9a5-cf29-4d09-899c-2f6e2263b02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:09.680515 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682f9a5-cf29-4d09-899c-2f6e2263b02d admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:09.680799 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682f9a5-cf29-4d09-899c-2f6e2263b02d admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:09.681002 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa538b4-2998-43dc-ae9d-4b254960d66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:09.681113 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6682f9a5-cf29-4d09-899c-2f6e2263b02d admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:09.681598 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa538b4-2998-43dc-ae9d-4b254960d66a admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:09.681816 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6682f9a5-cf29-4d09-899c-2f6e2263b02d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:09.681921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa538b4-2998-43dc-ae9d-4b254960d66a admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:09.682138 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa538b4-2998-43dc-ae9d-4b254960d66a admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:09.682838 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa538b4-2998-43dc-ae9d-4b254960d66a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:20:09.683141 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa538b4-2998-43dc-ae9d-4b254960d66a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:09.683454 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6682f9a5-cf29-4d09-899c-2f6e2263b02d admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:09.684745 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa538b4-2998-43dc-ae9d-4b254960d66a admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:09.694217 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 783/1564] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:20:09.695161 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682f9a5-cf29-4d09-899c-2f6e2263b02d admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:09.700051 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 782/1565] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:20:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:20:09.700889 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa538b4-2998-43dc-ae9d-4b254960d66a admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:09.705472 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6682f9a5-cf29-4d09-899c-2f6e2263b02d admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:09.710488 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8eddbf-f61f-45eb-ba11-519601cf61c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:09.711084 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8eddbf-f61f-45eb-ba11-519601cf61c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:09.711369 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8eddbf-f61f-45eb-ba11-519601cf61c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:09.711649 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8eddbf-f61f-45eb-ba11-519601cf61c7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:09.712360 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8eddbf-f61f-45eb-ba11-519601cf61c7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:20:09.712673 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8eddbf-f61f-45eb-ba11-519601cf61c7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:09.713734 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa538b4-2998-43dc-ae9d-4b254960d66a admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:09.714291 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8eddbf-f61f-45eb-ba11-519601cf61c7 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:09.719136 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f6c62-9b75-4f9a-90df-b62783c5b3a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:09.719830 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f6c62-9b75-4f9a-90df-b62783c5b3a1 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:09.720112 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f6c62-9b75-4f9a-90df-b62783c5b3a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:09.720418 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265f6c62-9b75-4f9a-90df-b62783c5b3a1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:09.722797 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f6c62-9b75-4f9a-90df-b62783c5b3a1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:09.722967 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-265f6c62-9b75-4f9a-90df-b62783c5b3a1 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:09.731049 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 784/1566] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:20:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:20:09.733227 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8eddbf-f61f-45eb-ba11-519601cf61c7 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:09.733358 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 783/1567] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:20:09.734519 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f6c62-9b75-4f9a-90df-b62783c5b3a1 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:09.744413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265f6c62-9b75-4f9a-90df-b62783c5b3a1 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:09.745273 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8eddbf-f61f-45eb-ba11-519601cf61c7 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:09.748963 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96814de-4f52-476f-b8d9-daee6024b60a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:09.749825 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96814de-4f52-476f-b8d9-daee6024b60a admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:09.750016 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48b56f-be64-4266-9655-ed80296be083 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:09.750247 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96814de-4f52-476f-b8d9-daee6024b60a admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:09.750515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96814de-4f52-476f-b8d9-daee6024b60a admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:09.750625 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48b56f-be64-4266-9655-ed80296be083 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:09.750865 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48b56f-be64-4266-9655-ed80296be083 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:09.751141 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa48b56f-be64-4266-9655-ed80296be083 admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:09.751238 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96814de-4f52-476f-b8d9-daee6024b60a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:20:09.751533 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96814de-4f52-476f-b8d9-daee6024b60a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:09.751802 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa48b56f-be64-4266-9655-ed80296be083 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:09.753145 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96814de-4f52-476f-b8d9-daee6024b60a admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:09.753717 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa48b56f-be64-4266-9655-ed80296be083 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:09.764613 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 784/1568] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:20:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:20:09.767406 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96814de-4f52-476f-b8d9-daee6024b60a admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:09.776066 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96814de-4f52-476f-b8d9-daee6024b60a admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:09.781916 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba241320-6081-429e-a2e6-65d8cf264b28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:09.782640 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba241320-6081-429e-a2e6-65d8cf264b28 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:09.782929 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba241320-6081-429e-a2e6-65d8cf264b28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:09.783208 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba241320-6081-429e-a2e6-65d8cf264b28 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:09.783901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba241320-6081-429e-a2e6-65d8cf264b28 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:20:09.784206 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba241320-6081-429e-a2e6-65d8cf264b28 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:09.788815 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 785/1569] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:20:09 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:20:09.789035 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba241320-6081-429e-a2e6-65d8cf264b28 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:09.789156 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48b56f-be64-4266-9655-ed80296be083 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:09.805841 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 785/1570] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:20:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:20:09.805841 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba241320-6081-429e-a2e6-65d8cf264b28 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:09.809663 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba241320-6081-429e-a2e6-65d8cf264b28 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:09.849877 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa48b56f-be64-4266-9655-ed80296be083 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:09.854580 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4af075-d6a8-4168-84ef-e4175356a756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:09.855196 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4af075-d6a8-4168-84ef-e4175356a756 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:09.855477 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4af075-d6a8-4168-84ef-e4175356a756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:09.855751 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4af075-d6a8-4168-84ef-e4175356a756 admin admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:09.856476 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4af075-d6a8-4168-84ef-e4175356a756 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:20:09.856784 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4af075-d6a8-4168-84ef-e4175356a756 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:09.858380 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4af075-d6a8-4168-84ef-e4175356a756 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:09.867603 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313fd42e-fd80-4aa5-8799-b82b86924a04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:09.868221 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fd42e-fd80-4aa5-8799-b82b86924a04 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:09.868530 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fd42e-fd80-4aa5-8799-b82b86924a04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:09.868809 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313fd42e-fd80-4aa5-8799-b82b86924a04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:09.869531 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313fd42e-fd80-4aa5-8799-b82b86924a04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:09.871111 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313fd42e-fd80-4aa5-8799-b82b86924a04 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:09.871279 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 786/1571] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:20:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:20:09.872022 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4af075-d6a8-4168-84ef-e4175356a756 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:09.881985 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4af075-d6a8-4168-84ef-e4175356a756 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:09.883623 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 786/1572] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:20:09 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:20:09.884402 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313fd42e-fd80-4aa5-8799-b82b86924a04 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:09.889590 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50022c2-ec66-4441-abc7-a3825a712372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:09.891295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50022c2-ec66-4441-abc7-a3825a712372 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:09.891600 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50022c2-ec66-4441-abc7-a3825a712372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:09.891881 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50022c2-ec66-4441-abc7-a3825a712372 admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:09.892576 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50022c2-ec66-4441-abc7-a3825a712372 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:09.894476 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50022c2-ec66-4441-abc7-a3825a712372 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:09.896975 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313fd42e-fd80-4aa5-8799-b82b86924a04 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:09.901533 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd880f-4ff4-429a-ba0c-a29e5634d0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:09.902180 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd880f-4ff4-429a-ba0c-a29e5634d0b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:09.902463 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd880f-4ff4-429a-ba0c-a29e5634d0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:09.902740 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97dd880f-4ff4-429a-ba0c-a29e5634d0b7 admin admin] PATH_INFO: `/v3/projects/00eaaf2e12844123996e26c1827d80b2/users/5bf84408a3984972a5bb68a3117c0501/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:09.917967 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd880f-4ff4-429a-ba0c-a29e5634d0b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=00eaaf2e12844123996e26c1827d80b2, user_id=5bf84408a3984972a5bb68a3117c0501, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:09.919134 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: WARNING py.warnings [None req-97dd880f-4ff4-429a-ba0c-a29e5634d0b7 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 02:20:09.919134 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: warnings.warn(msg) Aug 05 02:20:09.919134 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: Aug 05 02:20:09.921679 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97dd880f-4ff4-429a-ba0c-a29e5634d0b7 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:09.923543 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 787/1573] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:20:09 2022] POST /identity/v3/projects => generated 405 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:20:09.924338 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50022c2-ec66-4441-abc7-a3825a712372 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:09.937459 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 787/1574] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:20:09 2022] PUT /identity/v3/projects/00eaaf2e12844123996e26c1827d80b2/users/5bf84408a3984972a5bb68a3117c0501/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:20:09.941904 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd880f-4ff4-429a-ba0c-a29e5634d0b7 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:09.989422 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50022c2-ec66-4441-abc7-a3825a712372 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:10.007802 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97dd880f-4ff4-429a-ba0c-a29e5634d0b7 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:10.014478 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d05c79-e7f4-473f-82ab-e7b6ac815222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:10.015889 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d05c79-e7f4-473f-82ab-e7b6ac815222 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:10.016526 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d05c79-e7f4-473f-82ab-e7b6ac815222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:10.016789 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d05c79-e7f4-473f-82ab-e7b6ac815222 admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:10.017405 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d05c79-e7f4-473f-82ab-e7b6ac815222 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:10.018538 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:10.019638 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d05c79-e7f4-473f-82ab-e7b6ac815222 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:10.036767 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:10.050320 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 788/1575] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:20:09 2022] POST /identity/v3/projects => generated 383 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:20:10.051222 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d05c79-e7f4-473f-82ab-e7b6ac815222 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:10.055281 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45efb632-8ecb-4423-9946-1364cf3cf221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:10.055900 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45efb632-8ecb-4423-9946-1364cf3cf221 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:10.056183 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45efb632-8ecb-4423-9946-1364cf3cf221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:10.056524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45efb632-8ecb-4423-9946-1364cf3cf221 admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:10.057198 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45efb632-8ecb-4423-9946-1364cf3cf221 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:10.059133 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45efb632-8ecb-4423-9946-1364cf3cf221 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:10.087790 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 788/1576] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:20:09 2022] POST /identity/v3/projects => generated 365 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:20:10.088542 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45efb632-8ecb-4423-9946-1364cf3cf221 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:10.120027 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d05c79-e7f4-473f-82ab-e7b6ac815222 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:10.151372 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45efb632-8ecb-4423-9946-1364cf3cf221 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:10.156232 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0310b1-8bd7-477e-acc9-a7fccbefd712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:10.156884 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0310b1-8bd7-477e-acc9-a7fccbefd712 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:10.157166 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0310b1-8bd7-477e-acc9-a7fccbefd712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:10.157439 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0310b1-8bd7-477e-acc9-a7fccbefd712 admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:10.158126 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0310b1-8bd7-477e-acc9-a7fccbefd712 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:10.160021 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0310b1-8bd7-477e-acc9-a7fccbefd712 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:10.179290 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9624a-ea2e-49bc-9c89-64f5dd875a9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:10.179971 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9624a-ea2e-49bc-9c89-64f5dd875a9a admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:10.180293 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9624a-ea2e-49bc-9c89-64f5dd875a9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:10.180702 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9624a-ea2e-49bc-9c89-64f5dd875a9a admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:10.181396 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef9624a-ea2e-49bc-9c89-64f5dd875a9a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:10.183298 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef9624a-ea2e-49bc-9c89-64f5dd875a9a admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:10.189313 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 789/1577] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:20:10 2022] POST /identity/v3/projects => generated 389 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:20:10.190349 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0310b1-8bd7-477e-acc9-a7fccbefd712 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:10.205996 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 789/1578] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:20:10 2022] POST /identity/v3/users => generated 287 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:20:10.207136 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9624a-ea2e-49bc-9c89-64f5dd875a9a admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:10.216742 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9624a-ea2e-49bc-9c89-64f5dd875a9a admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:10.254767 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0310b1-8bd7-477e-acc9-a7fccbefd712 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:10.259358 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b4a76-c78e-44ee-98a0-ce71defd6b9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:10.259969 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b4a76-c78e-44ee-98a0-ce71defd6b9d admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:10.260249 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b4a76-c78e-44ee-98a0-ce71defd6b9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:10.260557 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-681b4a76-c78e-44ee-98a0-ce71defd6b9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:10.261217 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b4a76-c78e-44ee-98a0-ce71defd6b9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:10.263120 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-681b4a76-c78e-44ee-98a0-ce71defd6b9d admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:10.275278 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ab4fc-16a9-4a59-a794-16f460975fe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:10.275861 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ab4fc-16a9-4a59-a794-16f460975fe9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:10.276136 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ab4fc-16a9-4a59-a794-16f460975fe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:10.276435 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ab4fc-16a9-4a59-a794-16f460975fe9 admin admin] PATH_INFO: `/v3/projects/ce1ac0db26e648bba79191b3ad8a260b/users/64280d0c3da14f329b6fc21228d92288/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:10.291054 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ab4fc-16a9-4a59-a794-16f460975fe9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ce1ac0db26e648bba79191b3ad8a260b, user_id=64280d0c3da14f329b6fc21228d92288, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:10.293241 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 790/1579] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:20:10 2022] POST /identity/v3/projects => generated 379 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:20:10.293720 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ab4fc-16a9-4a59-a794-16f460975fe9 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:10.294237 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b4a76-c78e-44ee-98a0-ce71defd6b9d admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:10.307693 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 790/1580] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:20:10 2022] PUT /identity/v3/projects/ce1ac0db26e648bba79191b3ad8a260b/users/64280d0c3da14f329b6fc21228d92288/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:20:10.312194 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ecfc5-aa2a-4bdc-aefa-a1e68b0da3ec None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:10.312194 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ecfc5-aa2a-4bdc-aefa-a1e68b0da3ec None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:10.312194 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7ecfc5-aa2a-4bdc-aefa-a1e68b0da3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:10.324084 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:10.330951 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-7c7ecfc5-aa2a-4bdc-aefa-a1e68b0da3ec None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:10.332265 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-7c7ecfc5-aa2a-4bdc-aefa-a1e68b0da3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:10.341435 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:10.361960 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-681b4a76-c78e-44ee-98a0-ce71defd6b9d admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:10.395278 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 791/1581] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:10.396393 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ecfc5-aa2a-4bdc-aefa-a1e68b0da3ec None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:10.405570 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7ecfc5-aa2a-4bdc-aefa-a1e68b0da3ec None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:10.410423 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9722880-fb40-4640-a168-09261c2cb285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:10.411032 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9722880-fb40-4640-a168-09261c2cb285 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:10.411312 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9722880-fb40-4640-a168-09261c2cb285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:10.411579 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9722880-fb40-4640-a168-09261c2cb285 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:10.412230 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9722880-fb40-4640-a168-09261c2cb285 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:10.414147 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9722880-fb40-4640-a168-09261c2cb285 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:10.419888 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb8f25-d5d8-45d3-9dc0-05d3b2255284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:10.420538 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb8f25-d5d8-45d3-9dc0-05d3b2255284 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:10.420815 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb8f25-d5d8-45d3-9dc0-05d3b2255284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:10.421576 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb8f25-d5d8-45d3-9dc0-05d3b2255284 admin admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:10.422235 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb8f25-d5d8-45d3-9dc0-05d3b2255284 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:10.425144 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58cb8f25-d5d8-45d3-9dc0-05d3b2255284 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:10.436080 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 792/1582] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:20:10 2022] POST /identity/v3/users => generated 292 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:20:10.437837 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9722880-fb40-4640-a168-09261c2cb285 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:10.447288 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9722880-fb40-4640-a168-09261c2cb285 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:10.449736 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 791/1583] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:20:10 2022] POST /identity/v3/users => generated 303 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:20:10.450508 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb8f25-d5d8-45d3-9dc0-05d3b2255284 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:10.455976 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5fd2bf-47e3-4634-a88f-cb1ac4ea55f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:10.456675 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fd2bf-47e3-4634-a88f-cb1ac4ea55f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:10.456960 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fd2bf-47e3-4634-a88f-cb1ac4ea55f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:10.457240 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5fd2bf-47e3-4634-a88f-cb1ac4ea55f9 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:10.457905 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5fd2bf-47e3-4634-a88f-cb1ac4ea55f9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:10.459837 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a5fd2bf-47e3-4634-a88f-cb1ac4ea55f9 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:10.460770 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb8f25-d5d8-45d3-9dc0-05d3b2255284 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:10.465512 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a736b80-1eaa-47bf-b9f7-066c58341105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:10.466118 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a736b80-1eaa-47bf-b9f7-066c58341105 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:10.466423 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a736b80-1eaa-47bf-b9f7-066c58341105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:10.466701 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a736b80-1eaa-47bf-b9f7-066c58341105 admin admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:10.467356 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a736b80-1eaa-47bf-b9f7-066c58341105 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:10.470560 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a736b80-1eaa-47bf-b9f7-066c58341105 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:10.481798 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 793/1584] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:20:10 2022] POST /identity/v3/users => generated 283 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:20:10.482778 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5fd2bf-47e3-4634-a88f-cb1ac4ea55f9 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:10.492635 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 792/1585] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:20:10 2022] POST /identity/v3/users => generated 295 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:20:10.493640 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a736b80-1eaa-47bf-b9f7-066c58341105 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:10.493781 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5fd2bf-47e3-4634-a88f-cb1ac4ea55f9 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:10.500359 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208c82b-8aef-45ca-8d7f-538b53137cbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:10.500966 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208c82b-8aef-45ca-8d7f-538b53137cbc admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:10.501247 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208c82b-8aef-45ca-8d7f-538b53137cbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:10.501520 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208c82b-8aef-45ca-8d7f-538b53137cbc admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:10.502234 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208c82b-8aef-45ca-8d7f-538b53137cbc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:10.503190 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a736b80-1eaa-47bf-b9f7-066c58341105 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:10.503810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208c82b-8aef-45ca-8d7f-538b53137cbc admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:10.507771 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ceff9f-37b6-49fc-b743-cc2102b5792d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:10.508386 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ceff9f-37b6-49fc-b743-cc2102b5792d admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:10.508689 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ceff9f-37b6-49fc-b743-cc2102b5792d admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:10.508947 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ceff9f-37b6-49fc-b743-cc2102b5792d admin admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:10.509597 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ceff9f-37b6-49fc-b743-cc2102b5792d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:10.511489 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ceff9f-37b6-49fc-b743-cc2102b5792d admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:10.514567 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 794/1586] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:20:10.516438 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b556d1-8af1-47bd-b84a-71a4ad83f87b None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:10.516723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b556d1-8af1-47bd-b84a-71a4ad83f87b None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:10.516991 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b556d1-8af1-47bd-b84a-71a4ad83f87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:10.535207 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 793/1587] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:20:10 2022] POST /identity/v3/users => generated 290 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:20:10.536817 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-f4b556d1-8af1-47bd-b84a-71a4ad83f87b None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:10.538668 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ceff9f-37b6-49fc-b743-cc2102b5792d admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:10.538874 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-f4b556d1-8af1-47bd-b84a-71a4ad83f87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:10.546787 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 795/1588] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:10.547579 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b556d1-8af1-47bd-b84a-71a4ad83f87b None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:10.556860 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4b556d1-8af1-47bd-b84a-71a4ad83f87b None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:10.561547 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae991759-f6c7-4028-ac96-3e5558f213b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:10.562328 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae991759-f6c7-4028-ac96-3e5558f213b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:10.562638 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae991759-f6c7-4028-ac96-3e5558f213b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:10.562950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae991759-f6c7-4028-ac96-3e5558f213b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:10.563643 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae991759-f6c7-4028-ac96-3e5558f213b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:10.565370 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae991759-f6c7-4028-ac96-3e5558f213b2 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:10.578956 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 796/1589] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:20:10.578956 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae991759-f6c7-4028-ac96-3e5558f213b2 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:10.586135 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae991759-f6c7-4028-ac96-3e5558f213b2 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:10.591265 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9d802-9911-493f-94ea-8b7c5af4935a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:10.591924 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9d802-9911-493f-94ea-8b7c5af4935a admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:10.592153 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9d802-9911-493f-94ea-8b7c5af4935a admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:10.592461 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a9d802-9911-493f-94ea-8b7c5af4935a admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:10.593821 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a9d802-9911-493f-94ea-8b7c5af4935a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:10.595403 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a9d802-9911-493f-94ea-8b7c5af4935a admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:10.599108 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ceff9f-37b6-49fc-b743-cc2102b5792d admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:10.602802 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0612c-ff2c-454a-99cf-c0e717614fbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:10.603412 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0612c-ff2c-454a-99cf-c0e717614fbd service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:10.603693 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0612c-ff2c-454a-99cf-c0e717614fbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:10.603968 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15b0612c-ff2c-454a-99cf-c0e717614fbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:10.606080 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 797/1590] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:20:10.607040 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9d802-9911-493f-94ea-8b7c5af4935a admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:10.616055 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0612c-ff2c-454a-99cf-c0e717614fbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:10.616460 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a9d802-9911-493f-94ea-8b7c5af4935a admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:10.617552 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15b0612c-ff2c-454a-99cf-c0e717614fbd service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:10.620922 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a26fe-b41d-4737-bb53-c1e2d60f037f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:10.621502 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a26fe-b41d-4737-bb53-c1e2d60f037f admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:10.621778 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a26fe-b41d-4737-bb53-c1e2d60f037f admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:10.622054 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb3a26fe-b41d-4737-bb53-c1e2d60f037f admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:10.622719 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3a26fe-b41d-4737-bb53-c1e2d60f037f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:10.624295 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb3a26fe-b41d-4737-bb53-c1e2d60f037f admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:10.627173 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 794/1591] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:20:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:20:10.627814 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0612c-ff2c-454a-99cf-c0e717614fbd service neutron] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:10.634804 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 798/1592] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:20:10.635748 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a26fe-b41d-4737-bb53-c1e2d60f037f admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:10.637234 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15b0612c-ff2c-454a-99cf-c0e717614fbd service neutron] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:10.642960 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877349f-a3a6-43ce-a445-b3b147525766 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:10.643801 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877349f-a3a6-43ce-a445-b3b147525766 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:10.644150 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877349f-a3a6-43ce-a445-b3b147525766 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:10.644595 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9877349f-a3a6-43ce-a445-b3b147525766 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:10.645310 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9877349f-a3a6-43ce-a445-b3b147525766 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:10.646376 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb3a26fe-b41d-4737-bb53-c1e2d60f037f admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:10.646911 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9877349f-a3a6-43ce-a445-b3b147525766 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:10.651379 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5903d8e-e348-4704-aaac-6ec497655737 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:10.651983 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5903d8e-e348-4704-aaac-6ec497655737 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:10.652257 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5903d8e-e348-4704-aaac-6ec497655737 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:10.652559 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5903d8e-e348-4704-aaac-6ec497655737 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:10.653249 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5903d8e-e348-4704-aaac-6ec497655737 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:10.654796 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5903d8e-e348-4704-aaac-6ec497655737 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:10.658873 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 795/1593] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:20:10.659886 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877349f-a3a6-43ce-a445-b3b147525766 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:10.668428 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 799/1594] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:20:10.669277 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5903d8e-e348-4704-aaac-6ec497655737 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:10.672855 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9877349f-a3a6-43ce-a445-b3b147525766 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:10.678711 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09b509-54cf-4061-9499-b554dfb1cb55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:10.679359 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09b509-54cf-4061-9499-b554dfb1cb55 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:10.679632 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09b509-54cf-4061-9499-b554dfb1cb55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:10.679934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db09b509-54cf-4061-9499-b554dfb1cb55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:10.680685 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db09b509-54cf-4061-9499-b554dfb1cb55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:10.682430 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db09b509-54cf-4061-9499-b554dfb1cb55 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:10.683631 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5903d8e-e348-4704-aaac-6ec497655737 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:10.689431 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c42442-63dc-4b9c-972a-8b4b2cc50679 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:10.690104 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c42442-63dc-4b9c-972a-8b4b2cc50679 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:10.690382 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c42442-63dc-4b9c-972a-8b4b2cc50679 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:10.690952 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c42442-63dc-4b9c-972a-8b4b2cc50679 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:10.697058 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 796/1595] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:20:10.697058 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09b509-54cf-4061-9499-b554dfb1cb55 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:10.705875 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c42442-63dc-4b9c-972a-8b4b2cc50679 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:10.706064 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db09b509-54cf-4061-9499-b554dfb1cb55 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:10.707326 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c42442-63dc-4b9c-972a-8b4b2cc50679 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:10.710690 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef650f6d-caaa-43a5-837f-eea2d9a942ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:10.711294 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef650f6d-caaa-43a5-837f-eea2d9a942ce admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:10.711575 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef650f6d-caaa-43a5-837f-eea2d9a942ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:10.711972 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef650f6d-caaa-43a5-837f-eea2d9a942ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:10.712925 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef650f6d-caaa-43a5-837f-eea2d9a942ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:10.714267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef650f6d-caaa-43a5-837f-eea2d9a942ce admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:10.715660 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:10.720647 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 800/1596] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:20:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:20:10.722337 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c42442-63dc-4b9c-972a-8b4b2cc50679 service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:10.731658 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 797/1597] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:20:10.732894 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c42442-63dc-4b9c-972a-8b4b2cc50679 service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:10.733447 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef650f6d-caaa-43a5-837f-eea2d9a942ce admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:10.738585 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0716f8-3093-4d74-9c2a-69ee45a00d26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:10.739118 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0716f8-3093-4d74-9c2a-69ee45a00d26 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:10.739398 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0716f8-3093-4d74-9c2a-69ee45a00d26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:10.739660 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0716f8-3093-4d74-9c2a-69ee45a00d26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:10.740553 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0716f8-3093-4d74-9c2a-69ee45a00d26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:10.742828 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee0716f8-3093-4d74-9c2a-69ee45a00d26 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:10.746250 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef650f6d-caaa-43a5-837f-eea2d9a942ce admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:10.751990 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72494c14-67a6-4ddf-a6d8-853d08af1734 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:10.752728 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72494c14-67a6-4ddf-a6d8-853d08af1734 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:10.753180 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72494c14-67a6-4ddf-a6d8-853d08af1734 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:10.753825 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72494c14-67a6-4ddf-a6d8-853d08af1734 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:10.754353 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 801/1598] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:20:10.754494 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72494c14-67a6-4ddf-a6d8-853d08af1734 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:10.755328 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0716f8-3093-4d74-9c2a-69ee45a00d26 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:10.756195 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72494c14-67a6-4ddf-a6d8-853d08af1734 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:10.767865 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 798/1599] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:20:10.771577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0716f8-3093-4d74-9c2a-69ee45a00d26 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:10.771909 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72494c14-67a6-4ddf-a6d8-853d08af1734 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:10.776845 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc8c506-12d4-4212-a024-e9d079f3faaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:10.777476 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8c506-12d4-4212-a024-e9d079f3faaf admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:10.777802 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8c506-12d4-4212-a024-e9d079f3faaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:10.778035 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc8c506-12d4-4212-a024-e9d079f3faaf admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:10.778732 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc8c506-12d4-4212-a024-e9d079f3faaf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:10.780470 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cc8c506-12d4-4212-a024-e9d079f3faaf admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:10.784440 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72494c14-67a6-4ddf-a6d8-853d08af1734 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:10.790118 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20155f9a-ac71-42b8-94f0-8f5d9bceebad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:10.790902 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20155f9a-ac71-42b8-94f0-8f5d9bceebad admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:10.791257 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20155f9a-ac71-42b8-94f0-8f5d9bceebad admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:10.791607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20155f9a-ac71-42b8-94f0-8f5d9bceebad admin admin] PATH_INFO: `/v3/projects/0207e89d12a14539bead80f6312f93fc/users/729190451d35466ba0385522d165a895/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:10.792708 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 802/1600] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:20:10.797066 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc8c506-12d4-4212-a024-e9d079f3faaf admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:10.807328 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc8c506-12d4-4212-a024-e9d079f3faaf admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:10.814440 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1522f3-e456-47cb-a37c-ecbaa53bcd22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:10.815161 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1522f3-e456-47cb-a37c-ecbaa53bcd22 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:10.815455 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1522f3-e456-47cb-a37c-ecbaa53bcd22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:10.816104 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1522f3-e456-47cb-a37c-ecbaa53bcd22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:10.816214 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20155f9a-ac71-42b8-94f0-8f5d9bceebad admin admin] RBAC: Authorizing `identity:create_grant(project_id=0207e89d12a14539bead80f6312f93fc, user_id=729190451d35466ba0385522d165a895, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:10.816558 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1522f3-e456-47cb-a37c-ecbaa53bcd22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:10.818295 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1522f3-e456-47cb-a37c-ecbaa53bcd22 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:10.819840 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20155f9a-ac71-42b8-94f0-8f5d9bceebad admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:10.830244 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 803/1601] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:20:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:20:10.831081 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1522f3-e456-47cb-a37c-ecbaa53bcd22 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:10.838489 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 799/1602] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:20:10 2022] PUT /identity/v3/projects/0207e89d12a14539bead80f6312f93fc/users/729190451d35466ba0385522d165a895/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:20:10.839685 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20155f9a-ac71-42b8-94f0-8f5d9bceebad admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:10.852656 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1522f3-e456-47cb-a37c-ecbaa53bcd22 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:10.891542 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:10.923092 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12fc7a-7394-4732-99f2-ad4e1994b9f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:10.923340 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20155f9a-ac71-42b8-94f0-8f5d9bceebad admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:10.923786 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12fc7a-7394-4732-99f2-ad4e1994b9f2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:10.924073 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12fc7a-7394-4732-99f2-ad4e1994b9f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:10.924388 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd12fc7a-7394-4732-99f2-ad4e1994b9f2 admin admin] PATH_INFO: `/v3/projects/ad6a220b99d94a648150476bf0a01e50/users/600f51be8202427fb3691db566ed2ff2/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:10.928735 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18537c8-e65a-4740-acbe-7d40b477b562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:10.929517 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18537c8-e65a-4740-acbe-7d40b477b562 admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:10.929795 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18537c8-e65a-4740-acbe-7d40b477b562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:10.930070 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e18537c8-e65a-4740-acbe-7d40b477b562 admin admin] PATH_INFO: `/v3/projects/68240fa7edf743ecaa16a8dab7e77aad/users/38fd86e9cb75485bb102132000c0f256/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:10.943396 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd12fc7a-7394-4732-99f2-ad4e1994b9f2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad6a220b99d94a648150476bf0a01e50, user_id=600f51be8202427fb3691db566ed2ff2, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:10.946490 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd12fc7a-7394-4732-99f2-ad4e1994b9f2 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:10.949865 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18537c8-e65a-4740-acbe-7d40b477b562 admin admin] RBAC: Authorizing `identity:create_grant(project_id=68240fa7edf743ecaa16a8dab7e77aad, user_id=38fd86e9cb75485bb102132000c0f256, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:10.951758 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e18537c8-e65a-4740-acbe-7d40b477b562 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:10.970548 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 800/1603] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:20:10 2022] PUT /identity/v3/projects/68240fa7edf743ecaa16a8dab7e77aad/users/38fd86e9cb75485bb102132000c0f256/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:20:10.982053 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18537c8-e65a-4740-acbe-7d40b477b562 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:10.985656 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 804/1604] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:20:10 2022] PUT /identity/v3/projects/ad6a220b99d94a648150476bf0a01e50/users/600f51be8202427fb3691db566ed2ff2/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:20:10.986939 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12fc7a-7394-4732-99f2-ad4e1994b9f2 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:11.048457 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e18537c8-e65a-4740-acbe-7d40b477b562 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:11.069803 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd12fc7a-7394-4732-99f2-ad4e1994b9f2 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:11.074877 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91028b-8497-4b09-9f66-85e0bbed3783 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:11.075703 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91028b-8497-4b09-9f66-85e0bbed3783 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:11.076089 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91028b-8497-4b09-9f66-85e0bbed3783 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:11.076503 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af91028b-8497-4b09-9f66-85e0bbed3783 admin admin] PATH_INFO: `/v3/projects/6873a99b9878495895acb21ed2133bb6/users/3d47613c7085460da42e2179625b3f16/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:11.101499 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91028b-8497-4b09-9f66-85e0bbed3783 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6873a99b9878495895acb21ed2133bb6, user_id=3d47613c7085460da42e2179625b3f16, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:11.104219 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af91028b-8497-4b09-9f66-85e0bbed3783 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:11.110062 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:11.122864 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 805/1605] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:20:10 2022] PUT /identity/v3/projects/6873a99b9878495895acb21ed2133bb6/users/3d47613c7085460da42e2179625b3f16/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:20:11.124282 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91028b-8497-4b09-9f66-85e0bbed3783 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:11.135703 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b61c2c60-f5a8-4242-a054-096938fb926a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:11.136293 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c2c60-f5a8-4242-a054-096938fb926a admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:11.136691 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c2c60-f5a8-4242-a054-096938fb926a admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:11.137032 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b61c2c60-f5a8-4242-a054-096938fb926a admin admin] PATH_INFO: `/v3/projects/dd1e9101937649e6bbe9874dec3087a5/users/f47b1fc3c5484d68a7dfb5cf0dd5809c/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:11.156656 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c2c60-f5a8-4242-a054-096938fb926a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dd1e9101937649e6bbe9874dec3087a5, user_id=f47b1fc3c5484d68a7dfb5cf0dd5809c, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:11.159527 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b61c2c60-f5a8-4242-a054-096938fb926a admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:11.176233 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 801/1606] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:20:10 2022] PUT /identity/v3/projects/dd1e9101937649e6bbe9874dec3087a5/users/f47b1fc3c5484d68a7dfb5cf0dd5809c/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:20:11.177849 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee29bc1-3dad-40d7-baaa-7e01ea4f57f1 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:11.178202 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee29bc1-3dad-40d7-baaa-7e01ea4f57f1 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:11.178538 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee29bc1-3dad-40d7-baaa-7e01ea4f57f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:11.212838 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-6ee29bc1-3dad-40d7-baaa-7e01ea4f57f1 None None] MFA Rules not processed for user `729190451d35466ba0385522d165a895`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:11.214062 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-6ee29bc1-3dad-40d7-baaa-7e01ea4f57f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:11.217256 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af91028b-8497-4b09-9f66-85e0bbed3783 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:11.273773 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:11.293856 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b06235b0-d073-47ef-ba70-3fbc9f65e1e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:11.295139 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06235b0-d073-47ef-ba70-3fbc9f65e1e4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:11.295775 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06235b0-d073-47ef-ba70-3fbc9f65e1e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:11.297034 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b06235b0-d073-47ef-ba70-3fbc9f65e1e4 admin admin] PATH_INFO: `/v3/projects/5550d9709b98404290936885c7bbb16d/users/4e39a7be17b94c9c9dfb9ac1599a0052/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:11.305037 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 802/1607] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:11.307212 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8e05b-ecc7-4e48-ae66-adb97489aa8c None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:11.307719 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8e05b-ecc7-4e48-ae66-adb97489aa8c None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:11.308093 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d8e05b-ecc7-4e48-ae66-adb97489aa8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:11.330207 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06235b0-d073-47ef-ba70-3fbc9f65e1e4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5550d9709b98404290936885c7bbb16d, user_id=4e39a7be17b94c9c9dfb9ac1599a0052, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:11.333072 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b06235b0-d073-47ef-ba70-3fbc9f65e1e4 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:11.346853 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-a3d8e05b-ecc7-4e48-ae66-adb97489aa8c None None] MFA Rules not processed for user `38fd86e9cb75485bb102132000c0f256`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:11.349369 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-a3d8e05b-ecc7-4e48-ae66-adb97489aa8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:11.354021 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 806/1608] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:20:11 2022] PUT /identity/v3/projects/5550d9709b98404290936885c7bbb16d/users/4e39a7be17b94c9c9dfb9ac1599a0052/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:20:11.355775 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc415af9-d18e-49d6-b9df-ebc3ba6de543 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:11.356283 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc415af9-d18e-49d6-b9df-ebc3ba6de543 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:11.356858 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc415af9-d18e-49d6-b9df-ebc3ba6de543 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:11.383447 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-fc415af9-d18e-49d6-b9df-ebc3ba6de543 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:11.384944 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-fc415af9-d18e-49d6-b9df-ebc3ba6de543 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:11.489216 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 807/1609] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:11.489216 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4f7cf-caf4-467d-92e5-e8427e409b52 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:11.489216 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4f7cf-caf4-467d-92e5-e8427e409b52 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:11.489216 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4f7cf-caf4-467d-92e5-e8427e409b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:11.493850 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 803/1610] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:11 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:11.495549 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86040b-37f4-42c6-a03a-c297d3823707 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:11.496369 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86040b-37f4-42c6-a03a-c297d3823707 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:11.496369 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce86040b-37f4-42c6-a03a-c297d3823707 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:11.514736 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-55d4f7cf-caf4-467d-92e5-e8427e409b52 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:11.516539 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-55d4f7cf-caf4-467d-92e5-e8427e409b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:11.531751 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 808/1611] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:11.531751 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b8970-c26a-4a8f-892c-7c812a7dbabc None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:11.531751 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b8970-c26a-4a8f-892c-7c812a7dbabc None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:11.532286 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9b8970-c26a-4a8f-892c-7c812a7dbabc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:11.565096 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-ce86040b-37f4-42c6-a03a-c297d3823707 None None] MFA Rules not processed for user `f47b1fc3c5484d68a7dfb5cf0dd5809c`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:11.566726 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-ce86040b-37f4-42c6-a03a-c297d3823707 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:11.569588 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-ff9b8970-c26a-4a8f-892c-7c812a7dbabc None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:11.570925 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-ff9b8970-c26a-4a8f-892c-7c812a7dbabc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:11.580002 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 809/1612] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:11.581842 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddb611-9a8f-4a50-ae31-79e6cbc13a22 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:11.581842 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddb611-9a8f-4a50-ae31-79e6cbc13a22 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:11.582044 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddb611-9a8f-4a50-ae31-79e6cbc13a22 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:11.583736 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 810/1613] 10.222.0.15 () {54 vars in 962 bytes} [Fri Aug 5 02:20:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:20:11.584464 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dddb611-9a8f-4a50-ae31-79e6cbc13a22 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:11.602174 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dddb611-9a8f-4a50-ae31-79e6cbc13a22 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:11.612621 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d20a30-cc03-4d83-9365-5b82517b21c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:11.613237 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d20a30-cc03-4d83-9365-5b82517b21c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:11.613521 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d20a30-cc03-4d83-9365-5b82517b21c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:11.613997 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99d20a30-cc03-4d83-9365-5b82517b21c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:11.615049 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d20a30-cc03-4d83-9365-5b82517b21c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:11.620910 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99d20a30-cc03-4d83-9365-5b82517b21c4 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:11.637550 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:11.666069 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 811/1614] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:20:11 2022] POST /identity/v3/projects => generated 403 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:20:11.667174 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d20a30-cc03-4d83-9365-5b82517b21c4 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:11.671792 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-99d20a30-cc03-4d83-9365-5b82517b21c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:11.681676 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 804/1615] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:11.683316 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86040b-37f4-42c6-a03a-c297d3823707 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:11.756423 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99d20a30-cc03-4d83-9365-5b82517b21c4 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:11.761261 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc40c6-5f06-4a05-8d06-9369228ce8fa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:11.762120 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc40c6-5f06-4a05-8d06-9369228ce8fa service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:11.763011 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc40c6-5f06-4a05-8d06-9369228ce8fa service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:11.763665 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2fc40c6-5f06-4a05-8d06-9369228ce8fa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:11.774980 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce86040b-37f4-42c6-a03a-c297d3823707 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:11.779350 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f57bbb2-4f31-4584-9990-577e6331171a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:11.781661 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57bbb2-4f31-4584-9990-577e6331171a service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:11.782555 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57bbb2-4f31-4584-9990-577e6331171a service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:11.782986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f57bbb2-4f31-4584-9990-577e6331171a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:11.865866 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:11.883689 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f57bbb2-4f31-4584-9990-577e6331171a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:11.885216 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f57bbb2-4f31-4584-9990-577e6331171a service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:11.897233 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 805/1616] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:20:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:20:11.898742 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b45ddd-3a0e-4524-9450-106094bb4fdd None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:11.898883 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b45ddd-3a0e-4524-9450-106094bb4fdd None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:11.899061 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b45ddd-3a0e-4524-9450-106094bb4fdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:11.901076 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc40c6-5f06-4a05-8d06-9369228ce8fa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:11.903084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2fc40c6-5f06-4a05-8d06-9369228ce8fa service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:11.925571 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 812/1617] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:20:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 259 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:20:11.926447 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc40c6-5f06-4a05-8d06-9369228ce8fa service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:11.945099 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2fc40c6-5f06-4a05-8d06-9369228ce8fa service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:11.955225 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ec817-a0a0-4ea6-bdb2-fdd1a3e18a16 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:11.956899 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ec817-a0a0-4ea6-bdb2-fdd1a3e18a16 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:11.958382 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ec817-a0a0-4ea6-bdb2-fdd1a3e18a16 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:11.958867 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744ec817-a0a0-4ea6-bdb2-fdd1a3e18a16 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:11.961576 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-76b45ddd-3a0e-4524-9450-106094bb4fdd None None] MFA Rules not processed for user `4b5c0958604b436daa44b1f67c9dec26`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:11.963301 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-76b45ddd-3a0e-4524-9450-106094bb4fdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:12.000764 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ec817-a0a0-4ea6-bdb2-fdd1a3e18a16 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:12.003702 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744ec817-a0a0-4ea6-bdb2-fdd1a3e18a16 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:12.039136 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 813/1618] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:20:11 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:20:12.039986 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ec817-a0a0-4ea6-bdb2-fdd1a3e18a16 service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:12.061054 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744ec817-a0a0-4ea6-bdb2-fdd1a3e18a16 service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:12.079061 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538bfd2-8e61-4bee-bbfe-36db401dc70e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:12.080648 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538bfd2-8e61-4bee-bbfe-36db401dc70e admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:12.080922 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538bfd2-8e61-4bee-bbfe-36db401dc70e admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:12.082978 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2538bfd2-8e61-4bee-bbfe-36db401dc70e admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:12.083731 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2538bfd2-8e61-4bee-bbfe-36db401dc70e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:12.088619 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2538bfd2-8e61-4bee-bbfe-36db401dc70e admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:12.097610 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 806/1619] 10.222.0.15 () {58 vars in 1059 bytes} [Fri Aug 5 02:20:11 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:12.098969 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b45ddd-3a0e-4524-9450-106094bb4fdd None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:12.114669 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:12.139278 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 814/1620] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:20:12 2022] POST /identity/v3/users => generated 308 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:20:12.140723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538bfd2-8e61-4bee-bbfe-36db401dc70e admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:12.170828 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2538bfd2-8e61-4bee-bbfe-36db401dc70e admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:12.178373 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b45ddd-3a0e-4524-9450-106094bb4fdd None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:12.183454 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c79bda-688c-4f1e-ba77-6a403c37540b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:12.184359 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c79bda-688c-4f1e-ba77-6a403c37540b service cinder] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:12.184749 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c79bda-688c-4f1e-ba77-6a403c37540b service cinder] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:12.185227 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c79bda-688c-4f1e-ba77-6a403c37540b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:12.189021 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b51eb-53e9-4a6b-b24d-832aa700d95d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:12.189669 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b51eb-53e9-4a6b-b24d-832aa700d95d service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:12.189947 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b51eb-53e9-4a6b-b24d-832aa700d95d service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:12.190429 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60b51eb-53e9-4a6b-b24d-832aa700d95d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:12.272019 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c79bda-688c-4f1e-ba77-6a403c37540b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:12.273585 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c79bda-688c-4f1e-ba77-6a403c37540b service cinder] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:12.285492 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 807/1621] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:20:12 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:20:12.286365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c79bda-688c-4f1e-ba77-6a403c37540b service cinder] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:12.314281 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c79bda-688c-4f1e-ba77-6a403c37540b service cinder] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:12.322318 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d26a2-7a48-463a-8c09-08884a8d5bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:12.323027 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d26a2-7a48-463a-8c09-08884a8d5bbd admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:12.323505 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d26a2-7a48-463a-8c09-08884a8d5bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:12.323815 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c87d26a2-7a48-463a-8c09-08884a8d5bbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:12.324638 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d26a2-7a48-463a-8c09-08884a8d5bbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:12.326645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c87d26a2-7a48-463a-8c09-08884a8d5bbd admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:12.335203 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b51eb-53e9-4a6b-b24d-832aa700d95d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:12.336909 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60b51eb-53e9-4a6b-b24d-832aa700d95d service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:12.351923 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 808/1622] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:20:12.352132 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 815/1623] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:20:12 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 210 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:20:12.360785 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d26a2-7a48-463a-8c09-08884a8d5bbd admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:12.384732 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c87d26a2-7a48-463a-8c09-08884a8d5bbd admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:12.399554 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c1a1ed-f93b-4a48-9114-595872ceeb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:12.401745 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1a1ed-f93b-4a48-9114-595872ceeb65 admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:12.402040 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1a1ed-f93b-4a48-9114-595872ceeb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:12.402325 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c1a1ed-f93b-4a48-9114-595872ceeb65 admin admin] PATH_INFO: `/v3/projects/7c0aa0af46984d518e0bbf602ab5d37e/users/302fa5c6761948fab0199911eecb7976/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:12.441941 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c1a1ed-f93b-4a48-9114-595872ceeb65 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c0aa0af46984d518e0bbf602ab5d37e, user_id=302fa5c6761948fab0199911eecb7976, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:12.450424 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c1a1ed-f93b-4a48-9114-595872ceeb65 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:12.488051 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 809/1624] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:20:12 2022] PUT /identity/v3/projects/7c0aa0af46984d518e0bbf602ab5d37e/users/302fa5c6761948fab0199911eecb7976/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:20:12.492489 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b51eb-53e9-4a6b-b24d-832aa700d95d service nova] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:12.507780 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60b51eb-53e9-4a6b-b24d-832aa700d95d service nova] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:12.660093 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9510b916-6fec-47ae-af72-7a2ae43fff07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:12.662982 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510b916-6fec-47ae-af72-7a2ae43fff07 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:12.663324 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510b916-6fec-47ae-af72-7a2ae43fff07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:12.663605 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9510b916-6fec-47ae-af72-7a2ae43fff07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:12.667217 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510b916-6fec-47ae-af72-7a2ae43fff07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:12.668749 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9510b916-6fec-47ae-af72-7a2ae43fff07 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:12.697135 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 816/1625] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:20:12 2022] GET /identity/v3/roles => generated 1420 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:20:12.700577 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c1a1ed-f93b-4a48-9114-595872ceeb65 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:12.713690 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c1a1ed-f93b-4a48-9114-595872ceeb65 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:12.720018 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15bbd9d-4924-43e1-a4d1-9748a5729dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:12.720877 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15bbd9d-4924-43e1-a4d1-9748a5729dfb admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:12.721171 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15bbd9d-4924-43e1-a4d1-9748a5729dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:12.721856 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15bbd9d-4924-43e1-a4d1-9748a5729dfb admin admin] PATH_INFO: `/v3/projects/7c0aa0af46984d518e0bbf602ab5d37e/users/302fa5c6761948fab0199911eecb7976/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:12.725174 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15bbd9d-4924-43e1-a4d1-9748a5729dfb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c0aa0af46984d518e0bbf602ab5d37e, user_id=302fa5c6761948fab0199911eecb7976, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:12.728585 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15bbd9d-4924-43e1-a4d1-9748a5729dfb admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:12.755705 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 810/1626] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:20:12 2022] PUT /identity/v3/projects/7c0aa0af46984d518e0bbf602ab5d37e/users/302fa5c6761948fab0199911eecb7976/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:20:12.757172 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653fc6c-4f6c-4648-971e-4021f1c02a4f None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:12.757463 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653fc6c-4f6c-4648-971e-4021f1c02a4f None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:12.757742 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c653fc6c-4f6c-4648-971e-4021f1c02a4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:12.824473 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-c653fc6c-4f6c-4648-971e-4021f1c02a4f None None] MFA Rules not processed for user `302fa5c6761948fab0199911eecb7976`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:12.826227 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-c653fc6c-4f6c-4648-971e-4021f1c02a4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:12.914458 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:12.979002 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ec6fd-fca3-4df0-8562-dd178d9c6c3e None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:12.979550 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ec6fd-fca3-4df0-8562-dd178d9c6c3e None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:12.979841 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f2ec6fd-fca3-4df0-8562-dd178d9c6c3e None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:12.981586 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 811/1627] 10.222.0.15 () {54 vars in 912 bytes} [Fri Aug 5 02:20:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:20:12.988012 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 817/1628] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:12 2022] POST /identity/v3/auth/tokens => generated 3347 bytes in 232 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:12.993563 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682cf26-b109-45b4-91fb-e0c0ae6a63cb None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:12.993849 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682cf26-b109-45b4-91fb-e0c0ae6a63cb None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:12.994190 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a682cf26-b109-45b4-91fb-e0c0ae6a63cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:13.005204 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653fc6c-4f6c-4648-971e-4021f1c02a4f None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:13.023598 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-a682cf26-b109-45b4-91fb-e0c0ae6a63cb None None] MFA Rules not processed for user `4b5c0958604b436daa44b1f67c9dec26`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:13.025132 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-a682cf26-b109-45b4-91fb-e0c0ae6a63cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:13.138978 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c653fc6c-4f6c-4648-971e-4021f1c02a4f None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:13.139765 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 812/1629] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Aug 5 02:20:12 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:13.152174 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160f52c-ab1a-4b23-be47-7dafd2add7b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:13.152538 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160f52c-ab1a-4b23-be47-7dafd2add7b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:13.152834 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160f52c-ab1a-4b23-be47-7dafd2add7b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:13.153093 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6160f52c-ab1a-4b23-be47-7dafd2add7b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:13.174245 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6160f52c-ab1a-4b23-be47-7dafd2add7b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:13.175922 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6160f52c-ab1a-4b23-be47-7dafd2add7b3 service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:13.197702 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 818/1630] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:20:13 2022] GET /identity/v3/auth/tokens => generated 3347 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:20:13.347778 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682cf26-b109-45b4-91fb-e0c0ae6a63cb None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:13.378711 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a682cf26-b109-45b4-91fb-e0c0ae6a63cb None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:13.384390 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dfe7ffe-2fe3-4a10-9f42-98d4ddf71f83 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:13.385150 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe7ffe-2fe3-4a10-9f42-98d4ddf71f83 service cinder] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:13.385572 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe7ffe-2fe3-4a10-9f42-98d4ddf71f83 service cinder] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:13.386087 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dfe7ffe-2fe3-4a10-9f42-98d4ddf71f83 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:13.400812 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:13.404957 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe7ffe-2fe3-4a10-9f42-98d4ddf71f83 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:13.406907 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dfe7ffe-2fe3-4a10-9f42-98d4ddf71f83 service cinder] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:13.428629 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 813/1631] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:20:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:20:13.845642 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160f52c-ab1a-4b23-be47-7dafd2add7b3 service cinder] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:13.955011 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6160f52c-ab1a-4b23-be47-7dafd2add7b3 service cinder] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:13.986836 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee898b23-e239-4b8b-a9ea-ff530d06244a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:13.987721 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee898b23-e239-4b8b-a9ea-ff530d06244a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:13.988049 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee898b23-e239-4b8b-a9ea-ff530d06244a admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:13.988365 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee898b23-e239-4b8b-a9ea-ff530d06244a admin admin] PATH_INFO: `/v3/users/38fd86e9cb75485bb102132000c0f256` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:13.992611 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee898b23-e239-4b8b-a9ea-ff530d06244a admin admin] RBAC: Authorizing `identity:delete_user(user_id=38fd86e9cb75485bb102132000c0f256)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:13.998433 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: WARNING py.warnings [None req-ee898b23-e239-4b8b-a9ea-ff530d06244a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 02:20:13.998433 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: warnings.warn(msg) Aug 05 02:20:13.998433 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: Aug 05 02:20:14.003210 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee898b23-e239-4b8b-a9ea-ff530d06244a admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:14.174248 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-ee898b23-e239-4b8b-a9ea-ff530d06244a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38fd86e9cb75485bb102132000c0f256'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:14.256985 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-ee898b23-e239-4b8b-a9ea-ff530d06244a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38fd86e9cb75485bb102132000c0f256'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:14.256985 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-ee898b23-e239-4b8b-a9ea-ff530d06244a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38fd86e9cb75485bb102132000c0f256'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:14.256985 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-ee898b23-e239-4b8b-a9ea-ff530d06244a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38fd86e9cb75485bb102132000c0f256'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:14.281273 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-ee898b23-e239-4b8b-a9ea-ff530d06244a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38fd86e9cb75485bb102132000c0f256'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:14.306145 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:14.334541 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 819/1632] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:20:13 2022] DELETE /identity/v3/users/38fd86e9cb75485bb102132000c0f256 => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:20:14.338844 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6c14b-4131-450c-ab44-422cc58bcd45 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:14.339342 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6c14b-4131-450c-ab44-422cc58bcd45 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:14.339460 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1f6c14b-4131-450c-ab44-422cc58bcd45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:14.396937 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-c1f6c14b-4131-450c-ab44-422cc58bcd45 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:14.398204 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-c1f6c14b-4131-450c-ab44-422cc58bcd45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:14.595779 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 814/1633] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:14.685230 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c5d36-6aaa-44c7-afb7-65dc0b9e6af5 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:14.685607 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c5d36-6aaa-44c7-afb7-65dc0b9e6af5 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:14.685791 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-352c5d36-6aaa-44c7-afb7-65dc0b9e6af5 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:14.687507 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 820/1634] 10.222.0.15 () {54 vars in 962 bytes} [Fri Aug 5 02:20:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:20:14.694723 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96410b4-0098-4ce0-91a7-9bbb9dbd5e75 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:14.695042 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96410b4-0098-4ce0-91a7-9bbb9dbd5e75 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:14.695286 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96410b4-0098-4ce0-91a7-9bbb9dbd5e75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:14.715579 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c5d36-6aaa-44c7-afb7-65dc0b9e6af5 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:14.718589 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-352c5d36-6aaa-44c7-afb7-65dc0b9e6af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:14.765912 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-c96410b4-0098-4ce0-91a7-9bbb9dbd5e75 None None] MFA Rules not processed for user `4b5c0958604b436daa44b1f67c9dec26`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:14.767211 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-c96410b4-0098-4ce0-91a7-9bbb9dbd5e75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:14.848867 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-352c5d36-6aaa-44c7-afb7-65dc0b9e6af5 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:14.864567 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b462364d-f9ad-4238-8f9b-1a093d1d49a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:14.865521 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462364d-f9ad-4238-8f9b-1a093d1d49a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:14.865819 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462364d-f9ad-4238-8f9b-1a093d1d49a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:14.866098 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b462364d-f9ad-4238-8f9b-1a093d1d49a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:14.883451 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462364d-f9ad-4238-8f9b-1a093d1d49a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:14.891663 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b462364d-f9ad-4238-8f9b-1a093d1d49a1 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:14.912156 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 821/1635] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:20:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 197 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:20:14.950904 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 815/1636] 10.222.0.15 () {58 vars in 1059 bytes} [Fri Aug 5 02:20:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:14.960650 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a6546-3f95-461d-bc67-37fbe5459257 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:14.961242 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a6546-3f95-461d-bc67-37fbe5459257 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:14.961848 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6a6546-3f95-461d-bc67-37fbe5459257 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:14.963739 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 822/1637] 10.222.0.15 () {54 vars in 912 bytes} [Fri Aug 5 02:20:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:20:14.971425 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417e8b4-1f21-4ba3-bfdf-e395a6546062 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:14.971754 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417e8b4-1f21-4ba3-bfdf-e395a6546062 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:14.972284 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6417e8b4-1f21-4ba3-bfdf-e395a6546062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:15.027142 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-6417e8b4-1f21-4ba3-bfdf-e395a6546062 None None] MFA Rules not processed for user `4b5c0958604b436daa44b1f67c9dec26`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:15.029614 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-6417e8b4-1f21-4ba3-bfdf-e395a6546062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:15.067151 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 816/1638] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Aug 5 02:20:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:20:15.072697 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a6546-3f95-461d-bc67-37fbe5459257 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:15.074865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-fa6a6546-3f95-461d-bc67-37fbe5459257 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:15.180287 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6a6546-3f95-461d-bc67-37fbe5459257 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:15.186795 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e06c1cb-5a0c-4b1e-ac39-77fa10acf27c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:15.187237 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06c1cb-5a0c-4b1e-ac39-77fa10acf27c service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:15.187526 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06c1cb-5a0c-4b1e-ac39-77fa10acf27c service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:15.187854 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e06c1cb-5a0c-4b1e-ac39-77fa10acf27c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:15.199888 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06c1cb-5a0c-4b1e-ac39-77fa10acf27c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:15.201828 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e06c1cb-5a0c-4b1e-ac39-77fa10acf27c service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:15.216764 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 823/1639] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:20:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:20:16.879672 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417e8b4-1f21-4ba3-bfdf-e395a6546062 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:16.894287 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-6417e8b4-1f21-4ba3-bfdf-e395a6546062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:16.916138 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6417e8b4-1f21-4ba3-bfdf-e395a6546062 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:16.925893 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0f6fd-4632-4404-aebc-4460ddad3ee0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:16.926561 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0f6fd-4632-4404-aebc-4460ddad3ee0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:16.927003 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0f6fd-4632-4404-aebc-4460ddad3ee0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:16.940058 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0f6fd-4632-4404-aebc-4460ddad3ee0 admin admin] PATH_INFO: `/v3/users/729190451d35466ba0385522d165a895` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:16.941602 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c0f6fd-4632-4404-aebc-4460ddad3ee0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=729190451d35466ba0385522d165a895)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:16.946553 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c0f6fd-4632-4404-aebc-4460ddad3ee0 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:17.075097 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-46c0f6fd-4632-4404-aebc-4460ddad3ee0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '729190451d35466ba0385522d165a895'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:17.119794 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-46c0f6fd-4632-4404-aebc-4460ddad3ee0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '729190451d35466ba0385522d165a895'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:17.120823 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-46c0f6fd-4632-4404-aebc-4460ddad3ee0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '729190451d35466ba0385522d165a895'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:17.121547 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-46c0f6fd-4632-4404-aebc-4460ddad3ee0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '729190451d35466ba0385522d165a895'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:17.139269 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-46c0f6fd-4632-4404-aebc-4460ddad3ee0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '729190451d35466ba0385522d165a895'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:17.153322 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:17.165957 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 817/1640] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:20:16 2022] DELETE /identity/v3/users/729190451d35466ba0385522d165a895 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:20:17.170780 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245068ad-ff9e-4ee1-a2b0-aaa34484802b None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:17.172599 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245068ad-ff9e-4ee1-a2b0-aaa34484802b None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:17.173932 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245068ad-ff9e-4ee1-a2b0-aaa34484802b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:17.218389 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-245068ad-ff9e-4ee1-a2b0-aaa34484802b None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:17.235779 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-245068ad-ff9e-4ee1-a2b0-aaa34484802b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:17.407805 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 824/1641] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:17.536602 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0f6fd-4632-4404-aebc-4460ddad3ee0 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:17.539005 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-46c0f6fd-4632-4404-aebc-4460ddad3ee0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:17.568634 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0f6fd-4632-4404-aebc-4460ddad3ee0 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:17.583059 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2047862-4aa5-4697-8a31-578d18528000 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:17.583988 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2047862-4aa5-4697-8a31-578d18528000 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:17.584454 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2047862-4aa5-4697-8a31-578d18528000 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:17.585367 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2047862-4aa5-4697-8a31-578d18528000 admin admin] PATH_INFO: `/v3/projects/68240fa7edf743ecaa16a8dab7e77aad` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:17.590145 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2047862-4aa5-4697-8a31-578d18528000 admin admin] RBAC: Authorizing `identity:delete_project(project_id=68240fa7edf743ecaa16a8dab7e77aad)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:17.591180 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: WARNING py.warnings [None req-b2047862-4aa5-4697-8a31-578d18528000 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 05 02:20:17.591180 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: warnings.warn(msg) Aug 05 02:20:17.591180 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: Aug 05 02:20:17.608875 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2047862-4aa5-4697-8a31-578d18528000 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:17.776405 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-b2047862-4aa5-4697-8a31-578d18528000 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '68240fa7edf743ecaa16a8dab7e77aad', 'request_id': 'req-b2047862-4aa5-4697-8a31-578d18528000'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:17.797891 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-b2047862-4aa5-4697-8a31-578d18528000 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '68240fa7edf743ecaa16a8dab7e77aad', 'request_id': 'req-b2047862-4aa5-4697-8a31-578d18528000'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:17.816941 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-b2047862-4aa5-4697-8a31-578d18528000 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '68240fa7edf743ecaa16a8dab7e77aad', 'request_id': 'req-b2047862-4aa5-4697-8a31-578d18528000'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:17.867470 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-b2047862-4aa5-4697-8a31-578d18528000 admin admin] The token cache is being invalidate because project 68240fa7edf743ecaa16a8dab7e77aad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:20:17.867773 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-b2047862-4aa5-4697-8a31-578d18528000 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:17.870674 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-b2047862-4aa5-4697-8a31-578d18528000 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:17.876921 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 818/1642] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:20:17 2022] DELETE /identity/v3/projects/68240fa7edf743ecaa16a8dab7e77aad => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:20:17.881211 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245068ad-ff9e-4ee1-a2b0-aaa34484802b None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:17.898439 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245068ad-ff9e-4ee1-a2b0-aaa34484802b None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:17.980782 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2047862-4aa5-4697-8a31-578d18528000 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:17.982312 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-b2047862-4aa5-4697-8a31-578d18528000 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:18.067708 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:18.147110 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45cf29cb-bce1-4d0a-9a0b-7ca891a3abb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:18.150369 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf29cb-bce1-4d0a-9a0b-7ca891a3abb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:18.150567 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf29cb-bce1-4d0a-9a0b-7ca891a3abb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:18.151824 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45cf29cb-bce1-4d0a-9a0b-7ca891a3abb5 admin admin] PATH_INFO: `/v3/users/302fa5c6761948fab0199911eecb7976` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:18.157299 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf29cb-bce1-4d0a-9a0b-7ca891a3abb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=302fa5c6761948fab0199911eecb7976)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:18.163300 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45cf29cb-bce1-4d0a-9a0b-7ca891a3abb5 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:18.240467 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2047862-4aa5-4697-8a31-578d18528000 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:18.254384 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e623c1-0a9d-4c36-928e-1ad7173f68b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:18.255038 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e623c1-0a9d-4c36-928e-1ad7173f68b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:18.255322 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e623c1-0a9d-4c36-928e-1ad7173f68b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:18.255601 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e623c1-0a9d-4c36-928e-1ad7173f68b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:18.268432 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-08e623c1-0a9d-4c36-928e-1ad7173f68b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:18.334257 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e623c1-0a9d-4c36-928e-1ad7173f68b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:18.344657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-45cf29cb-bce1-4d0a-9a0b-7ca891a3abb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '302fa5c6761948fab0199911eecb7976'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:18.345173 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08e623c1-0a9d-4c36-928e-1ad7173f68b7 service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:18.383656 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-45cf29cb-bce1-4d0a-9a0b-7ca891a3abb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '302fa5c6761948fab0199911eecb7976'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:18.384843 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-45cf29cb-bce1-4d0a-9a0b-7ca891a3abb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '302fa5c6761948fab0199911eecb7976'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:18.385806 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-45cf29cb-bce1-4d0a-9a0b-7ca891a3abb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '302fa5c6761948fab0199911eecb7976'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:18.406482 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-45cf29cb-bce1-4d0a-9a0b-7ca891a3abb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '302fa5c6761948fab0199911eecb7976'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:18.414140 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 819/1643] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:20:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:20:18.463118 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 825/1644] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:20:17 2022] DELETE /identity/v3/users/302fa5c6761948fab0199911eecb7976 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:20:19.566864 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e623c1-0a9d-4c36-928e-1ad7173f68b7 service neutron] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:19.569428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-08e623c1-0a9d-4c36-928e-1ad7173f68b7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:19.588306 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08e623c1-0a9d-4c36-928e-1ad7173f68b7 service neutron] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:19.726403 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877cab0b-d957-4c8e-89a4-545fc6b424b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:19.728433 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877cab0b-d957-4c8e-89a4-545fc6b424b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:19.728829 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877cab0b-d957-4c8e-89a4-545fc6b424b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:19.729218 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877cab0b-d957-4c8e-89a4-545fc6b424b9 admin admin] PATH_INFO: `/v3/projects/0207e89d12a14539bead80f6312f93fc` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:19.732857 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877cab0b-d957-4c8e-89a4-545fc6b424b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0207e89d12a14539bead80f6312f93fc)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:19.735528 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877cab0b-d957-4c8e-89a4-545fc6b424b9 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:19.812613 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:19.872482 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-877cab0b-d957-4c8e-89a4-545fc6b424b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0207e89d12a14539bead80f6312f93fc', 'request_id': 'req-877cab0b-d957-4c8e-89a4-545fc6b424b9'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:19.887829 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-877cab0b-d957-4c8e-89a4-545fc6b424b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0207e89d12a14539bead80f6312f93fc', 'request_id': 'req-877cab0b-d957-4c8e-89a4-545fc6b424b9'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:19.907369 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-877cab0b-d957-4c8e-89a4-545fc6b424b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0207e89d12a14539bead80f6312f93fc', 'request_id': 'req-877cab0b-d957-4c8e-89a4-545fc6b424b9'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:19.930683 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-877cab0b-d957-4c8e-89a4-545fc6b424b9 admin admin] The token cache is being invalidate because project 0207e89d12a14539bead80f6312f93fc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:20:19.932218 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-877cab0b-d957-4c8e-89a4-545fc6b424b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:19.933991 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-877cab0b-d957-4c8e-89a4-545fc6b424b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:19.945160 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 820/1645] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:20:19 2022] DELETE /identity/v3/projects/0207e89d12a14539bead80f6312f93fc => generated 0 bytes in 375 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:20:19.946048 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096c52f-7120-424b-bcf0-f4db3cb49573 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:19.946532 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096c52f-7120-424b-bcf0-f4db3cb49573 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:19.946867 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2096c52f-7120-424b-bcf0-f4db3cb49573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:19.994710 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-2096c52f-7120-424b-bcf0-f4db3cb49573 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:19.996305 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-2096c52f-7120-424b-bcf0-f4db3cb49573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:20.184679 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 826/1646] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:20.192358 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29253f-18e1-4654-8f46-ba54960865ce None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:20.192637 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29253f-18e1-4654-8f46-ba54960865ce None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:20.192921 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd29253f-18e1-4654-8f46-ba54960865ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:20.244940 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-dd29253f-18e1-4654-8f46-ba54960865ce None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:20.247033 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-dd29253f-18e1-4654-8f46-ba54960865ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:20.268194 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2096c52f-7120-424b-bcf0-f4db3cb49573 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:20.272891 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 821/1647] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:20.278438 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2096c52f-7120-424b-bcf0-f4db3cb49573 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:20.292362 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993eee07-0a46-4c20-8c0b-c2877964b259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:20.293017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993eee07-0a46-4c20-8c0b-c2877964b259 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:20.293302 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993eee07-0a46-4c20-8c0b-c2877964b259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:20.293579 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993eee07-0a46-4c20-8c0b-c2877964b259 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:20.294313 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993eee07-0a46-4c20-8c0b-c2877964b259 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:20:20.294622 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993eee07-0a46-4c20-8c0b-c2877964b259 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:20.296941 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993eee07-0a46-4c20-8c0b-c2877964b259 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:20.331094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 827/1648] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:20:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:20:20.335661 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd29253f-18e1-4654-8f46-ba54960865ce None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:20.354942 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd29253f-18e1-4654-8f46-ba54960865ce None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:20.365286 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0200677c-da38-4c76-9780-49eb91df8c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:20.365947 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200677c-da38-4c76-9780-49eb91df8c0f admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:20.366235 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200677c-da38-4c76-9780-49eb91df8c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:20.366516 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0200677c-da38-4c76-9780-49eb91df8c0f admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:20.367206 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0200677c-da38-4c76-9780-49eb91df8c0f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:20.369208 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0200677c-da38-4c76-9780-49eb91df8c0f admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:20.450947 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993eee07-0a46-4c20-8c0b-c2877964b259 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:20.457932 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 822/1649] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:20:20 2022] POST /identity/v3/projects => generated 377 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:20:20.462077 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993eee07-0a46-4c20-8c0b-c2877964b259 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:20.554267 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:20.599928 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c276f85-c76d-4cfa-8c22-a9e00b1f43fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:20.600842 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c276f85-c76d-4cfa-8c22-a9e00b1f43fb admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:20.601938 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c276f85-c76d-4cfa-8c22-a9e00b1f43fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:20.602794 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c276f85-c76d-4cfa-8c22-a9e00b1f43fb admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:20.603651 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c276f85-c76d-4cfa-8c22-a9e00b1f43fb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:20.605673 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c276f85-c76d-4cfa-8c22-a9e00b1f43fb admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:20.674854 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 828/1650] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:20:20 2022] POST /identity/v3/users => generated 289 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:20:20.681223 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0200677c-da38-4c76-9780-49eb91df8c0f admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:20.707611 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0200677c-da38-4c76-9780-49eb91df8c0f admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:20.745473 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335db4b-0b47-48a2-92cd-2626fa9e5e06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:20.746519 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335db4b-0b47-48a2-92cd-2626fa9e5e06 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:20.747427 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335db4b-0b47-48a2-92cd-2626fa9e5e06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:20.747427 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f335db4b-0b47-48a2-92cd-2626fa9e5e06 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:20.749215 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f335db4b-0b47-48a2-92cd-2626fa9e5e06 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:20.768632 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f335db4b-0b47-48a2-92cd-2626fa9e5e06 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:20.828255 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 823/1651] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:20:20.838064 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c276f85-c76d-4cfa-8c22-a9e00b1f43fb admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:20.873805 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c276f85-c76d-4cfa-8c22-a9e00b1f43fb admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:20.893963 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562d017-d075-44e5-849b-53a83343a03c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:20.894636 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562d017-d075-44e5-849b-53a83343a03c admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:20.894926 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562d017-d075-44e5-849b-53a83343a03c admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:20.895199 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562d017-d075-44e5-849b-53a83343a03c admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:20.908150 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0562d017-d075-44e5-849b-53a83343a03c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:20.912304 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0562d017-d075-44e5-849b-53a83343a03c admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:20.956061 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335db4b-0b47-48a2-92cd-2626fa9e5e06 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:20.963339 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 829/1652] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:20:20 2022] GET /identity/v3/roles => generated 1420 bytes in 124 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:20:20.968041 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f335db4b-0b47-48a2-92cd-2626fa9e5e06 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:20.984032 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948a742-3f12-4092-baba-e762b93b66a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:20.984775 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948a742-3f12-4092-baba-e762b93b66a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:20.985062 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948a742-3f12-4092-baba-e762b93b66a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:20.985340 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948a742-3f12-4092-baba-e762b93b66a1 admin admin] PATH_INFO: `/v3/projects/185626fe59d14d43bf02a56991a068a0/users/5e4475a270994c1d9761ded90c3e2fb4/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:21.063386 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5948a742-3f12-4092-baba-e762b93b66a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=185626fe59d14d43bf02a56991a068a0, user_id=5e4475a270994c1d9761ded90c3e2fb4, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:21.067135 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5948a742-3f12-4092-baba-e762b93b66a1 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:21.108674 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 824/1653] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:20:20 2022] PUT /identity/v3/projects/185626fe59d14d43bf02a56991a068a0/users/5e4475a270994c1d9761ded90c3e2fb4/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:20:21.119622 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e4732-723c-4784-904e-d22b5e7e1add None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:21.120164 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e4732-723c-4784-904e-d22b5e7e1add None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:21.120482 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36e4732-723c-4784-904e-d22b5e7e1add None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:21.212033 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-f36e4732-723c-4784-904e-d22b5e7e1add None None] MFA Rules not processed for user `5e4475a270994c1d9761ded90c3e2fb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:21.216999 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-f36e4732-723c-4784-904e-d22b5e7e1add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:21.363151 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 830/1654] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:21 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:21.368628 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948a742-3f12-4092-baba-e762b93b66a1 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:21.482455 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e4732-723c-4784-904e-d22b5e7e1add None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:21.485861 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-f36e4732-723c-4784-904e-d22b5e7e1add None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:21.587425 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948a742-3f12-4092-baba-e762b93b66a1 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:21.607261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbeb45d-ecb0-42e1-8ea0-1671f36e2ade admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:21.607908 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbeb45d-ecb0-42e1-8ea0-1671f36e2ade admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:21.609095 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbeb45d-ecb0-42e1-8ea0-1671f36e2ade admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:21.609382 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbeb45d-ecb0-42e1-8ea0-1671f36e2ade admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:21.612962 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbeb45d-ecb0-42e1-8ea0-1671f36e2ade admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:21.615703 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbeb45d-ecb0-42e1-8ea0-1671f36e2ade admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:21.674248 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36e4732-723c-4784-904e-d22b5e7e1add None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:21.681094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de031619-2969-4a0f-90ab-43e4fcc9b427 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:21.682024 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de031619-2969-4a0f-90ab-43e4fcc9b427 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:21.682322 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de031619-2969-4a0f-90ab-43e4fcc9b427 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:21.682603 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de031619-2969-4a0f-90ab-43e4fcc9b427 admin admin] PATH_INFO: `/v3/projects/7c0aa0af46984d518e0bbf602ab5d37e` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:21.698032 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 825/1655] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:20:21 2022] POST /identity/v3/projects => generated 379 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:20:21.699189 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbeb45d-ecb0-42e1-8ea0-1671f36e2ade admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:21.700274 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de031619-2969-4a0f-90ab-43e4fcc9b427 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c0aa0af46984d518e0bbf602ab5d37e)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:21.704795 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de031619-2969-4a0f-90ab-43e4fcc9b427 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:21.797549 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:DELETE=7,keystone:SELECT=89,keystone:INSERT=4 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:21.850359 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-de031619-2969-4a0f-90ab-43e4fcc9b427 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c0aa0af46984d518e0bbf602ab5d37e', 'request_id': 'req-de031619-2969-4a0f-90ab-43e4fcc9b427'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:21.865307 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-de031619-2969-4a0f-90ab-43e4fcc9b427 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c0aa0af46984d518e0bbf602ab5d37e', 'request_id': 'req-de031619-2969-4a0f-90ab-43e4fcc9b427'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:21.872522 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=91,keystone:INSERT=3,keystone:DELETE=6 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:21.892491 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbeb45d-ecb0-42e1-8ea0-1671f36e2ade admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:21.904351 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-de031619-2969-4a0f-90ab-43e4fcc9b427 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c0aa0af46984d518e0bbf602ab5d37e', 'request_id': 'req-de031619-2969-4a0f-90ab-43e4fcc9b427'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:21.934055 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-de031619-2969-4a0f-90ab-43e4fcc9b427 admin admin] The token cache is being invalidate because project 7c0aa0af46984d518e0bbf602ab5d37e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:20:21.936016 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-de031619-2969-4a0f-90ab-43e4fcc9b427 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:21.948319 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-de031619-2969-4a0f-90ab-43e4fcc9b427 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:21.968044 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 831/1656] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:20:21 2022] DELETE /identity/v3/projects/7c0aa0af46984d518e0bbf602ab5d37e => generated 0 bytes in 481 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:20:21.973361 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951db8f-95af-4954-a7a5-da055246f58e None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:21.973717 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951db8f-95af-4954-a7a5-da055246f58e None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:21.974382 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7951db8f-95af-4954-a7a5-da055246f58e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:22.028309 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-7951db8f-95af-4954-a7a5-da055246f58e None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:22.035274 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-7951db8f-95af-4954-a7a5-da055246f58e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:22.103166 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddacec36-f8fe-44b8-bbf6-d2faddb2b53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:22.103819 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddacec36-f8fe-44b8-bbf6-d2faddb2b53f admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:22.104100 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddacec36-f8fe-44b8-bbf6-d2faddb2b53f admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:22.104396 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddacec36-f8fe-44b8-bbf6-d2faddb2b53f admin admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:22.110977 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddacec36-f8fe-44b8-bbf6-d2faddb2b53f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:22.118926 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddacec36-f8fe-44b8-bbf6-d2faddb2b53f admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:22.149367 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 832/1657] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:22.159434 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9c392-5d73-4198-83d9-c3f96b10777b None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:22.160223 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9c392-5d73-4198-83d9-c3f96b10777b None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:22.160836 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da9c392-5d73-4198-83d9-c3f96b10777b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:22.191876 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 826/1658] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:20:21 2022] POST /identity/v3/users => generated 290 bytes in 493 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:20:22.198429 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddacec36-f8fe-44b8-bbf6-d2faddb2b53f admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:22.200915 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-3da9c392-5d73-4198-83d9-c3f96b10777b None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:22.201525 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-ddacec36-f8fe-44b8-bbf6-d2faddb2b53f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:22.202947 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-3da9c392-5d73-4198-83d9-c3f96b10777b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:22.224044 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddacec36-f8fe-44b8-bbf6-d2faddb2b53f admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:22.230206 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 833/1659] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:20:22.234820 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9c392-5d73-4198-83d9-c3f96b10777b None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:22.247388 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b3747-80ca-4072-9886-886daed76b25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:22.248033 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b3747-80ca-4072-9886-886daed76b25 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:22.250653 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b3747-80ca-4072-9886-886daed76b25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:22.250955 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35b3747-80ca-4072-9886-886daed76b25 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:22.254016 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b3747-80ca-4072-9886-886daed76b25 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:22.266115 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da9c392-5d73-4198-83d9-c3f96b10777b None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:22.266649 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35b3747-80ca-4072-9886-886daed76b25 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:22.281486 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179490c-3f1e-41f3-8c03-b130e4ca259f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:22.282132 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179490c-3f1e-41f3-8c03-b130e4ca259f admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:22.282399 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179490c-3f1e-41f3-8c03-b130e4ca259f admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:22.282670 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d179490c-3f1e-41f3-8c03-b130e4ca259f admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:22.286500 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179490c-3f1e-41f3-8c03-b130e4ca259f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:20:22.286816 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179490c-3f1e-41f3-8c03-b130e4ca259f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:22.290119 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 827/1660] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:20:22.290262 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d179490c-3f1e-41f3-8c03-b130e4ca259f admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:22.291233 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b3747-80ca-4072-9886-886daed76b25 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:22.314477 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35b3747-80ca-4072-9886-886daed76b25 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:22.322358 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 834/1661] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:20:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:20:22.323289 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179490c-3f1e-41f3-8c03-b130e4ca259f admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:22.329661 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66b1cc-cfcf-447a-8951-5c34160f7f5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:22.330454 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66b1cc-cfcf-447a-8951-5c34160f7f5f admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:22.333137 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66b1cc-cfcf-447a-8951-5c34160f7f5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:22.334736 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de66b1cc-cfcf-447a-8951-5c34160f7f5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:22.335729 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66b1cc-cfcf-447a-8951-5c34160f7f5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:22.340153 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de66b1cc-cfcf-447a-8951-5c34160f7f5f admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:22.374556 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d179490c-3f1e-41f3-8c03-b130e4ca259f admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:22.384715 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 828/1662] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:20:22.392018 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66b1cc-cfcf-447a-8951-5c34160f7f5f admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:22.394190 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a58ce-e86a-4ea4-b976-01edc7a41305 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:22.394875 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a58ce-e86a-4ea4-b976-01edc7a41305 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:22.395157 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a58ce-e86a-4ea4-b976-01edc7a41305 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:22.397191 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5a58ce-e86a-4ea4-b976-01edc7a41305 admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:22.397914 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a58ce-e86a-4ea4-b976-01edc7a41305 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:22.403793 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de66b1cc-cfcf-447a-8951-5c34160f7f5f admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:22.403985 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be5a58ce-e86a-4ea4-b976-01edc7a41305 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:22.415799 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f126d0-15ae-4ade-9f6b-c8d6d36d961b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:22.419953 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f126d0-15ae-4ade-9f6b-c8d6d36d961b admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:22.419953 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f126d0-15ae-4ade-9f6b-c8d6d36d961b admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:22.420483 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f126d0-15ae-4ade-9f6b-c8d6d36d961b admin admin] PATH_INFO: `/v3/projects/8a88e2d3b7434623a20278af8f081c3a/users/24c9a5408cd7414481e49eeba5a067d9/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:22.455179 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f126d0-15ae-4ade-9f6b-c8d6d36d961b admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a88e2d3b7434623a20278af8f081c3a, user_id=24c9a5408cd7414481e49eeba5a067d9, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:22.459646 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f126d0-15ae-4ade-9f6b-c8d6d36d961b admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:22.481391 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 835/1663] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:20:22 2022] POST /identity/v3/projects => generated 361 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:20:22.488951 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a58ce-e86a-4ea4-b976-01edc7a41305 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:22.516923 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 829/1664] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:20:22 2022] PUT /identity/v3/projects/8a88e2d3b7434623a20278af8f081c3a/users/24c9a5408cd7414481e49eeba5a067d9/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:20:22.517496 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07336e53-0206-439e-9c75-2537e1d3c4f2 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:22.517919 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07336e53-0206-439e-9c75-2537e1d3c4f2 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:22.518310 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07336e53-0206-439e-9c75-2537e1d3c4f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:22.579203 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-07336e53-0206-439e-9c75-2537e1d3c4f2 None None] MFA Rules not processed for user `24c9a5408cd7414481e49eeba5a067d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:22.581328 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-07336e53-0206-439e-9c75-2537e1d3c4f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:22.608608 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be5a58ce-e86a-4ea4-b976-01edc7a41305 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:22.740462 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 830/1665] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:22.751897 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07336e53-0206-439e-9c75-2537e1d3c4f2 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:22.768429 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:22.780541 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:22.791231 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc0308-0c5b-470d-aec2-a5544b436e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:22.791887 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc0308-0c5b-470d-aec2-a5544b436e3d admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:22.792169 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc0308-0c5b-470d-aec2-a5544b436e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:22.792480 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc0308-0c5b-470d-aec2-a5544b436e3d admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:22.801176 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc0308-0c5b-470d-aec2-a5544b436e3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:22.808908 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc0308-0c5b-470d-aec2-a5544b436e3d admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:22.858888 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 836/1666] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:20:22 2022] POST /identity/v3/users => generated 281 bytes in 374 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:20:22.865118 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc0308-0c5b-470d-aec2-a5544b436e3d admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:22.888203 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc0308-0c5b-470d-aec2-a5544b436e3d admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:22.898337 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700fd8a-f027-4415-b501-49afcb8974bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:22.898998 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700fd8a-f027-4415-b501-49afcb8974bc admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:22.899280 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700fd8a-f027-4415-b501-49afcb8974bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:22.899551 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6700fd8a-f027-4415-b501-49afcb8974bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:22.900265 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6700fd8a-f027-4415-b501-49afcb8974bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:22.901887 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6700fd8a-f027-4415-b501-49afcb8974bc admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:22.902402 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07336e53-0206-439e-9c75-2537e1d3c4f2 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:22.910282 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0c1f8-14de-48da-a0d9-d6053730430a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:22.912636 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0c1f8-14de-48da-a0d9-d6053730430a admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:22.912873 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0c1f8-14de-48da-a0d9-d6053730430a admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:22.913310 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad0c1f8-14de-48da-a0d9-d6053730430a admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:22.914711 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad0c1f8-14de-48da-a0d9-d6053730430a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:22.916678 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ad0c1f8-14de-48da-a0d9-d6053730430a admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:22.922777 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 837/1667] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:20:22.927002 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700fd8a-f027-4415-b501-49afcb8974bc admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:22.954138 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6700fd8a-f027-4415-b501-49afcb8974bc admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:22.974702 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 831/1668] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:20:22 2022] POST /identity/v3/projects => generated 377 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:20:22.981158 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0c1f8-14de-48da-a0d9-d6053730430a admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:22.988518 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1d85a-28e7-434f-8575-40fcb64b478e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:22.989168 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1d85a-28e7-434f-8575-40fcb64b478e admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:22.989457 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1d85a-28e7-434f-8575-40fcb64b478e admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:22.989738 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f1d85a-28e7-434f-8575-40fcb64b478e admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:22.990445 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f1d85a-28e7-434f-8575-40fcb64b478e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:22.992685 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f1d85a-28e7-434f-8575-40fcb64b478e admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:23.016720 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 838/1669] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:20:22 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:20:23.018374 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1d85a-28e7-434f-8575-40fcb64b478e admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:23.040780 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f1d85a-28e7-434f-8575-40fcb64b478e admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:23.100883 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ad0c1f8-14de-48da-a0d9-d6053730430a admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:23.113419 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2549d-815d-452b-abc0-30acdc886f87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:23.115259 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2549d-815d-452b-abc0-30acdc886f87 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:23.115790 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2549d-815d-452b-abc0-30acdc886f87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:23.117937 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a2549d-815d-452b-abc0-30acdc886f87 admin admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:23.119955 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a2549d-815d-452b-abc0-30acdc886f87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:23.124414 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a2549d-815d-452b-abc0-30acdc886f87 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:23.196699 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a840348c-bd2c-4c5f-949d-709e45e346e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:23.197000 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 832/1670] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:20:22 2022] POST /identity/v3/users => generated 295 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:20:23.198430 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840348c-bd2c-4c5f-949d-709e45e346e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:23.199461 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2549d-815d-452b-abc0-30acdc886f87 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:23.202921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840348c-bd2c-4c5f-949d-709e45e346e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:23.203410 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a840348c-bd2c-4c5f-949d-709e45e346e7 admin admin] PATH_INFO: `/v3/projects/049941021f754165858826843e37f2ad/users/11fa5f2ad7d240e7bd73f6e26fcb6b8a/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:23.234238 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a2549d-815d-452b-abc0-30acdc886f87 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:23.246506 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e0697-d243-42de-9b01-ecc39927ab87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:23.247003 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e0697-d243-42de-9b01-ecc39927ab87 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:23.247827 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e0697-d243-42de-9b01-ecc39927ab87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:23.247827 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de2e0697-d243-42de-9b01-ecc39927ab87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:23.248019 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840348c-bd2c-4c5f-949d-709e45e346e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=049941021f754165858826843e37f2ad, user_id=11fa5f2ad7d240e7bd73f6e26fcb6b8a, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:23.248484 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e0697-d243-42de-9b01-ecc39927ab87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:23.250508 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de2e0697-d243-42de-9b01-ecc39927ab87 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:23.252511 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a840348c-bd2c-4c5f-949d-709e45e346e7 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:23.275229 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 839/1671] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:20:23 2022] PUT /identity/v3/projects/049941021f754165858826843e37f2ad/users/11fa5f2ad7d240e7bd73f6e26fcb6b8a/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:20:23.285857 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 833/1672] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:20:23.287953 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b8b3f-7eef-40bb-a446-153488bb54e0 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:23.288749 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b8b3f-7eef-40bb-a446-153488bb54e0 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:23.289516 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-788b8b3f-7eef-40bb-a446-153488bb54e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:23.289689 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e0697-d243-42de-9b01-ecc39927ab87 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:23.305672 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de2e0697-d243-42de-9b01-ecc39927ab87 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:23.366222 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-788b8b3f-7eef-40bb-a446-153488bb54e0 None None] MFA Rules not processed for user `11fa5f2ad7d240e7bd73f6e26fcb6b8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:23.367633 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-788b8b3f-7eef-40bb-a446-153488bb54e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:23.409396 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ae5e7-2698-4018-bc6b-098d8827975f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:23.410103 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ae5e7-2698-4018-bc6b-098d8827975f admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:23.410390 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ae5e7-2698-4018-bc6b-098d8827975f admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:23.410666 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3ae5e7-2698-4018-bc6b-098d8827975f admin admin] PATH_INFO: `/v3/projects/6d16c0b8a3d84ca09cf27c0d0f6ec13e/users/62abd0e3286c48a4b32a65e2cbd49950/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:23.429511 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ae5e7-2698-4018-bc6b-098d8827975f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d16c0b8a3d84ca09cf27c0d0f6ec13e, user_id=62abd0e3286c48a4b32a65e2cbd49950, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:23.432562 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f3ae5e7-2698-4018-bc6b-098d8827975f admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:23.455273 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:23.463385 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 834/1673] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:20:23 2022] PUT /identity/v3/projects/6d16c0b8a3d84ca09cf27c0d0f6ec13e/users/62abd0e3286c48a4b32a65e2cbd49950/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:20:23.469963 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ae5e7-2698-4018-bc6b-098d8827975f admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:23.516631 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 840/1674] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 230 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:23.521158 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b8b3f-7eef-40bb-a446-153488bb54e0 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:23.541845 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-788b8b3f-7eef-40bb-a446-153488bb54e0 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:23.595360 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f3ae5e7-2698-4018-bc6b-098d8827975f admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:23.605285 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae38e3-ff57-4b91-bcc0-df05b1b1598c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:23.605908 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae38e3-ff57-4b91-bcc0-df05b1b1598c admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:23.606119 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:23.606224 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae38e3-ff57-4b91-bcc0-df05b1b1598c admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:23.606453 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ae38e3-ff57-4b91-bcc0-df05b1b1598c admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:23.607276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ae38e3-ff57-4b91-bcc0-df05b1b1598c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:23.609261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ae38e3-ff57-4b91-bcc0-df05b1b1598c admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:23.638032 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 835/1675] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:20:23.657241 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae38e3-ff57-4b91-bcc0-df05b1b1598c admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:23.673469 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d586e4-492d-4dc7-9e1b-5f9e77cf2e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:23.674216 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d586e4-492d-4dc7-9e1b-5f9e77cf2e5f admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:23.674672 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d586e4-492d-4dc7-9e1b-5f9e77cf2e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:23.675056 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d586e4-492d-4dc7-9e1b-5f9e77cf2e5f admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:23.675910 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d586e4-492d-4dc7-9e1b-5f9e77cf2e5f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:23.676549 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ae38e3-ff57-4b91-bcc0-df05b1b1598c admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:23.678023 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d586e4-492d-4dc7-9e1b-5f9e77cf2e5f admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:23.701593 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40795d0-2748-47e2-a85a-39a240d4a520 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:23.702440 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40795d0-2748-47e2-a85a-39a240d4a520 admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:23.702637 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40795d0-2748-47e2-a85a-39a240d4a520 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:23.702906 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40795d0-2748-47e2-a85a-39a240d4a520 admin admin] PATH_INFO: `/v3/projects/6d16c0b8a3d84ca09cf27c0d0f6ec13e/users/62abd0e3286c48a4b32a65e2cbd49950/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:23.706502 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40795d0-2748-47e2-a85a-39a240d4a520 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d16c0b8a3d84ca09cf27c0d0f6ec13e, user_id=62abd0e3286c48a4b32a65e2cbd49950, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:23.719818 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40795d0-2748-47e2-a85a-39a240d4a520 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:23.743117 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 841/1676] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:20:23 2022] POST /identity/v3/projects => generated 369 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:20:23.748067 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d586e4-492d-4dc7-9e1b-5f9e77cf2e5f admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:23.766268 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 836/1677] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:20:23 2022] PUT /identity/v3/projects/6d16c0b8a3d84ca09cf27c0d0f6ec13e/users/62abd0e3286c48a4b32a65e2cbd49950/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:20:23.767716 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b45f3-e027-4ce2-a1d7-ff8d666e8baf None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:23.768119 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b45f3-e027-4ce2-a1d7-ff8d666e8baf None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:23.768449 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989b45f3-e027-4ce2-a1d7-ff8d666e8baf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:23.809972 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-989b45f3-e027-4ce2-a1d7-ff8d666e8baf None None] MFA Rules not processed for user `62abd0e3286c48a4b32a65e2cbd49950`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:23.811539 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-989b45f3-e027-4ce2-a1d7-ff8d666e8baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:23.878943 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d586e4-492d-4dc7-9e1b-5f9e77cf2e5f admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:23.898121 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95ac25-c343-45bf-ab1e-ba7f318a9170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:23.898121 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95ac25-c343-45bf-ab1e-ba7f318a9170 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:23.898121 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95ac25-c343-45bf-ab1e-ba7f318a9170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:23.898121 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95ac25-c343-45bf-ab1e-ba7f318a9170 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:23.898547 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de95ac25-c343-45bf-ab1e-ba7f318a9170 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:23.899851 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de95ac25-c343-45bf-ab1e-ba7f318a9170 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:23.927276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 837/1678] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:23 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:23.928646 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b45f3-e027-4ce2-a1d7-ff8d666e8baf None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:23.930191 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-989b45f3-e027-4ce2-a1d7-ff8d666e8baf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:23.949116 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 842/1679] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:20:23 2022] POST /identity/v3/users => generated 291 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:20:23.950370 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95ac25-c343-45bf-ab1e-ba7f318a9170 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:23.963881 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95ac25-c343-45bf-ab1e-ba7f318a9170 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:23.970616 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae1ccc-e160-4945-a05f-60b96fa72d04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:23.971177 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae1ccc-e160-4945-a05f-60b96fa72d04 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:23.971461 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae1ccc-e160-4945-a05f-60b96fa72d04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:23.971739 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae1ccc-e160-4945-a05f-60b96fa72d04 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:23.972750 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae1ccc-e160-4945-a05f-60b96fa72d04 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:23.974701 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae1ccc-e160-4945-a05f-60b96fa72d04 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:23.996674 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 843/1680] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:20:23 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:20:23.998028 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae1ccc-e160-4945-a05f-60b96fa72d04 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:24.016714 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae1ccc-e160-4945-a05f-60b96fa72d04 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:24.025185 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e084360-cde1-46b2-8d16-de04e126867e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:24.025911 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e084360-cde1-46b2-8d16-de04e126867e admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:24.026703 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e084360-cde1-46b2-8d16-de04e126867e admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:24.026991 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e084360-cde1-46b2-8d16-de04e126867e admin admin] PATH_INFO: `/v3/projects/6c7ae2cc442e414ab41a3545f2b26dda/users/b631ab5ecf4a4e388957cfad56f9689f/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:24.052151 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e084360-cde1-46b2-8d16-de04e126867e admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c7ae2cc442e414ab41a3545f2b26dda, user_id=b631ab5ecf4a4e388957cfad56f9689f, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:24.055306 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e084360-cde1-46b2-8d16-de04e126867e admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:24.083195 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 844/1681] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:20:23 2022] PUT /identity/v3/projects/6c7ae2cc442e414ab41a3545f2b26dda/users/b631ab5ecf4a4e388957cfad56f9689f/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:20:24.086081 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e084360-cde1-46b2-8d16-de04e126867e admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:24.093910 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989b45f3-e027-4ce2-a1d7-ff8d666e8baf None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:24.135979 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:24.184929 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e084360-cde1-46b2-8d16-de04e126867e admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:24.191976 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350a742-79fc-41d2-8f85-fc14ee686ff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:24.192658 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350a742-79fc-41d2-8f85-fc14ee686ff5 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:24.192947 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350a742-79fc-41d2-8f85-fc14ee686ff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:24.193227 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7350a742-79fc-41d2-8f85-fc14ee686ff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:24.193941 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7350a742-79fc-41d2-8f85-fc14ee686ff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:24.195983 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7350a742-79fc-41d2-8f85-fc14ee686ff5 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:24.210049 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 845/1682] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:20:24 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:20:24.215452 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350a742-79fc-41d2-8f85-fc14ee686ff5 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:24.218120 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b30d49-9310-4046-8131-86634414e27b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:24.218978 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b30d49-9310-4046-8131-86634414e27b service cinder] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:24.219414 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b30d49-9310-4046-8131-86634414e27b service cinder] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:24.219991 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b30d49-9310-4046-8131-86634414e27b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:24.242501 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7350a742-79fc-41d2-8f85-fc14ee686ff5 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:24.251912 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba208ecd-34cf-4b13-9428-2aa60fff0fa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:24.252649 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba208ecd-34cf-4b13-9428-2aa60fff0fa6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:24.252937 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba208ecd-34cf-4b13-9428-2aa60fff0fa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:24.253221 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba208ecd-34cf-4b13-9428-2aa60fff0fa6 admin admin] PATH_INFO: `/v3/projects/6c7ae2cc442e414ab41a3545f2b26dda/users/b631ab5ecf4a4e388957cfad56f9689f/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:24.255966 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba208ecd-34cf-4b13-9428-2aa60fff0fa6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6c7ae2cc442e414ab41a3545f2b26dda, user_id=b631ab5ecf4a4e388957cfad56f9689f, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:24.260688 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba208ecd-34cf-4b13-9428-2aa60fff0fa6 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:24.266519 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:24.289195 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 846/1683] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:20:24 2022] PUT /identity/v3/projects/6c7ae2cc442e414ab41a3545f2b26dda/users/b631ab5ecf4a4e388957cfad56f9689f/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:20:24.291490 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b034422-f785-4e1b-a055-03e36b558009 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:24.291792 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b034422-f785-4e1b-a055-03e36b558009 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:24.292080 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b034422-f785-4e1b-a055-03e36b558009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:24.341584 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-1b034422-f785-4e1b-a055-03e36b558009 None None] MFA Rules not processed for user `b631ab5ecf4a4e388957cfad56f9689f`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:24.343657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-1b034422-f785-4e1b-a055-03e36b558009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:24.358873 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b30d49-9310-4046-8131-86634414e27b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:24.360629 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b30d49-9310-4046-8131-86634414e27b service cinder] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:24.388559 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 838/1684] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:20:23 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:20:24.488105 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b30d49-9310-4046-8131-86634414e27b service cinder] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:24.489730 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-64b30d49-9310-4046-8131-86634414e27b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:24.517375 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b30d49-9310-4046-8131-86634414e27b service cinder] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:24.540052 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 847/1685] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:24 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 251 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:24.558048 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b034422-f785-4e1b-a055-03e36b558009 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:24.657670 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b034422-f785-4e1b-a055-03e36b558009 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:24.663084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1a6a43-49ea-4e27-b051-b2c56b7c63c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:24.663731 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a6a43-49ea-4e27-b051-b2c56b7c63c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:24.664016 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a6a43-49ea-4e27-b051-b2c56b7c63c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:24.665366 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1a6a43-49ea-4e27-b051-b2c56b7c63c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:24.681102 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a6a43-49ea-4e27-b051-b2c56b7c63c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:24.682679 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55109f8d-ec82-4c7f-b24d-bbdf0d8db4a7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:24.682823 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1a6a43-49ea-4e27-b051-b2c56b7c63c3 service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:24.683318 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55109f8d-ec82-4c7f-b24d-bbdf0d8db4a7 service cinder] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:24.683599 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55109f8d-ec82-4c7f-b24d-bbdf0d8db4a7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:24.683874 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55109f8d-ec82-4c7f-b24d-bbdf0d8db4a7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:24.687745 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-55109f8d-ec82-4c7f-b24d-bbdf0d8db4a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:24.712954 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 848/1686] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:20:24 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 155 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:20:24.826379 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55109f8d-ec82-4c7f-b24d-bbdf0d8db4a7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:24.832376 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55109f8d-ec82-4c7f-b24d-bbdf0d8db4a7 service cinder] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:24.862513 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 839/1687] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:20:24 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:20:25.263269 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399a386-1662-493f-992c-2871a3d8bf51 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:25.263817 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399a386-1662-493f-992c-2871a3d8bf51 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:25.265696 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d399a386-1662-493f-992c-2871a3d8bf51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:25.374616 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-d399a386-1662-493f-992c-2871a3d8bf51 None None] MFA Rules not processed for user `600f51be8202427fb3691db566ed2ff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:25.377779 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-d399a386-1662-493f-992c-2871a3d8bf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:25.594293 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 849/1688] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 332 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:20:25.613653 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55109f8d-ec82-4c7f-b24d-bbdf0d8db4a7 service cinder] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:25.615303 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-55109f8d-ec82-4c7f-b24d-bbdf0d8db4a7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:25.711744 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:25.808285 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55109f8d-ec82-4c7f-b24d-bbdf0d8db4a7 service cinder] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:25.816937 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95be8cd0-cf38-4660-b93d-6b1fa3dc71b1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:25.817724 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be8cd0-cf38-4660-b93d-6b1fa3dc71b1 service nova] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:25.818099 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be8cd0-cf38-4660-b93d-6b1fa3dc71b1 service nova] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:25.818450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95be8cd0-cf38-4660-b93d-6b1fa3dc71b1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:25.839227 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95be8cd0-cf38-4660-b93d-6b1fa3dc71b1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:25.845322 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95be8cd0-cf38-4660-b93d-6b1fa3dc71b1 service nova] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:25.877673 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 840/1689] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:20:25 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:20:26.410919 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399a386-1662-493f-992c-2871a3d8bf51 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:26.412942 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-d399a386-1662-493f-992c-2871a3d8bf51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:26.461793 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:26.622340 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d399a386-1662-493f-992c-2871a3d8bf51 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:26.632311 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25006e-0d40-4be3-b3cd-e2dc00107925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:26.637691 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25006e-0d40-4be3-b3cd-e2dc00107925 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:26.644069 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25006e-0d40-4be3-b3cd-e2dc00107925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:26.646849 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e25006e-0d40-4be3-b3cd-e2dc00107925 admin admin] PATH_INFO: `/v3/users/f47b1fc3c5484d68a7dfb5cf0dd5809c` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:26.648288 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25006e-0d40-4be3-b3cd-e2dc00107925 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f47b1fc3c5484d68a7dfb5cf0dd5809c)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:26.653548 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e25006e-0d40-4be3-b3cd-e2dc00107925 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:26.888270 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1e25006e-0d40-4be3-b3cd-e2dc00107925 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f47b1fc3c5484d68a7dfb5cf0dd5809c'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:26.950933 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1e25006e-0d40-4be3-b3cd-e2dc00107925 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f47b1fc3c5484d68a7dfb5cf0dd5809c'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:26.952677 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1e25006e-0d40-4be3-b3cd-e2dc00107925 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f47b1fc3c5484d68a7dfb5cf0dd5809c'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:26.954710 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1e25006e-0d40-4be3-b3cd-e2dc00107925 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f47b1fc3c5484d68a7dfb5cf0dd5809c'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:26.985452 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1e25006e-0d40-4be3-b3cd-e2dc00107925 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f47b1fc3c5484d68a7dfb5cf0dd5809c'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:27.016524 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 850/1690] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:20:26 2022] DELETE /identity/v3/users/f47b1fc3c5484d68a7dfb5cf0dd5809c => generated 0 bytes in 606 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:20:27.021063 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d6ce2-4f72-4d00-8b60-a1311cfa3146 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:27.022022 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d6ce2-4f72-4d00-8b60-a1311cfa3146 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:27.022581 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51d6ce2-4f72-4d00-8b60-a1311cfa3146 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:27.070594 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-e51d6ce2-4f72-4d00-8b60-a1311cfa3146 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:27.072269 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-e51d6ce2-4f72-4d00-8b60-a1311cfa3146 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:27.288378 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 841/1691] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:27.358726 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25006e-0d40-4be3-b3cd-e2dc00107925 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:27.360735 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-1e25006e-0d40-4be3-b3cd-e2dc00107925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:27.567780 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e25006e-0d40-4be3-b3cd-e2dc00107925 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:27.593646 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b3c8e-0410-48aa-8afe-f350e2432805 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:27.597597 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b3c8e-0410-48aa-8afe-f350e2432805 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:27.597887 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b3c8e-0410-48aa-8afe-f350e2432805 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:27.598215 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570b3c8e-0410-48aa-8afe-f350e2432805 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:27.629953 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570b3c8e-0410-48aa-8afe-f350e2432805 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:27.633492 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570b3c8e-0410-48aa-8afe-f350e2432805 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:27.666236 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 851/1692] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:20:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:20:28.008554 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01712475-3b7e-4110-b497-e8aeac270f5d None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:28.008892 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01712475-3b7e-4110-b497-e8aeac270f5d None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:28.009163 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01712475-3b7e-4110-b497-e8aeac270f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:28.122457 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-01712475-3b7e-4110-b497-e8aeac270f5d None None] MFA Rules not processed for user `64280d0c3da14f329b6fc21228d92288`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:28.128976 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-01712475-3b7e-4110-b497-e8aeac270f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:28.262801 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b3c8e-0410-48aa-8afe-f350e2432805 service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:28.265853 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-570b3c8e-0410-48aa-8afe-f350e2432805 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:28.292547 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570b3c8e-0410-48aa-8afe-f350e2432805 service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:28.307162 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2ae9bf8-69be-46ab-b0e7-f79bc8663e2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:28.307834 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae9bf8-69be-46ab-b0e7-f79bc8663e2b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:28.310744 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae9bf8-69be-46ab-b0e7-f79bc8663e2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:28.311947 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2ae9bf8-69be-46ab-b0e7-f79bc8663e2b admin admin] PATH_INFO: `/v3/users/11fa5f2ad7d240e7bd73f6e26fcb6b8a` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:28.314466 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae9bf8-69be-46ab-b0e7-f79bc8663e2b admin admin] RBAC: Authorizing `identity:delete_user(user_id=11fa5f2ad7d240e7bd73f6e26fcb6b8a)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:28.316339 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 842/1693] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 309 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:28.318969 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2ae9bf8-69be-46ab-b0e7-f79bc8663e2b admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:28.333128 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01712475-3b7e-4110-b497-e8aeac270f5d None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:28.335051 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-01712475-3b7e-4110-b497-e8aeac270f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:28.437940 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:28.439576 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:28.466153 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-b2ae9bf8-69be-46ab-b0e7-f79bc8663e2b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '11fa5f2ad7d240e7bd73f6e26fcb6b8a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:28.502460 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-b2ae9bf8-69be-46ab-b0e7-f79bc8663e2b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '11fa5f2ad7d240e7bd73f6e26fcb6b8a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:28.508270 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-b2ae9bf8-69be-46ab-b0e7-f79bc8663e2b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '11fa5f2ad7d240e7bd73f6e26fcb6b8a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:28.509175 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-b2ae9bf8-69be-46ab-b0e7-f79bc8663e2b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '11fa5f2ad7d240e7bd73f6e26fcb6b8a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:28.509665 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01712475-3b7e-4110-b497-e8aeac270f5d None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:28.523542 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e0939a-5079-4880-8efb-5ac024c72dbd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:28.524462 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0939a-5079-4880-8efb-5ac024c72dbd service nova] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:28.526249 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0939a-5079-4880-8efb-5ac024c72dbd service nova] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:28.526595 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-b2ae9bf8-69be-46ab-b0e7-f79bc8663e2b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '11fa5f2ad7d240e7bd73f6e26fcb6b8a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:28.526709 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e0939a-5079-4880-8efb-5ac024c72dbd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:28.533167 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-e5e0939a-5079-4880-8efb-5ac024c72dbd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:28.559090 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 852/1694] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:20:28 2022] DELETE /identity/v3/users/11fa5f2ad7d240e7bd73f6e26fcb6b8a => generated 0 bytes in 297 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:20:28.564910 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e0939a-5079-4880-8efb-5ac024c72dbd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:28.565405 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26503acf-2ca7-4ea4-bff5-0e4c86c094d2 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:28.565902 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26503acf-2ca7-4ea4-bff5-0e4c86c094d2 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:28.566524 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26503acf-2ca7-4ea4-bff5-0e4c86c094d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:28.567977 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e0939a-5079-4880-8efb-5ac024c72dbd service nova] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:28.595351 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 843/1695] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:20:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:20:28.686449 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-26503acf-2ca7-4ea4-bff5-0e4c86c094d2 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:28.689058 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-26503acf-2ca7-4ea4-bff5-0e4c86c094d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:28.888411 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 853/1696] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:20:28.924823 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e0939a-5079-4880-8efb-5ac024c72dbd service nova] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:28.926411 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-e5e0939a-5079-4880-8efb-5ac024c72dbd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:28.960081 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e0939a-5079-4880-8efb-5ac024c72dbd service nova] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:29.105764 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26503acf-2ca7-4ea4-bff5-0e4c86c094d2 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:29.107948 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-26503acf-2ca7-4ea4-bff5-0e4c86c094d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:29.132674 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26503acf-2ca7-4ea4-bff5-0e4c86c094d2 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:29.134472 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa5aab7-439a-4903-89d9-659782a6f4b2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:29.134982 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5aab7-439a-4903-89d9-659782a6f4b2 service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:29.135636 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5aab7-439a-4903-89d9-659782a6f4b2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:29.136631 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa5aab7-439a-4903-89d9-659782a6f4b2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:29.159105 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39456fed-67f0-41a6-acdf-1fb56163bc53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:29.159806 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39456fed-67f0-41a6-acdf-1fb56163bc53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:29.161691 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39456fed-67f0-41a6-acdf-1fb56163bc53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:29.161976 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39456fed-67f0-41a6-acdf-1fb56163bc53 admin admin] PATH_INFO: `/v3/users/5e4475a270994c1d9761ded90c3e2fb4` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:29.164746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39456fed-67f0-41a6-acdf-1fb56163bc53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e4475a270994c1d9761ded90c3e2fb4)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:29.167523 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39456fed-67f0-41a6-acdf-1fb56163bc53 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:29.189618 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa5aab7-439a-4903-89d9-659782a6f4b2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:29.190897 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa5aab7-439a-4903-89d9-659782a6f4b2 service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:29.216760 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 844/1697] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:20:28 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:20:29.291062 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-39456fed-67f0-41a6-acdf-1fb56163bc53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e4475a270994c1d9761ded90c3e2fb4'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:29.316276 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-39456fed-67f0-41a6-acdf-1fb56163bc53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e4475a270994c1d9761ded90c3e2fb4'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:29.317442 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-39456fed-67f0-41a6-acdf-1fb56163bc53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e4475a270994c1d9761ded90c3e2fb4'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:29.318872 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-39456fed-67f0-41a6-acdf-1fb56163bc53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e4475a270994c1d9761ded90c3e2fb4'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:29.333941 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-39456fed-67f0-41a6-acdf-1fb56163bc53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e4475a270994c1d9761ded90c3e2fb4'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:29.353184 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 854/1698] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:20:29 2022] DELETE /identity/v3/users/5e4475a270994c1d9761ded90c3e2fb4 => generated 0 bytes in 248 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:20:29.357318 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5317b45-9dd9-4585-b963-ea231920e752 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:29.358175 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5317b45-9dd9-4585-b963-ea231920e752 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:29.358468 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5317b45-9dd9-4585-b963-ea231920e752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:29.397385 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-e5317b45-9dd9-4585-b963-ea231920e752 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:29.398824 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-e5317b45-9dd9-4585-b963-ea231920e752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:29.494026 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 845/1699] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:29.538631 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39456fed-67f0-41a6-acdf-1fb56163bc53 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:29.540088 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-39456fed-67f0-41a6-acdf-1fb56163bc53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:29.571361 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:29.626330 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39456fed-67f0-41a6-acdf-1fb56163bc53 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:29.638361 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceac2f81-2304-419b-a5e8-1a528d14dee5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:29.638982 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac2f81-2304-419b-a5e8-1a528d14dee5 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:29.639342 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac2f81-2304-419b-a5e8-1a528d14dee5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:29.639624 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceac2f81-2304-419b-a5e8-1a528d14dee5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:29.665324 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac2f81-2304-419b-a5e8-1a528d14dee5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:29.667603 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceac2f81-2304-419b-a5e8-1a528d14dee5 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:29.686225 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 855/1700] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:20:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:20:30.310051 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5317b45-9dd9-4585-b963-ea231920e752 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:30.311834 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-e5317b45-9dd9-4585-b963-ea231920e752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:30.337837 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5317b45-9dd9-4585-b963-ea231920e752 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:30.421438 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e578012-556e-4c28-b27f-f08574835c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:30.422222 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e578012-556e-4c28-b27f-f08574835c34 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:30.425139 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e578012-556e-4c28-b27f-f08574835c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:30.425454 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e578012-556e-4c28-b27f-f08574835c34 admin admin] PATH_INFO: `/v3/projects/dd1e9101937649e6bbe9874dec3087a5` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:30.431584 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e578012-556e-4c28-b27f-f08574835c34 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dd1e9101937649e6bbe9874dec3087a5)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:30.440778 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e578012-556e-4c28-b27f-f08574835c34 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:30.553943 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-9e578012-556e-4c28-b27f-f08574835c34 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dd1e9101937649e6bbe9874dec3087a5', 'request_id': 'req-9e578012-556e-4c28-b27f-f08574835c34'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:30.568227 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-9e578012-556e-4c28-b27f-f08574835c34 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dd1e9101937649e6bbe9874dec3087a5', 'request_id': 'req-9e578012-556e-4c28-b27f-f08574835c34'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:30.586612 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-9e578012-556e-4c28-b27f-f08574835c34 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dd1e9101937649e6bbe9874dec3087a5', 'request_id': 'req-9e578012-556e-4c28-b27f-f08574835c34'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:30.589935 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:30.616630 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-9e578012-556e-4c28-b27f-f08574835c34 admin admin] The token cache is being invalidate because project dd1e9101937649e6bbe9874dec3087a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:20:30.617847 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-9e578012-556e-4c28-b27f-f08574835c34 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:30.621591 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-9e578012-556e-4c28-b27f-f08574835c34 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:30.630718 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 846/1701] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:20:30 2022] DELETE /identity/v3/projects/dd1e9101937649e6bbe9874dec3087a5 => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:20:30.631508 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44630499-0764-45c9-8238-f2ff0a5a0bcb None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:30.631989 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44630499-0764-45c9-8238-f2ff0a5a0bcb None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:30.632061 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44630499-0764-45c9-8238-f2ff0a5a0bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:30.681618 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-44630499-0764-45c9-8238-f2ff0a5a0bcb None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:30.683026 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-44630499-0764-45c9-8238-f2ff0a5a0bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:30.824154 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 856/1702] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:20:30.830182 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88936464-bddc-48dc-ad6c-a24af7bdd532 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:30.830835 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88936464-bddc-48dc-ad6c-a24af7bdd532 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:30.831356 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88936464-bddc-48dc-ad6c-a24af7bdd532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:30.870920 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f38a86-9bc6-4511-89bb-e27c90332a44 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:30.872856 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f38a86-9bc6-4511-89bb-e27c90332a44 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:30.873358 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f38a86-9bc6-4511-89bb-e27c90332a44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:30.898313 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-88936464-bddc-48dc-ad6c-a24af7bdd532 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:30.902330 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-88936464-bddc-48dc-ad6c-a24af7bdd532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:30.932411 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 847/1703] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:30.935457 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88936464-bddc-48dc-ad6c-a24af7bdd532 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:30.971189 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88936464-bddc-48dc-ad6c-a24af7bdd532 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:30.975652 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-05f38a86-9bc6-4511-89bb-e27c90332a44 None None] MFA Rules not processed for user `5bf84408a3984972a5bb68a3117c0501`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:30.978767 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-05f38a86-9bc6-4511-89bb-e27c90332a44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:30.987575 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce6473-a708-40ce-9161-c4c34cde285e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:30.990791 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce6473-a708-40ce-9161-c4c34cde285e admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:30.992015 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce6473-a708-40ce-9161-c4c34cde285e admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:30.992423 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ce6473-a708-40ce-9161-c4c34cde285e admin admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:30.996485 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ce6473-a708-40ce-9161-c4c34cde285e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:20:30.996927 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ce6473-a708-40ce-9161-c4c34cde285e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:31.001947 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ce6473-a708-40ce-9161-c4c34cde285e admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:31.054037 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 848/1704] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:20:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:20:31.055988 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce6473-a708-40ce-9161-c4c34cde285e admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:31.095601 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ce6473-a708-40ce-9161-c4c34cde285e admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:31.113370 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071294e-e151-4959-9e90-3ee06cdfc878 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:31.117273 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071294e-e151-4959-9e90-3ee06cdfc878 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:31.117613 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071294e-e151-4959-9e90-3ee06cdfc878 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:31.117893 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4071294e-e151-4959-9e90-3ee06cdfc878 admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:31.118581 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4071294e-e151-4959-9e90-3ee06cdfc878 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:31.126635 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4071294e-e151-4959-9e90-3ee06cdfc878 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:31.182477 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 857/1705] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:30 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 313 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:31.193362 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133b5d0-c522-422f-8026-00ee84feb6c3 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:31.193660 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133b5d0-c522-422f-8026-00ee84feb6c3 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:31.193942 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0133b5d0-c522-422f-8026-00ee84feb6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:31.216686 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 849/1706] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:20:31 2022] POST /identity/v3/projects => generated 373 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:20:31.221208 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071294e-e151-4959-9e90-3ee06cdfc878 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:31.243708 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-0133b5d0-c522-422f-8026-00ee84feb6c3 None None] MFA Rules not processed for user `5bf84408a3984972a5bb68a3117c0501`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:31.247379 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-0133b5d0-c522-422f-8026-00ee84feb6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:31.388191 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:31.407417 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 858/1707] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:31 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:31.411859 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4071294e-e151-4959-9e90-3ee06cdfc878 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:31.414990 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133b5d0-c522-422f-8026-00ee84feb6c3 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:31.417754 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-0133b5d0-c522-422f-8026-00ee84feb6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:31.442089 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9ed80-0efb-4855-905b-dec58c36cc20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:31.442747 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9ed80-0efb-4855-905b-dec58c36cc20 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:31.443029 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9ed80-0efb-4855-905b-dec58c36cc20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:31.443305 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba9ed80-0efb-4855-905b-dec58c36cc20 admin admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:31.443997 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba9ed80-0efb-4855-905b-dec58c36cc20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:31.446020 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba9ed80-0efb-4855-905b-dec58c36cc20 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:31.533722 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 850/1708] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:20:31 2022] POST /identity/v3/users => generated 287 bytes in 316 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:20:31.534893 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9ed80-0efb-4855-905b-dec58c36cc20 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:31.539235 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-6ba9ed80-0efb-4855-905b-dec58c36cc20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:31.579701 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba9ed80-0efb-4855-905b-dec58c36cc20 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:31.600577 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab8ccf-30af-4b6b-8153-deeb7c8a1354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:31.601394 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab8ccf-30af-4b6b-8153-deeb7c8a1354 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:31.601780 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab8ccf-30af-4b6b-8153-deeb7c8a1354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:31.602158 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ab8ccf-30af-4b6b-8153-deeb7c8a1354 admin admin] PATH_INFO: `/v3/projects/049941021f754165858826843e37f2ad` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:31.603866 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab8ccf-30af-4b6b-8153-deeb7c8a1354 admin admin] RBAC: Authorizing `identity:delete_project(project_id=049941021f754165858826843e37f2ad)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:31.605930 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ab8ccf-30af-4b6b-8153-deeb7c8a1354 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:31.642830 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0133b5d0-c522-422f-8026-00ee84feb6c3 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:31.663277 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc7305-9ee4-488a-8f74-c01eed9024f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:31.678754 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc7305-9ee4-488a-8f74-c01eed9024f0 service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:31.680470 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc7305-9ee4-488a-8f74-c01eed9024f0 service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:31.681445 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dc7305-9ee4-488a-8f74-c01eed9024f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:31.712476 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dc7305-9ee4-488a-8f74-c01eed9024f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:31.714595 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dc7305-9ee4-488a-8f74-c01eed9024f0 service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:31.755720 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 859/1709] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:20:31 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:20:31.761559 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc7305-9ee4-488a-8f74-c01eed9024f0 service nova] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:31.792970 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-81ab8ccf-30af-4b6b-8153-deeb7c8a1354 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '049941021f754165858826843e37f2ad', 'request_id': 'req-81ab8ccf-30af-4b6b-8153-deeb7c8a1354'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:31.800233 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dc7305-9ee4-488a-8f74-c01eed9024f0 service nova] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:31.817128 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-81ab8ccf-30af-4b6b-8153-deeb7c8a1354 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '049941021f754165858826843e37f2ad', 'request_id': 'req-81ab8ccf-30af-4b6b-8153-deeb7c8a1354'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:31.841607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-81ab8ccf-30af-4b6b-8153-deeb7c8a1354 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '049941021f754165858826843e37f2ad', 'request_id': 'req-81ab8ccf-30af-4b6b-8153-deeb7c8a1354'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:31.867975 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-81ab8ccf-30af-4b6b-8153-deeb7c8a1354 admin admin] The token cache is being invalidate because project 049941021f754165858826843e37f2ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:20:31.868272 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-81ab8ccf-30af-4b6b-8153-deeb7c8a1354 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:31.869022 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-81ab8ccf-30af-4b6b-8153-deeb7c8a1354 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:31.875427 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 851/1710] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:20:31 2022] DELETE /identity/v3/projects/049941021f754165858826843e37f2ad => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:20:31.880153 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab8ccf-30af-4b6b-8153-deeb7c8a1354 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:31.884889 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-81ab8ccf-30af-4b6b-8153-deeb7c8a1354 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:32.030511 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=88,keystone:INSERT=5,keystone:DELETE=7 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:32.044853 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0020b7b9-84ac-4ca5-b515-edde43da3ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:32.045608 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020b7b9-84ac-4ca5-b515-edde43da3ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:32.046064 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020b7b9-84ac-4ca5-b515-edde43da3ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:32.046711 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0020b7b9-84ac-4ca5-b515-edde43da3ec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:32.047148 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0020b7b9-84ac-4ca5-b515-edde43da3ec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:32.073414 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0020b7b9-84ac-4ca5-b515-edde43da3ec6 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:32.110644 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 860/1711] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:20:31 2022] GET /identity/v3/roles => generated 1420 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:20:32.123697 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0020b7b9-84ac-4ca5-b515-edde43da3ec6 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:32.126002 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-0020b7b9-84ac-4ca5-b515-edde43da3ec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:32.151299 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0020b7b9-84ac-4ca5-b515-edde43da3ec6 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:32.167869 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359caf9-c6d1-458e-bc58-8e1389f4b96b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:32.168549 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359caf9-c6d1-458e-bc58-8e1389f4b96b admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:32.168833 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359caf9-c6d1-458e-bc58-8e1389f4b96b admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:32.169247 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3359caf9-c6d1-458e-bc58-8e1389f4b96b admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:32.169964 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359caf9-c6d1-458e-bc58-8e1389f4b96b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:32.172680 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3359caf9-c6d1-458e-bc58-8e1389f4b96b admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:32.196062 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ab8ccf-30af-4b6b-8153-deeb7c8a1354 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:32.206574 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 861/1712] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:20:32 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:20:32.209321 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb13b8-948c-4098-8077-6bcb615e2bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:32.210407 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb13b8-948c-4098-8077-6bcb615e2bb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:32.213294 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359caf9-c6d1-458e-bc58-8e1389f4b96b admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:32.225752 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb13b8-948c-4098-8077-6bcb615e2bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:32.238751 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb13b8-948c-4098-8077-6bcb615e2bb0 admin admin] PATH_INFO: `/v3/users/b631ab5ecf4a4e388957cfad56f9689f` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:32.242379 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb13b8-948c-4098-8077-6bcb615e2bb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b631ab5ecf4a4e388957cfad56f9689f)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:32.244611 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb13b8-948c-4098-8077-6bcb615e2bb0 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:32.255180 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3359caf9-c6d1-458e-bc58-8e1389f4b96b admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:32.273539 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f8bc82-3e73-4053-8b7a-8c7871348d49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:32.274255 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8bc82-3e73-4053-8b7a-8c7871348d49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:32.275710 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8bc82-3e73-4053-8b7a-8c7871348d49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:32.276281 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f8bc82-3e73-4053-8b7a-8c7871348d49 admin admin] PATH_INFO: `/v3/projects/8de3eee4065f4002ac30d956b311378f/users/126629652bec43c2b733ac9a55ec7888/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:32.324618 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8bc82-3e73-4053-8b7a-8c7871348d49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8de3eee4065f4002ac30d956b311378f, user_id=126629652bec43c2b733ac9a55ec7888, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:32.327486 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f8bc82-3e73-4053-8b7a-8c7871348d49 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:32.382255 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 862/1713] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:20:32 2022] PUT /identity/v3/projects/8de3eee4065f4002ac30d956b311378f/users/126629652bec43c2b733ac9a55ec7888/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:20:32.394384 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cde854-d6cc-425b-b97d-21fda4b663cd None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:32.394696 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cde854-d6cc-425b-b97d-21fda4b663cd None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:32.394973 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cde854-d6cc-425b-b97d-21fda4b663cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:32.397637 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-7dcb13b8-948c-4098-8077-6bcb615e2bb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b631ab5ecf4a4e388957cfad56f9689f'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:32.440119 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-7dcb13b8-948c-4098-8077-6bcb615e2bb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b631ab5ecf4a4e388957cfad56f9689f'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:32.442740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-7dcb13b8-948c-4098-8077-6bcb615e2bb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b631ab5ecf4a4e388957cfad56f9689f'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:32.443956 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-7dcb13b8-948c-4098-8077-6bcb615e2bb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b631ab5ecf4a4e388957cfad56f9689f'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:32.470209 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-7dcb13b8-948c-4098-8077-6bcb615e2bb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b631ab5ecf4a4e388957cfad56f9689f'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:32.496167 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-65cde854-d6cc-425b-b97d-21fda4b663cd None None] MFA Rules not processed for user `126629652bec43c2b733ac9a55ec7888`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:32.501495 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-65cde854-d6cc-425b-b97d-21fda4b663cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:32.524678 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 852/1714] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:20:31 2022] DELETE /identity/v3/users/b631ab5ecf4a4e388957cfad56f9689f => generated 0 bytes in 642 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:20:32.586974 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:32.635924 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb13b8-948c-4098-8077-6bcb615e2bb0 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:32.637428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-7dcb13b8-948c-4098-8077-6bcb615e2bb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:32.659674 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 863/1715] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 266 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:32.663465 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cde854-d6cc-425b-b97d-21fda4b663cd None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:32.665132 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-65cde854-d6cc-425b-b97d-21fda4b663cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:32.782194 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cde854-d6cc-425b-b97d-21fda4b663cd None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:32.850113 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb13b8-948c-4098-8077-6bcb615e2bb0 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:32.867687 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8088b-6a3b-4fc1-b7b4-6fb3a04a9b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:32.868752 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8088b-6a3b-4fc1-b7b4-6fb3a04a9b20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:32.869388 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8088b-6a3b-4fc1-b7b4-6fb3a04a9b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:32.870009 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff8088b-6a3b-4fc1-b7b4-6fb3a04a9b20 admin admin] PATH_INFO: `/v3/projects/185626fe59d14d43bf02a56991a068a0` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:32.876880 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff8088b-6a3b-4fc1-b7b4-6fb3a04a9b20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=185626fe59d14d43bf02a56991a068a0)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:32.879082 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff8088b-6a3b-4fc1-b7b4-6fb3a04a9b20 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:32.905224 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad79761-7def-4c4e-8871-ed6c2f863d69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:32.907616 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad79761-7def-4c4e-8871-ed6c2f863d69 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:32.907936 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad79761-7def-4c4e-8871-ed6c2f863d69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:32.908379 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad79761-7def-4c4e-8871-ed6c2f863d69 admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:32.911950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad79761-7def-4c4e-8871-ed6c2f863d69 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:32.917183 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad79761-7def-4c4e-8871-ed6c2f863d69 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:32.988138 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 864/1716] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:20:32 2022] POST /identity/v3/projects => generated 373 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:20:32.989135 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad79761-7def-4c4e-8871-ed6c2f863d69 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:33.039612 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:33.059419 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-5ff8088b-6a3b-4fc1-b7b4-6fb3a04a9b20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '185626fe59d14d43bf02a56991a068a0', 'request_id': 'req-5ff8088b-6a3b-4fc1-b7b4-6fb3a04a9b20'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:33.079732 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-5ff8088b-6a3b-4fc1-b7b4-6fb3a04a9b20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '185626fe59d14d43bf02a56991a068a0', 'request_id': 'req-5ff8088b-6a3b-4fc1-b7b4-6fb3a04a9b20'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:33.102218 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-5ff8088b-6a3b-4fc1-b7b4-6fb3a04a9b20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '185626fe59d14d43bf02a56991a068a0', 'request_id': 'req-5ff8088b-6a3b-4fc1-b7b4-6fb3a04a9b20'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:33.125510 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-5ff8088b-6a3b-4fc1-b7b4-6fb3a04a9b20 admin admin] The token cache is being invalidate because project 185626fe59d14d43bf02a56991a068a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:20:33.125830 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-5ff8088b-6a3b-4fc1-b7b4-6fb3a04a9b20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:33.128545 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-5ff8088b-6a3b-4fc1-b7b4-6fb3a04a9b20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:33.130460 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 853/1717] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:20:32 2022] DELETE /identity/v3/projects/185626fe59d14d43bf02a56991a068a0 => generated 0 bytes in 495 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:20:33.134417 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8088b-6a3b-4fc1-b7b4-6fb3a04a9b20 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:33.135852 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-5ff8088b-6a3b-4fc1-b7b4-6fb3a04a9b20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:33.162490 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad79761-7def-4c4e-8871-ed6c2f863d69 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:33.183769 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:33.309797 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff8088b-6a3b-4fc1-b7b4-6fb3a04a9b20 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:33.315297 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703e88d-1850-415e-9f2d-c2f02ac9f423 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:33.315953 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703e88d-1850-415e-9f2d-c2f02ac9f423 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:33.316238 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703e88d-1850-415e-9f2d-c2f02ac9f423 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:33.316544 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f703e88d-1850-415e-9f2d-c2f02ac9f423 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:33.317247 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f703e88d-1850-415e-9f2d-c2f02ac9f423 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:33.317363 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27d994-2683-47b5-99ec-5e9385ca5a41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:33.317948 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27d994-2683-47b5-99ec-5e9385ca5a41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:33.318227 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27d994-2683-47b5-99ec-5e9385ca5a41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:33.318674 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc27d994-2683-47b5-99ec-5e9385ca5a41 admin admin] PATH_INFO: `/v3/users/24c9a5408cd7414481e49eeba5a067d9` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:33.319151 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f703e88d-1850-415e-9f2d-c2f02ac9f423 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:33.320816 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc27d994-2683-47b5-99ec-5e9385ca5a41 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24c9a5408cd7414481e49eeba5a067d9)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:33.322554 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc27d994-2683-47b5-99ec-5e9385ca5a41 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:33.369138 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 865/1718] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:20:32 2022] POST /identity/v3/users => generated 293 bytes in 380 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:20:33.374971 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703e88d-1850-415e-9f2d-c2f02ac9f423 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:33.383534 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-f703e88d-1850-415e-9f2d-c2f02ac9f423 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:33.434494 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f703e88d-1850-415e-9f2d-c2f02ac9f423 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:33.448974 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68567b-ac5b-4c33-acc6-4527a83ae17a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:33.449763 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68567b-ac5b-4c33-acc6-4527a83ae17a admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:33.450178 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-fc27d994-2683-47b5-99ec-5e9385ca5a41 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24c9a5408cd7414481e49eeba5a067d9'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:33.450918 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68567b-ac5b-4c33-acc6-4527a83ae17a admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:33.452826 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c68567b-ac5b-4c33-acc6-4527a83ae17a admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:33.454527 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c68567b-ac5b-4c33-acc6-4527a83ae17a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:33.460279 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c68567b-ac5b-4c33-acc6-4527a83ae17a admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:33.476244 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-fc27d994-2683-47b5-99ec-5e9385ca5a41 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24c9a5408cd7414481e49eeba5a067d9'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:33.478253 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-fc27d994-2683-47b5-99ec-5e9385ca5a41 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24c9a5408cd7414481e49eeba5a067d9'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:33.480660 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-fc27d994-2683-47b5-99ec-5e9385ca5a41 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24c9a5408cd7414481e49eeba5a067d9'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:33.500028 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 866/1719] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:20:33 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:20:33.501287 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68567b-ac5b-4c33-acc6-4527a83ae17a admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:33.505485 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-3c68567b-ac5b-4c33-acc6-4527a83ae17a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:33.507663 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-fc27d994-2683-47b5-99ec-5e9385ca5a41 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24c9a5408cd7414481e49eeba5a067d9'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:33.525410 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 854/1720] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:20:33 2022] DELETE /identity/v3/users/24c9a5408cd7414481e49eeba5a067d9 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:20:33.564171 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c68567b-ac5b-4c33-acc6-4527a83ae17a admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:33.715785 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e0554e-58db-4349-a917-dcbd68b11460 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:33.716511 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0554e-58db-4349-a917-dcbd68b11460 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:33.716857 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0554e-58db-4349-a917-dcbd68b11460 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:33.717697 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e0554e-58db-4349-a917-dcbd68b11460 admin admin] PATH_INFO: `/v3/projects/4d645813c33c466f914893246ce1134f/users/62a4d59683744efa8671ebaa8108a206/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:33.761772 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0554e-58db-4349-a917-dcbd68b11460 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d645813c33c466f914893246ce1134f, user_id=62a4d59683744efa8671ebaa8108a206, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:33.771668 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e0554e-58db-4349-a917-dcbd68b11460 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:33.808554 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 867/1721] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:20:33 2022] PUT /identity/v3/projects/4d645813c33c466f914893246ce1134f/users/62a4d59683744efa8671ebaa8108a206/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:20:33.813010 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27d994-2683-47b5-99ec-5e9385ca5a41 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:33.842214 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc27d994-2683-47b5-99ec-5e9385ca5a41 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:33.852202 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ec48d-8c6c-457b-a855-7285de8f6976 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:33.853258 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ec48d-8c6c-457b-a855-7285de8f6976 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:33.853760 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6ec48d-8c6c-457b-a855-7285de8f6976 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:33.857193 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 868/1722] 10.222.0.15 () {54 vars in 912 bytes} [Fri Aug 5 02:20:33 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:20:33.864472 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c73cc-5f6e-49e2-9c89-6f375a44a510 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:33.864780 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c73cc-5f6e-49e2-9c89-6f375a44a510 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:33.865054 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-749c73cc-5f6e-49e2-9c89-6f375a44a510 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:33.990784 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-749c73cc-5f6e-49e2-9c89-6f375a44a510 None None] MFA Rules not processed for user `f81daf3da9b34e7380c61005019a53bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:33.996465 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-749c73cc-5f6e-49e2-9c89-6f375a44a510 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:34.017777 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:34.044845 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119bcf6-2a01-4ab3-8cc4-469b78f23963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:34.045940 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119bcf6-2a01-4ab3-8cc4-469b78f23963 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:34.046532 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119bcf6-2a01-4ab3-8cc4-469b78f23963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:34.046810 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8119bcf6-2a01-4ab3-8cc4-469b78f23963 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:34.047529 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119bcf6-2a01-4ab3-8cc4-469b78f23963 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:34.049258 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8119bcf6-2a01-4ab3-8cc4-469b78f23963 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:34.084073 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 855/1723] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:20:33 2022] GET /identity/v3/roles => generated 1420 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:20:34.085324 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119bcf6-2a01-4ab3-8cc4-469b78f23963 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:34.111601 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8119bcf6-2a01-4ab3-8cc4-469b78f23963 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:34.120052 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54609bf-fe1b-4464-b274-6a6a0b951caf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:34.121908 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54609bf-fe1b-4464-b274-6a6a0b951caf admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:34.122196 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54609bf-fe1b-4464-b274-6a6a0b951caf admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:34.122479 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54609bf-fe1b-4464-b274-6a6a0b951caf admin admin] PATH_INFO: `/v3/projects/4d645813c33c466f914893246ce1134f/users/62a4d59683744efa8671ebaa8108a206/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:34.130740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54609bf-fe1b-4464-b274-6a6a0b951caf admin admin] RBAC: Authorizing `identity:create_grant(project_id=4d645813c33c466f914893246ce1134f, user_id=62a4d59683744efa8671ebaa8108a206, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:34.137671 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54609bf-fe1b-4464-b274-6a6a0b951caf admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:34.152509 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 869/1724] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Aug 5 02:20:33 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 289 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:34.153874 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade7e9a-2307-440a-85f6-3c1d6e4d5162 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:34.154166 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade7e9a-2307-440a-85f6-3c1d6e4d5162 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:34.154508 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ade7e9a-2307-440a-85f6-3c1d6e4d5162 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:34.178071 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 856/1725] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:20:34 2022] PUT /identity/v3/projects/4d645813c33c466f914893246ce1134f/users/62a4d59683744efa8671ebaa8108a206/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 84 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:20:34.179746 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76dcbc-ca17-43a2-90ce-e081c896569d None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:34.180033 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76dcbc-ca17-43a2-90ce-e081c896569d None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:34.180309 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e76dcbc-ca17-43a2-90ce-e081c896569d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:34.199972 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:34.217205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-5ade7e9a-2307-440a-85f6-3c1d6e4d5162 None None] MFA Rules not processed for user `3d47613c7085460da42e2179625b3f16`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:34.221027 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-5ade7e9a-2307-440a-85f6-3c1d6e4d5162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:34.236198 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-2e76dcbc-ca17-43a2-90ce-e081c896569d None None] MFA Rules not processed for user `62a4d59683744efa8671ebaa8108a206`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:34.238169 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-2e76dcbc-ca17-43a2-90ce-e081c896569d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:34.376756 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 870/1726] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:34 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:34.385128 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 857/1727] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:34.385128 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76dcbc-ca17-43a2-90ce-e081c896569d None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:34.385128 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-2e76dcbc-ca17-43a2-90ce-e081c896569d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:34.388011 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade7e9a-2307-440a-85f6-3c1d6e4d5162 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:34.389851 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-5ade7e9a-2307-440a-85f6-3c1d6e4d5162 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:34.483521 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e76dcbc-ca17-43a2-90ce-e081c896569d None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:34.486424 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ade7e9a-2307-440a-85f6-3c1d6e4d5162 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:34.489632 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a28bd-b5f2-438b-9d74-7a0a647c51b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:34.490432 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a28bd-b5f2-438b-9d74-7a0a647c51b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:34.490777 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a28bd-b5f2-438b-9d74-7a0a647c51b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:34.491120 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a28bd-b5f2-438b-9d74-7a0a647c51b3 admin admin] PATH_INFO: `/v3/projects/6c7ae2cc442e414ab41a3545f2b26dda` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:34.492426 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a28bd-b5f2-438b-9d74-7a0a647c51b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6c7ae2cc442e414ab41a3545f2b26dda)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:34.493367 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24be41c-8107-42ce-b6cf-9bbebb459970 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:34.494602 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a28bd-b5f2-438b-9d74-7a0a647c51b3 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:34.495588 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24be41c-8107-42ce-b6cf-9bbebb459970 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:34.496173 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24be41c-8107-42ce-b6cf-9bbebb459970 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:34.496676 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24be41c-8107-42ce-b6cf-9bbebb459970 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:34.509085 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24be41c-8107-42ce-b6cf-9bbebb459970 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:34.510897 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24be41c-8107-42ce-b6cf-9bbebb459970 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:34.526858 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 871/1728] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:20:34 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:20:34.528581 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7838e67-4a5f-4a09-b5d1-5eb1225ff280 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:34.529077 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7838e67-4a5f-4a09-b5d1-5eb1225ff280 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:34.531051 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7838e67-4a5f-4a09-b5d1-5eb1225ff280 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:34.565223 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-e37a28bd-b5f2-438b-9d74-7a0a647c51b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6c7ae2cc442e414ab41a3545f2b26dda', 'request_id': 'req-e37a28bd-b5f2-438b-9d74-7a0a647c51b3'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:34.569638 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-f7838e67-4a5f-4a09-b5d1-5eb1225ff280 None None] MFA Rules not processed for user `600f51be8202427fb3691db566ed2ff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:34.572163 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-e37a28bd-b5f2-438b-9d74-7a0a647c51b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6c7ae2cc442e414ab41a3545f2b26dda', 'request_id': 'req-e37a28bd-b5f2-438b-9d74-7a0a647c51b3'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:34.576629 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:34.588381 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-e37a28bd-b5f2-438b-9d74-7a0a647c51b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6c7ae2cc442e414ab41a3545f2b26dda', 'request_id': 'req-e37a28bd-b5f2-438b-9d74-7a0a647c51b3'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:34.596029 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-f7838e67-4a5f-4a09-b5d1-5eb1225ff280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:34.626167 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-e37a28bd-b5f2-438b-9d74-7a0a647c51b3 admin admin] The token cache is being invalidate because project 6c7ae2cc442e414ab41a3545f2b26dda was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:20:34.626463 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-e37a28bd-b5f2-438b-9d74-7a0a647c51b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:34.629162 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-e37a28bd-b5f2-438b-9d74-7a0a647c51b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:34.635014 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 858/1729] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:20:34 2022] DELETE /identity/v3/projects/6c7ae2cc442e414ab41a3545f2b26dda => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:20:34.636005 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a28bd-b5f2-438b-9d74-7a0a647c51b3 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:34.638181 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-e37a28bd-b5f2-438b-9d74-7a0a647c51b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:34.705737 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 872/1730] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:34.711140 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7838e67-4a5f-4a09-b5d1-5eb1225ff280 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:34.712606 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-f7838e67-4a5f-4a09-b5d1-5eb1225ff280 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:34.769940 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a28bd-b5f2-438b-9d74-7a0a647c51b3 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:34.783616 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ae0c2b-6f84-4943-a7c9-1972a5ad4061 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:34.787419 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae0c2b-6f84-4943-a7c9-1972a5ad4061 service cinder] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:34.787938 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae0c2b-6f84-4943-a7c9-1972a5ad4061 service cinder] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:34.788607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ae0c2b-6f84-4943-a7c9-1972a5ad4061 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:34.791934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-00ae0c2b-6f84-4943-a7c9-1972a5ad4061 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:34.818493 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:34.883662 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7838e67-4a5f-4a09-b5d1-5eb1225ff280 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:34.891421 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539e2b7e-55fe-42a3-9f4c-a64326ff68f1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:34.892381 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e2b7e-55fe-42a3-9f4c-a64326ff68f1 service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:34.893031 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e2b7e-55fe-42a3-9f4c-a64326ff68f1 service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:34.893531 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539e2b7e-55fe-42a3-9f4c-a64326ff68f1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:34.896900 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-539e2b7e-55fe-42a3-9f4c-a64326ff68f1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:34.897389 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ae0c2b-6f84-4943-a7c9-1972a5ad4061 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:34.965051 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ae0c2b-6f84-4943-a7c9-1972a5ad4061 service cinder] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:34.988506 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539e2b7e-55fe-42a3-9f4c-a64326ff68f1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:34.990314 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539e2b7e-55fe-42a3-9f4c-a64326ff68f1 service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:34.999378 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 859/1731] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:20:34 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 364 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:20:35.002186 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be6838-484b-4205-9f50-b3ad8b61e20b None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:35.002468 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be6838-484b-4205-9f50-b3ad8b61e20b None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:35.002741 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2be6838-484b-4205-9f50-b3ad8b61e20b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:35.006563 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 873/1732] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:20:34 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:20:35.007854 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ccd28-66cb-4b68-acbf-26f705b7e081 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:35.008262 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ccd28-66cb-4b68-acbf-26f705b7e081 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:35.008499 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-393ccd28-66cb-4b68-acbf-26f705b7e081 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:35.059536 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-393ccd28-66cb-4b68-acbf-26f705b7e081 None None] MFA Rules not processed for user `4e39a7be17b94c9c9dfb9ac1599a0052`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:35.062635 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-393ccd28-66cb-4b68-acbf-26f705b7e081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:35.068088 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-c2be6838-484b-4205-9f50-b3ad8b61e20b None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:35.094652 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-c2be6838-484b-4205-9f50-b3ad8b61e20b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:35.254196 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 874/1733] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:35.258197 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ccd28-66cb-4b68-acbf-26f705b7e081 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:35.264774 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-393ccd28-66cb-4b68-acbf-26f705b7e081 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:35.404642 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 860/1734] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:35.406712 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20871d9-ede2-4568-bb6f-48e179a9e6d4 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:35.410893 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20871d9-ede2-4568-bb6f-48e179a9e6d4 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:35.414769 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20871d9-ede2-4568-bb6f-48e179a9e6d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:35.455088 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-393ccd28-66cb-4b68-acbf-26f705b7e081 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:35.468309 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0ed2c6-ccea-4de2-a943-d618cb9c50ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:35.468830 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ed2c6-ccea-4de2-a943-d618cb9c50ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:35.469111 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ed2c6-ccea-4de2-a943-d618cb9c50ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:35.469393 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0ed2c6-ccea-4de2-a943-d618cb9c50ed admin admin] PATH_INFO: `/v3/projects/8a88e2d3b7434623a20278af8f081c3a` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:35.471083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ed2c6-ccea-4de2-a943-d618cb9c50ed admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a88e2d3b7434623a20278af8f081c3a)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:35.473386 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0ed2c6-ccea-4de2-a943-d618cb9c50ed admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:35.478696 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-f20871d9-ede2-4568-bb6f-48e179a9e6d4 None None] MFA Rules not processed for user `4e39a7be17b94c9c9dfb9ac1599a0052`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:35.479918 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-f20871d9-ede2-4568-bb6f-48e179a9e6d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:35.500749 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 861/1735] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:35 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:35.506005 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20871d9-ede2-4568-bb6f-48e179a9e6d4 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:35.524242 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:35.530428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20871d9-ede2-4568-bb6f-48e179a9e6d4 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:35.540276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a9309-b650-47e2-a629-f3c80232dee6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:35.540915 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a9309-b650-47e2-a629-f3c80232dee6 service cinder] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:35.541241 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a9309-b650-47e2-a629-f3c80232dee6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:35.541515 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4a9309-b650-47e2-a629-f3c80232dee6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:35.544421 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-3f4a9309-b650-47e2-a629-f3c80232dee6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:35.591421 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9f0ed2c6-ccea-4de2-a943-d618cb9c50ed admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a88e2d3b7434623a20278af8f081c3a', 'request_id': 'req-9f0ed2c6-ccea-4de2-a943-d618cb9c50ed'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:35.609791 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9f0ed2c6-ccea-4de2-a943-d618cb9c50ed admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a88e2d3b7434623a20278af8f081c3a', 'request_id': 'req-9f0ed2c6-ccea-4de2-a943-d618cb9c50ed'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:35.629512 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9f0ed2c6-ccea-4de2-a943-d618cb9c50ed admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a88e2d3b7434623a20278af8f081c3a', 'request_id': 'req-9f0ed2c6-ccea-4de2-a943-d618cb9c50ed'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:35.638974 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:35.655276 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9f0ed2c6-ccea-4de2-a943-d618cb9c50ed admin admin] The token cache is being invalidate because project 8a88e2d3b7434623a20278af8f081c3a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:20:35.655592 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9f0ed2c6-ccea-4de2-a943-d618cb9c50ed admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:35.658686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9f0ed2c6-ccea-4de2-a943-d618cb9c50ed admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:35.666061 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 875/1736] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:20:35 2022] DELETE /identity/v3/projects/8a88e2d3b7434623a20278af8f081c3a => generated 0 bytes in 406 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:20:35.670103 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb7002-eb12-4b09-80f8-b1d1b827014f None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:35.671827 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb7002-eb12-4b09-80f8-b1d1b827014f None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:35.672118 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bb7002-eb12-4b09-80f8-b1d1b827014f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:35.704196 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a9309-b650-47e2-a629-f3c80232dee6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:35.705885 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4a9309-b650-47e2-a629-f3c80232dee6 service cinder] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:35.715820 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-62bb7002-eb12-4b09-80f8-b1d1b827014f None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:35.719430 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-62bb7002-eb12-4b09-80f8-b1d1b827014f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:35.737299 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 862/1737] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:20:35 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 236 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:20:35.740168 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a9309-b650-47e2-a629-f3c80232dee6 service cinder] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:35.767268 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4a9309-b650-47e2-a629-f3c80232dee6 service cinder] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:35.940514 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 876/1738] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:35.948220 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb7002-eb12-4b09-80f8-b1d1b827014f None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:35.957597 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a657141-ea5b-4cfc-9a06-c6d7fe06c500 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:35.958305 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a657141-ea5b-4cfc-9a06-c6d7fe06c500 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:35.958581 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a657141-ea5b-4cfc-9a06-c6d7fe06c500 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:35.958855 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a657141-ea5b-4cfc-9a06-c6d7fe06c500 admin admin] PATH_INFO: `/v3/users/62abd0e3286c48a4b32a65e2cbd49950` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:35.972938 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a657141-ea5b-4cfc-9a06-c6d7fe06c500 admin admin] RBAC: Authorizing `identity:delete_user(user_id=62abd0e3286c48a4b32a65e2cbd49950)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:35.976304 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a657141-ea5b-4cfc-9a06-c6d7fe06c500 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:35.978115 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bb7002-eb12-4b09-80f8-b1d1b827014f None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:35.990838 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9734a0-b8ac-42d9-b379-c714c37e7a3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:35.991779 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9734a0-b8ac-42d9-b379-c714c37e7a3c admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:35.992515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9734a0-b8ac-42d9-b379-c714c37e7a3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:35.992947 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9734a0-b8ac-42d9-b379-c714c37e7a3c admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:35.995226 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9734a0-b8ac-42d9-b379-c714c37e7a3c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:20:35.996008 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9734a0-b8ac-42d9-b379-c714c37e7a3c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:36.002561 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9734a0-b8ac-42d9-b379-c714c37e7a3c admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:36.046647 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 877/1739] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:20:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:20:36.047701 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9734a0-b8ac-42d9-b379-c714c37e7a3c admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:36.087458 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9734a0-b8ac-42d9-b379-c714c37e7a3c admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:36.113671 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6742a1-5d78-406b-9adb-c8f06d91a1cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:36.116529 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6742a1-5d78-406b-9adb-c8f06d91a1cf admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:36.117987 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6742a1-5d78-406b-9adb-c8f06d91a1cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:36.118265 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6742a1-5d78-406b-9adb-c8f06d91a1cf admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:36.125137 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6742a1-5d78-406b-9adb-c8f06d91a1cf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:36.132883 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d6742a1-5d78-406b-9adb-c8f06d91a1cf admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:36.187182 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-1a657141-ea5b-4cfc-9a06-c6d7fe06c500 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62abd0e3286c48a4b32a65e2cbd49950'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:36.235190 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 878/1740] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:20:36 2022] POST /identity/v3/projects => generated 399 bytes in 188 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:20:36.240309 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6742a1-5d78-406b-9adb-c8f06d91a1cf admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:36.247299 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-1a657141-ea5b-4cfc-9a06-c6d7fe06c500 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62abd0e3286c48a4b32a65e2cbd49950'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:36.249417 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-1a657141-ea5b-4cfc-9a06-c6d7fe06c500 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62abd0e3286c48a4b32a65e2cbd49950'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:36.250287 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-1a657141-ea5b-4cfc-9a06-c6d7fe06c500 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62abd0e3286c48a4b32a65e2cbd49950'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:36.264277 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-1a657141-ea5b-4cfc-9a06-c6d7fe06c500 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62abd0e3286c48a4b32a65e2cbd49950'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:36.343085 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 863/1741] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:20:35 2022] DELETE /identity/v3/users/62abd0e3286c48a4b32a65e2cbd49950 => generated 0 bytes in 603 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:20:36.500900 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6742a1-5d78-406b-9adb-c8f06d91a1cf admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:36.502252 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a657141-ea5b-4cfc-9a06-c6d7fe06c500 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:36.504277 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-1a657141-ea5b-4cfc-9a06-c6d7fe06c500 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:36.547038 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:36.663985 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82226717-23a7-4c75-a40b-6a091c9252b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:36.664129 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82226717-23a7-4c75-a40b-6a091c9252b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:36.664406 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82226717-23a7-4c75-a40b-6a091c9252b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:36.664692 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82226717-23a7-4c75-a40b-6a091c9252b4 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:36.668351 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82226717-23a7-4c75-a40b-6a091c9252b4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:36.673620 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82226717-23a7-4c75-a40b-6a091c9252b4 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:36.696775 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:36.733974 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 879/1742] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:20:36 2022] POST /identity/v3/users => generated 300 bytes in 494 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:20:36.738045 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d5833-b34e-4ada-b3de-7a9fe28fdb78 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:36.738342 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d5833-b34e-4ada-b3de-7a9fe28fdb78 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:36.738625 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-951d5833-b34e-4ada-b3de-7a9fe28fdb78 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:36.744842 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a657141-ea5b-4cfc-9a06-c6d7fe06c500 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:36.749410 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 880/1743] 10.222.0.15 () {54 vars in 961 bytes} [Fri Aug 5 02:20:36 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:20:36.750366 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d5833-b34e-4ada-b3de-7a9fe28fdb78 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:36.756535 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-951d5833-b34e-4ada-b3de-7a9fe28fdb78 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:36.759568 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba82ed2d-3f90-4c38-9b84-4d9acac71394 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:36.760581 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82ed2d-3f90-4c38-9b84-4d9acac71394 service nova] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:36.761030 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82ed2d-3f90-4c38-9b84-4d9acac71394 service nova] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:36.761446 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba82ed2d-3f90-4c38-9b84-4d9acac71394 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:36.769284 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-ba82ed2d-3f90-4c38-9b84-4d9acac71394 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:36.791616 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-951d5833-b34e-4ada-b3de-7a9fe28fdb78 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:36.810230 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbc303c-6ce2-4071-af51-8c3b10a72b9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:36.811438 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc303c-6ce2-4071-af51-8c3b10a72b9e admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:36.811727 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc303c-6ce2-4071-af51-8c3b10a72b9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:36.812003 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbc303c-6ce2-4071-af51-8c3b10a72b9e admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:36.812769 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbc303c-6ce2-4071-af51-8c3b10a72b9e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:36.814390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbc303c-6ce2-4071-af51-8c3b10a72b9e admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:36.845299 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 881/1744] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:20:36.846583 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8ebc1-b660-4205-b9f9-2917e72b6de1 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:36.847124 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8ebc1-b660-4205-b9f9-2917e72b6de1 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:36.847485 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b8ebc1-b660-4205-b9f9-2917e72b6de1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:36.870157 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-41b8ebc1-b660-4205-b9f9-2917e72b6de1 None None] MFA Rules not processed for user `e84ea976b5914aea94c4d8f805139daf`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:36.871478 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-41b8ebc1-b660-4205-b9f9-2917e72b6de1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:36.905386 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba82ed2d-3f90-4c38-9b84-4d9acac71394 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:36.907367 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba82ed2d-3f90-4c38-9b84-4d9acac71394 service nova] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:36.924884 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 864/1745] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:20:36 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 423 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:20:36.926402 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31d5c9-6276-4fde-8fb6-c16f0f103009 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:36.928843 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31d5c9-6276-4fde-8fb6-c16f0f103009 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:36.929984 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a31d5c9-6276-4fde-8fb6-c16f0f103009 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:36.934728 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 865/1746] 10.222.0.15 () {54 vars in 912 bytes} [Fri Aug 5 02:20:36 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:20:36.936250 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31d5c9-6276-4fde-8fb6-c16f0f103009 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:36.971519 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a31d5c9-6276-4fde-8fb6-c16f0f103009 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:36.985276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e823b7fa-6169-440b-856f-4333b5350cc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:36.985914 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823b7fa-6169-440b-856f-4333b5350cc5 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:36.986195 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823b7fa-6169-440b-856f-4333b5350cc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:36.986481 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e823b7fa-6169-440b-856f-4333b5350cc5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:36.987166 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e823b7fa-6169-440b-856f-4333b5350cc5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:36.988831 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e823b7fa-6169-440b-856f-4333b5350cc5 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:37.011796 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 866/1747] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:20:36 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:20:37.015545 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a2dda-ab55-4cde-b6ba-eac2dcc0a24c None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:37.015994 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a2dda-ab55-4cde-b6ba-eac2dcc0a24c None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:37.019009 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 882/1748] 10.222.0.15 () {58 vars in 1058 bytes} [Fri Aug 5 02:20:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:37.019930 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a2dda-ab55-4cde-b6ba-eac2dcc0a24c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:37.022295 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8ebc1-b660-4205-b9f9-2917e72b6de1 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:37.039942 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b8ebc1-b660-4205-b9f9-2917e72b6de1 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:37.045245 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a38a48-d205-44d3-a441-13b88acf20af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:37.046145 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a38a48-d205-44d3-a441-13b88acf20af admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:37.046442 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a38a48-d205-44d3-a441-13b88acf20af admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:37.046798 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a38a48-d205-44d3-a441-13b88acf20af admin admin] PATH_INFO: `/v3/projects/2de8d8949f7c4c599cc404cafc591721/users/4379b624ca084ca288bbf1d068c9ff49/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:37.068490 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a38a48-d205-44d3-a441-13b88acf20af admin admin] RBAC: Authorizing `identity:create_grant(project_id=2de8d8949f7c4c599cc404cafc591721, user_id=4379b624ca084ca288bbf1d068c9ff49, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:37.071087 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-275a2dda-ab55-4cde-b6ba-eac2dcc0a24c None None] MFA Rules not processed for user `f81daf3da9b34e7380c61005019a53bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:37.071992 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a38a48-d205-44d3-a441-13b88acf20af admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:37.072935 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-275a2dda-ab55-4cde-b6ba-eac2dcc0a24c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:37.107977 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 883/1749] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:20:37 2022] PUT /identity/v3/projects/2de8d8949f7c4c599cc404cafc591721/users/4379b624ca084ca288bbf1d068c9ff49/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:20:37.117806 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a38a48-d205-44d3-a441-13b88acf20af admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:37.208857 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 867/1750] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Aug 5 02:20:37 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:37.210295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc6fe4-fee2-42b1-9629-0560be1f13ff None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:37.210679 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc6fe4-fee2-42b1-9629-0560be1f13ff None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:37.211058 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc6fe4-fee2-42b1-9629-0560be1f13ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:37.291058 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-dcbc6fe4-fee2-42b1-9629-0560be1f13ff None None] MFA Rules not processed for user `4379b624ca084ca288bbf1d068c9ff49`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:37.293374 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-dcbc6fe4-fee2-42b1-9629-0560be1f13ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:37.318196 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a38a48-d205-44d3-a441-13b88acf20af admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:37.334082 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a14a4-be11-4032-b604-5e24e1b833d0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e84ea976b5914aea94c4d8f805139daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:37.334839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a14a4-be11-4032-b604-5e24e1b833d0 service placement] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:37.335017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a14a4-be11-4032-b604-5e24e1b833d0 service placement] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:37.335302 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635a14a4-be11-4032-b604-5e24e1b833d0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:37.350797 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-635a14a4-be11-4032-b604-5e24e1b833d0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:37.380391 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a14a4-be11-4032-b604-5e24e1b833d0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:37.382195 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635a14a4-be11-4032-b604-5e24e1b833d0 service placement] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:37.391296 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:37.411718 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 884/1751] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:20:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:20:37.412628 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a14a4-be11-4032-b604-5e24e1b833d0 service placement] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:37.417812 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-635a14a4-be11-4032-b604-5e24e1b833d0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:37.540608 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 868/1752] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:37 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 331 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:37.541142 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635a14a4-be11-4032-b604-5e24e1b833d0 service placement] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:37.541554 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc6fe4-fee2-42b1-9629-0560be1f13ff None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:37.543707 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-dcbc6fe4-fee2-42b1-9629-0560be1f13ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:37.557532 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ad139-9947-4ad5-9b97-686e858e71cd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:37.558186 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ad139-9947-4ad5-9b97-686e858e71cd service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:37.558572 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ad139-9947-4ad5-9b97-686e858e71cd service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:37.558850 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ad139-9947-4ad5-9b97-686e858e71cd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:37.571915 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:37.583046 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8ad139-9947-4ad5-9b97-686e858e71cd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:37.586684 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8ad139-9947-4ad5-9b97-686e858e71cd service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:37.613260 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 885/1753] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:20:37 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 201 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:20:37.614111 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ad139-9947-4ad5-9b97-686e858e71cd service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:37.698384 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc6fe4-fee2-42b1-9629-0560be1f13ff None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:37.707858 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63145a63-0bdc-4484-b39d-a33acaa5722a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:37.708553 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63145a63-0bdc-4484-b39d-a33acaa5722a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:37.708836 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63145a63-0bdc-4484-b39d-a33acaa5722a admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:37.709113 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63145a63-0bdc-4484-b39d-a33acaa5722a admin admin] PATH_INFO: `/v3/projects/6d16c0b8a3d84ca09cf27c0d0f6ec13e` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:37.716184 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63145a63-0bdc-4484-b39d-a33acaa5722a admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d16c0b8a3d84ca09cf27c0d0f6ec13e)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:37.718588 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63145a63-0bdc-4484-b39d-a33acaa5722a admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:37.821716 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ad139-9947-4ad5-9b97-686e858e71cd service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:37.843544 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-63145a63-0bdc-4484-b39d-a33acaa5722a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d16c0b8a3d84ca09cf27c0d0f6ec13e', 'request_id': 'req-63145a63-0bdc-4484-b39d-a33acaa5722a'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:37.862507 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-63145a63-0bdc-4484-b39d-a33acaa5722a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d16c0b8a3d84ca09cf27c0d0f6ec13e', 'request_id': 'req-63145a63-0bdc-4484-b39d-a33acaa5722a'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:37.886007 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-63145a63-0bdc-4484-b39d-a33acaa5722a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d16c0b8a3d84ca09cf27c0d0f6ec13e', 'request_id': 'req-63145a63-0bdc-4484-b39d-a33acaa5722a'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:37.936186 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-63145a63-0bdc-4484-b39d-a33acaa5722a admin admin] The token cache is being invalidate because project 6d16c0b8a3d84ca09cf27c0d0f6ec13e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:20:37.938655 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-63145a63-0bdc-4484-b39d-a33acaa5722a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:37.942974 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-63145a63-0bdc-4484-b39d-a33acaa5722a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:37.949463 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 869/1754] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:20:37 2022] DELETE /identity/v3/projects/6d16c0b8a3d84ca09cf27c0d0f6ec13e => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:20:37.957000 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8ca3e-da0e-4f04-981e-8a9e3a1c1b73 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:37.957317 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8ca3e-da0e-4f04-981e-8a9e3a1c1b73 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:37.957714 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33f8ca3e-da0e-4f04-981e-8a9e3a1c1b73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:37.995281 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee70f12-a1ac-4a06-98d3-4121b86adfdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:37.996787 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee70f12-a1ac-4a06-98d3-4121b86adfdc admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:37.997070 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee70f12-a1ac-4a06-98d3-4121b86adfdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:37.997346 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee70f12-a1ac-4a06-98d3-4121b86adfdc admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:38.001804 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee70f12-a1ac-4a06-98d3-4121b86adfdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:38.007140 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee70f12-a1ac-4a06-98d3-4121b86adfdc admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:38.044165 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-33f8ca3e-da0e-4f04-981e-8a9e3a1c1b73 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:38.049758 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-33f8ca3e-da0e-4f04-981e-8a9e3a1c1b73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:38.084444 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 870/1755] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:20:38.089831 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405c03e-46d5-42a1-8cdb-95ea994d2f95 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:38.090128 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405c03e-46d5-42a1-8cdb-95ea994d2f95 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:38.090409 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3405c03e-46d5-42a1-8cdb-95ea994d2f95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:38.116462 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 886/1756] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:20:37 2022] POST /identity/v3/projects => generated 399 bytes in 502 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:20:38.117421 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee70f12-a1ac-4a06-98d3-4121b86adfdc admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:38.125953 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-aee70f12-a1ac-4a06-98d3-4121b86adfdc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:38.150696 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-3405c03e-46d5-42a1-8cdb-95ea994d2f95 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:38.155104 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-3405c03e-46d5-42a1-8cdb-95ea994d2f95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:38.246257 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:38.299240 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 871/1757] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:38.303994 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405c03e-46d5-42a1-8cdb-95ea994d2f95 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:38.328528 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3405c03e-46d5-42a1-8cdb-95ea994d2f95 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:38.329924 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee70f12-a1ac-4a06-98d3-4121b86adfdc admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:38.340814 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb1cf57-2eae-40ec-a113-5daf54c8eb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:38.340957 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6aed7-25fb-4000-9542-9a23886c8b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:38.342352 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6aed7-25fb-4000-9542-9a23886c8b0d admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:38.342804 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6aed7-25fb-4000-9542-9a23886c8b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:38.342961 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1cf57-2eae-40ec-a113-5daf54c8eb92 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:38.343696 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1cf57-2eae-40ec-a113-5daf54c8eb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:38.343983 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bb1cf57-2eae-40ec-a113-5daf54c8eb92 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:38.344350 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aad6aed7-25fb-4000-9542-9a23886c8b0d admin admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:38.346576 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6aed7-25fb-4000-9542-9a23886c8b0d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:20:38.346576 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6aed7-25fb-4000-9542-9a23886c8b0d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:38.347114 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb1cf57-2eae-40ec-a113-5daf54c8eb92 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:38.352976 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bb1cf57-2eae-40ec-a113-5daf54c8eb92 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:38.353569 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aad6aed7-25fb-4000-9542-9a23886c8b0d admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:38.385332 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 872/1758] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:20:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:20:38.390318 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6aed7-25fb-4000-9542-9a23886c8b0d admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:38.412027 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 887/1759] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:20:38 2022] POST /identity/v3/users => generated 306 bytes in 295 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:20:38.413976 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb1cf57-2eae-40ec-a113-5daf54c8eb92 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:38.422341 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aad6aed7-25fb-4000-9542-9a23886c8b0d admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:38.449314 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec82f0e-4ea0-436a-88f3-901478ad2971 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:38.452791 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec82f0e-4ea0-436a-88f3-901478ad2971 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:38.453092 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec82f0e-4ea0-436a-88f3-901478ad2971 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:38.454616 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec82f0e-4ea0-436a-88f3-901478ad2971 admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:38.456952 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec82f0e-4ea0-436a-88f3-901478ad2971 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:38.463219 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fec82f0e-4ea0-436a-88f3-901478ad2971 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:38.476277 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bb1cf57-2eae-40ec-a113-5daf54c8eb92 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:38.501619 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed2ac1b-d0a2-4f13-a163-e1bfe2126319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:38.502270 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2ac1b-d0a2-4f13-a163-e1bfe2126319 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:38.504850 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2ac1b-d0a2-4f13-a163-e1bfe2126319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:38.505643 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed2ac1b-d0a2-4f13-a163-e1bfe2126319 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:38.507217 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed2ac1b-d0a2-4f13-a163-e1bfe2126319 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:38.511596 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed2ac1b-d0a2-4f13-a163-e1bfe2126319 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:38.546712 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 888/1760] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:20:38 2022] GET /identity/v3/roles => generated 1420 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:20:38.551997 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53bf3e-ad88-4d86-baec-37d5b6e94fd4 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:38.551997 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53bf3e-ad88-4d86-baec-37d5b6e94fd4 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:38.551997 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf53bf3e-ad88-4d86-baec-37d5b6e94fd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:38.557791 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 873/1761] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:20:38 2022] POST /identity/v3/projects => generated 373 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:20:38.558778 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec82f0e-4ea0-436a-88f3-901478ad2971 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:38.574448 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-bf53bf3e-ad88-4d86-baec-37d5b6e94fd4 None None] MFA Rules not processed for user `64280d0c3da14f329b6fc21228d92288`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:38.575690 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-bf53bf3e-ad88-4d86-baec-37d5b6e94fd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:38.594487 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:38.739500 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 889/1762] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:38 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:38.743899 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53bf3e-ad88-4d86-baec-37d5b6e94fd4 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:38.816535 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec82f0e-4ea0-436a-88f3-901478ad2971 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:38.848967 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41df543-b6fb-48a1-8b73-52858f98dd38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:38.851188 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41df543-b6fb-48a1-8b73-52858f98dd38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:38.853930 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41df543-b6fb-48a1-8b73-52858f98dd38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:38.854337 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41df543-b6fb-48a1-8b73-52858f98dd38 admin admin] PATH_INFO: `/v3/projects/9e32123b50044aea9e1ad0c30da629d2/users/f9052b0ab26346f4937357d67bd60e09/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:38.928181 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41df543-b6fb-48a1-8b73-52858f98dd38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e32123b50044aea9e1ad0c30da629d2, user_id=f9052b0ab26346f4937357d67bd60e09, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:38.939206 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c41df543-b6fb-48a1-8b73-52858f98dd38 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:39.005299 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 874/1763] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:20:38 2022] PUT /identity/v3/projects/9e32123b50044aea9e1ad0c30da629d2/users/f9052b0ab26346f4937357d67bd60e09/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:20:39.022507 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41df543-b6fb-48a1-8b73-52858f98dd38 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:39.036191 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf53bf3e-ad88-4d86-baec-37d5b6e94fd4 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:39.183012 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c41df543-b6fb-48a1-8b73-52858f98dd38 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:39.207862 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e7ca2-65d9-45ce-9dcb-a7c2f1941890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:39.209623 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e7ca2-65d9-45ce-9dcb-a7c2f1941890 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:39.211607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e7ca2-65d9-45ce-9dcb-a7c2f1941890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:39.211770 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2ceec-7794-4e64-b8dd-d8b9814a92b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:39.212234 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7e7ca2-65d9-45ce-9dcb-a7c2f1941890 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:39.212448 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2ceec-7794-4e64-b8dd-d8b9814a92b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:39.212703 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2ceec-7794-4e64-b8dd-d8b9814a92b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:39.212976 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f2ceec-7794-4e64-b8dd-d8b9814a92b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:39.213682 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2ceec-7794-4e64-b8dd-d8b9814a92b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:39.214898 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7e7ca2-65d9-45ce-9dcb-a7c2f1941890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:39.218872 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f2ceec-7794-4e64-b8dd-d8b9814a92b0 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:39.222585 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f7e7ca2-65d9-45ce-9dcb-a7c2f1941890 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:39.246080 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:39.276315 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 890/1764] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:20:38 2022] POST /identity/v3/users => generated 287 bytes in 536 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:20:39.278659 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2ceec-7794-4e64-b8dd-d8b9814a92b0 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:39.305917 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 875/1765] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:20:39.307407 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e7ca2-65d9-45ce-9dcb-a7c2f1941890 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:39.315540 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f2ceec-7794-4e64-b8dd-d8b9814a92b0 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:39.331280 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9977c-2dae-437e-8486-4bc0e9e1283b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:39.333834 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9977c-2dae-437e-8486-4bc0e9e1283b admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:39.334839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9977c-2dae-437e-8486-4bc0e9e1283b admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:39.335934 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf9977c-2dae-437e-8486-4bc0e9e1283b admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:39.337793 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf9977c-2dae-437e-8486-4bc0e9e1283b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:39.345389 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cf9977c-2dae-437e-8486-4bc0e9e1283b admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:39.348896 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7e7ca2-65d9-45ce-9dcb-a7c2f1941890 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:39.377446 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 891/1766] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:20:39.379069 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda30fa5-e10f-4662-9da6-363d51c9c833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:39.379999 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda30fa5-e10f-4662-9da6-363d51c9c833 admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:39.380380 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda30fa5-e10f-4662-9da6-363d51c9c833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:39.383799 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9977c-2dae-437e-8486-4bc0e9e1283b admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:39.384430 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda30fa5-e10f-4662-9da6-363d51c9c833 admin admin] PATH_INFO: `/v3/projects/9e32123b50044aea9e1ad0c30da629d2/users/f9052b0ab26346f4937357d67bd60e09/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:39.397369 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda30fa5-e10f-4662-9da6-363d51c9c833 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9e32123b50044aea9e1ad0c30da629d2, user_id=f9052b0ab26346f4937357d67bd60e09, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:39.402427 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda30fa5-e10f-4662-9da6-363d51c9c833 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:39.412964 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf9977c-2dae-437e-8486-4bc0e9e1283b admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:39.427436 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db12f5-4a9a-4f72-a860-752673afd7d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:39.428111 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db12f5-4a9a-4f72-a860-752673afd7d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:39.428444 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db12f5-4a9a-4f72-a860-752673afd7d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:39.429662 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02db12f5-4a9a-4f72-a860-752673afd7d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:39.430477 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db12f5-4a9a-4f72-a860-752673afd7d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:39.434332 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02db12f5-4a9a-4f72-a860-752673afd7d4 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:39.467893 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 876/1767] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:20:39 2022] PUT /identity/v3/projects/9e32123b50044aea9e1ad0c30da629d2/users/f9052b0ab26346f4937357d67bd60e09/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:20:39.469590 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e722c-dca4-4c42-9978-4f187c807e5e None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:39.469878 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e722c-dca4-4c42-9978-4f187c807e5e None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:39.470398 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 892/1768] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:20:39 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:20:39.473349 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db12f5-4a9a-4f72-a860-752673afd7d4 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:39.477072 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e722c-dca4-4c42-9978-4f187c807e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:39.497411 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02db12f5-4a9a-4f72-a860-752673afd7d4 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:39.637625 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-116e722c-dca4-4c42-9978-4f187c807e5e None None] MFA Rules not processed for user `f9052b0ab26346f4937357d67bd60e09`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:39.654811 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-116e722c-dca4-4c42-9978-4f187c807e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:39.656980 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fca9b30-f38b-412e-8c0a-427412e739b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:39.657775 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca9b30-f38b-412e-8c0a-427412e739b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:39.658121 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca9b30-f38b-412e-8c0a-427412e739b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:39.658476 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fca9b30-f38b-412e-8c0a-427412e739b7 admin admin] PATH_INFO: `/v3/projects/bf64708e6a4d4951b4c42b609ba301de/users/f8fd12e29ae843399a8a9b7a228d9a42/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:39.691849 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca9b30-f38b-412e-8c0a-427412e739b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf64708e6a4d4951b4c42b609ba301de, user_id=f8fd12e29ae843399a8a9b7a228d9a42, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:39.695635 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fca9b30-f38b-412e-8c0a-427412e739b7 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:39.752700 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 893/1769] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:20:39 2022] PUT /identity/v3/projects/bf64708e6a4d4951b4c42b609ba301de/users/f8fd12e29ae843399a8a9b7a228d9a42/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:20:39.772417 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac2d4f-c137-40b4-b519-6c0dd4f9e847 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:39.780497 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac2d4f-c137-40b4-b519-6c0dd4f9e847 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:39.784942 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ac2d4f-c137-40b4-b519-6c0dd4f9e847 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:39.891267 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-90ac2d4f-c137-40b4-b519-6c0dd4f9e847 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:39.892958 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-90ac2d4f-c137-40b4-b519-6c0dd4f9e847 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:39.994239 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:40.020908 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 877/1770] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:39 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 551 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:40.030527 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e722c-dca4-4c42-9978-4f187c807e5e None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:40.035313 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-116e722c-dca4-4c42-9978-4f187c807e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:40.229893 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 894/1771] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:40.235872 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b25bb7-53ed-44f6-8112-e17078164a69 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:40.236835 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b25bb7-53ed-44f6-8112-e17078164a69 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:40.237136 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b25bb7-53ed-44f6-8112-e17078164a69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:40.329433 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-26b25bb7-53ed-44f6-8112-e17078164a69 None None] MFA Rules not processed for user `5bf84408a3984972a5bb68a3117c0501`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:40.340116 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-26b25bb7-53ed-44f6-8112-e17078164a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:40.343435 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e722c-dca4-4c42-9978-4f187c807e5e None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:40.595230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b63da-d136-4ccd-9ce6-5cfc59f2ebb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:40.595230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b63da-d136-4ccd-9ce6-5cfc59f2ebb2 service cinder] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:40.595230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b63da-d136-4ccd-9ce6-5cfc59f2ebb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:40.595230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-620b63da-d136-4ccd-9ce6-5cfc59f2ebb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:40.597039 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:40.618265 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 895/1772] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:40 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 386 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:40.619289 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b25bb7-53ed-44f6-8112-e17078164a69 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:40.621892 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-26b25bb7-53ed-44f6-8112-e17078164a69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:40.846348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b25bb7-53ed-44f6-8112-e17078164a69 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:40.860761 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b63da-d136-4ccd-9ce6-5cfc59f2ebb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:40.863202 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-620b63da-d136-4ccd-9ce6-5cfc59f2ebb2 service cinder] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:40.876671 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cead1dd-5da0-444a-87ee-bae11b8a41f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:40.877323 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cead1dd-5da0-444a-87ee-bae11b8a41f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:40.878304 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 878/1773] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:20:40 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 850 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:20:40.879837 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cead1dd-5da0-444a-87ee-bae11b8a41f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:40.880161 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cead1dd-5da0-444a-87ee-bae11b8a41f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:40.912478 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cead1dd-5da0-444a-87ee-bae11b8a41f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:40.913941 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cead1dd-5da0-444a-87ee-bae11b8a41f7 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:40.945032 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 896/1774] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:20:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 326 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:20:41.070590 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b63da-d136-4ccd-9ce6-5cfc59f2ebb2 service cinder] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:41.087963 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-620b63da-d136-4ccd-9ce6-5cfc59f2ebb2 service cinder] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:41.106059 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d984a2-fa08-43da-9a27-366d1ffbd003 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:41.107252 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d984a2-fa08-43da-9a27-366d1ffbd003 service cinder] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:41.109801 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d984a2-fa08-43da-9a27-366d1ffbd003 service cinder] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:41.111345 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d984a2-fa08-43da-9a27-366d1ffbd003 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:41.116880 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-d2d984a2-fa08-43da-9a27-366d1ffbd003 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:41.278818 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d984a2-fa08-43da-9a27-366d1ffbd003 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:41.280704 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d984a2-fa08-43da-9a27-366d1ffbd003 service cinder] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:41.304477 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 879/1775] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:20:41 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 235 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:20:42.184127 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6755f-8fbf-4be0-9a0d-e2756a13dcd5 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:42.184794 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6755f-8fbf-4be0-9a0d-e2756a13dcd5 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:42.185094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff6755f-8fbf-4be0-9a0d-e2756a13dcd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:42.209566 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-9ff6755f-8fbf-4be0-9a0d-e2756a13dcd5 None None] MFA Rules not processed for user `3d47613c7085460da42e2179625b3f16`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:42.211112 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9ff6755f-8fbf-4be0-9a0d-e2756a13dcd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:42.323275 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 897/1776] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:42 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:42.804034 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1282ea-5175-4f38-b8cd-b90c614b0302 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:42.804626 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1282ea-5175-4f38-b8cd-b90c614b0302 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:42.804626 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f1282ea-5175-4f38-b8cd-b90c614b0302 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:42.822599 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:42.847476 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-3f1282ea-5175-4f38-b8cd-b90c614b0302 None None] MFA Rules not processed for user `f8fd12e29ae843399a8a9b7a228d9a42`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:42.848873 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-3f1282ea-5175-4f38-b8cd-b90c614b0302 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:42.960373 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 880/1777] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:42 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:42.964882 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6755f-8fbf-4be0-9a0d-e2756a13dcd5 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:42.980053 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff6755f-8fbf-4be0-9a0d-e2756a13dcd5 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:42.988882 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a3873-a9bd-4bf1-a74c-28f805163b84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:42.989678 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a3873-a9bd-4bf1-a74c-28f805163b84 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:42.990065 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a3873-a9bd-4bf1-a74c-28f805163b84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:42.990443 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043a3873-a9bd-4bf1-a74c-28f805163b84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:42.991228 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a3873-a9bd-4bf1-a74c-28f805163b84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:42.993907 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-043a3873-a9bd-4bf1-a74c-28f805163b84 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:43.076839 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1282ea-5175-4f38-b8cd-b90c614b0302 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:43.076975 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 898/1778] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:20:42 2022] POST /identity/v3/projects => generated 373 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:20:43.096926 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f1282ea-5175-4f38-b8cd-b90c614b0302 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:43.199495 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046cd472-6a8d-4e79-8ad6-39971a9a5b8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:43.200196 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cd472-6a8d-4e79-8ad6-39971a9a5b8e admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:43.200603 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cd472-6a8d-4e79-8ad6-39971a9a5b8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:43.201176 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046cd472-6a8d-4e79-8ad6-39971a9a5b8e admin admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:43.202394 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046cd472-6a8d-4e79-8ad6-39971a9a5b8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:43.204524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046cd472-6a8d-4e79-8ad6-39971a9a5b8e admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:43.229793 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 881/1779] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:20:43 2022] POST /identity/v3/users => generated 293 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:20:43.234348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a3873-a9bd-4bf1-a74c-28f805163b84 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:43.245754 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043a3873-a9bd-4bf1-a74c-28f805163b84 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:43.250824 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba89513-a42b-4a3d-a0c3-abb7786f02db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:43.252078 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba89513-a42b-4a3d-a0c3-abb7786f02db admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:43.252078 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba89513-a42b-4a3d-a0c3-abb7786f02db admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:43.252078 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ba89513-a42b-4a3d-a0c3-abb7786f02db admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:43.252988 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba89513-a42b-4a3d-a0c3-abb7786f02db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:43.254693 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ba89513-a42b-4a3d-a0c3-abb7786f02db admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:43.266573 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 899/1780] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:20:43.270567 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046cd472-6a8d-4e79-8ad6-39971a9a5b8e admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:43.287702 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046cd472-6a8d-4e79-8ad6-39971a9a5b8e admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:43.293598 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e4bb1-d032-4a9b-9341-3483833e7be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:43.294385 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e4bb1-d032-4a9b-9341-3483833e7be5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:43.295310 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e4bb1-d032-4a9b-9341-3483833e7be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:43.296122 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781e4bb1-d032-4a9b-9341-3483833e7be5 admin admin] PATH_INFO: `/v3/projects/7fd8191678fc41699f2d796ce761dd71/users/2a2474a9bb1d470ba9ee4b1695502d4f/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:43.321970 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e4bb1-d032-4a9b-9341-3483833e7be5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fd8191678fc41699f2d796ce761dd71, user_id=2a2474a9bb1d470ba9ee4b1695502d4f, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:43.324977 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781e4bb1-d032-4a9b-9341-3483833e7be5 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:43.349124 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 882/1781] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:20:43 2022] PUT /identity/v3/projects/7fd8191678fc41699f2d796ce761dd71/users/2a2474a9bb1d470ba9ee4b1695502d4f/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:20:43.353283 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba89513-a42b-4a3d-a0c3-abb7786f02db admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:43.366911 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ba89513-a42b-4a3d-a0c3-abb7786f02db admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:43.456106 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a69dafad-3272-4223-b85c-580cd36a04ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:43.456759 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69dafad-3272-4223-b85c-580cd36a04ab admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:43.457044 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69dafad-3272-4223-b85c-580cd36a04ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:43.457340 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a69dafad-3272-4223-b85c-580cd36a04ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:43.458136 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69dafad-3272-4223-b85c-580cd36a04ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:43.459983 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a69dafad-3272-4223-b85c-580cd36a04ab admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:43.476109 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 900/1782] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:20:43 2022] GET /identity/v3/roles => generated 1420 bytes in 123 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:20:43.480490 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e4bb1-d032-4a9b-9341-3483833e7be5 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:43.501237 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781e4bb1-d032-4a9b-9341-3483833e7be5 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:43.521778 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89dd33-a950-4ff8-afdd-fc9abe383004 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:43.522670 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89dd33-a950-4ff8-afdd-fc9abe383004 admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:43.523029 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89dd33-a950-4ff8-afdd-fc9abe383004 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:43.523558 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed89dd33-a950-4ff8-afdd-fc9abe383004 admin admin] PATH_INFO: `/v3/projects/7fd8191678fc41699f2d796ce761dd71/users/2a2474a9bb1d470ba9ee4b1695502d4f/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:43.526735 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed89dd33-a950-4ff8-afdd-fc9abe383004 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7fd8191678fc41699f2d796ce761dd71, user_id=2a2474a9bb1d470ba9ee4b1695502d4f, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:43.530678 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed89dd33-a950-4ff8-afdd-fc9abe383004 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:43.543724 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 883/1783] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:20:43 2022] PUT /identity/v3/projects/7fd8191678fc41699f2d796ce761dd71/users/2a2474a9bb1d470ba9ee4b1695502d4f/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:20:44.438937 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca581413-2fb0-4f19-8176-976a41d56013 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:44.439388 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca581413-2fb0-4f19-8176-976a41d56013 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:44.439630 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca581413-2fb0-4f19-8176-976a41d56013 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:44.500663 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:44.517806 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-ca581413-2fb0-4f19-8176-976a41d56013 None None] MFA Rules not processed for user `2a2474a9bb1d470ba9ee4b1695502d4f`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:44.519098 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-ca581413-2fb0-4f19-8176-976a41d56013 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:44.607610 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 901/1784] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:44 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:44.619487 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89dd33-a950-4ff8-afdd-fc9abe383004 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:44.694909 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:44.709059 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed89dd33-a950-4ff8-afdd-fc9abe383004 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:44.714923 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa841373-984b-48a3-8947-9285004e5363 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:44.715913 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa841373-984b-48a3-8947-9285004e5363 service cinder] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:44.717078 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa841373-984b-48a3-8947-9285004e5363 service cinder] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:44.717631 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa841373-984b-48a3-8947-9285004e5363 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:44.817304 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa841373-984b-48a3-8947-9285004e5363 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:44.822582 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa841373-984b-48a3-8947-9285004e5363 service cinder] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:44.852197 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 884/1785] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:20:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:20:48.600547 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68d0fb-6ff8-49c4-beff-31d7d15e4e8b None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:48.601074 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68d0fb-6ff8-49c4-beff-31d7d15e4e8b None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:48.601074 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd68d0fb-6ff8-49c4-beff-31d7d15e4e8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:48.709773 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa841373-984b-48a3-8947-9285004e5363 service cinder] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:48.711712 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-fa841373-984b-48a3-8947-9285004e5363 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:48.735003 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa841373-984b-48a3-8947-9285004e5363 service cinder] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:48.747071 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02beb14c-5562-4fea-8bd9-2fb9ca606372 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:48.748088 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02beb14c-5562-4fea-8bd9-2fb9ca606372 service cinder] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:48.748204 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-fd68d0fb-6ff8-49c4-beff-31d7d15e4e8b None None] MFA Rules not processed for user `36970f0778384576b599cd7217b5084d`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:48.748582 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02beb14c-5562-4fea-8bd9-2fb9ca606372 service cinder] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:48.749035 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02beb14c-5562-4fea-8bd9-2fb9ca606372 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:48.750222 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-fd68d0fb-6ff8-49c4-beff-31d7d15e4e8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:48.770837 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02beb14c-5562-4fea-8bd9-2fb9ca606372 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:48.773822 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02beb14c-5562-4fea-8bd9-2fb9ca606372 service cinder] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:48.802555 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 885/1786] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:20:48 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:20:48.914962 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 902/1787] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Aug 5 02:20:48 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:20:49.240453 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02beb14c-5562-4fea-8bd9-2fb9ca606372 service cinder] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:49.243931 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-02beb14c-5562-4fea-8bd9-2fb9ca606372 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:49.366795 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0bfee-00c5-40c3-9027-fa55a2b4fe16 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:49.367225 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0bfee-00c5-40c3-9027-fa55a2b4fe16 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:49.367728 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0bfee-00c5-40c3-9027-fa55a2b4fe16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:49.441696 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-a6f0bfee-00c5-40c3-9027-fa55a2b4fe16 None None] MFA Rules not processed for user `f81daf3da9b34e7380c61005019a53bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:49.452095 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-a6f0bfee-00c5-40c3-9027-fa55a2b4fe16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:49.664160 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02beb14c-5562-4fea-8bd9-2fb9ca606372 service cinder] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:49.704229 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780a649-83b4-404a-b284-380afdca1332 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f03233b0ee3540cdb5105f6603cfdff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:49.708015 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 903/1788] 10.222.0.45 () {58 vars in 1015 bytes} [Fri Aug 5 02:20:49 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 342 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:20:49.710443 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780a649-83b4-404a-b284-380afdca1332 service swift] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:49.710825 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780a649-83b4-404a-b284-380afdca1332 service swift] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:49.711063 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780a649-83b4-404a-b284-380afdca1332 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:49.765045 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0bfee-00c5-40c3-9027-fa55a2b4fe16 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:49.804583 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780a649-83b4-404a-b284-380afdca1332 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:49.806397 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3780a649-83b4-404a-b284-380afdca1332 service swift] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:49.813218 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0bfee-00c5-40c3-9027-fa55a2b4fe16 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:49.825639 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec3a21c-799e-48d6-bf63-541d4b90098b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:49.826296 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3a21c-799e-48d6-bf63-541d4b90098b service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:49.826594 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3a21c-799e-48d6-bf63-541d4b90098b service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:49.826857 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec3a21c-799e-48d6-bf63-541d4b90098b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:49.834740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 886/1789] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Aug 5 02:20:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 597 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 02:20:49.850702 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec3a21c-799e-48d6-bf63-541d4b90098b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:49.853203 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bec3a21c-799e-48d6-bf63-541d4b90098b service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:49.875147 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 904/1790] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:20:49 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:20:52.416351 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780a649-83b4-404a-b284-380afdca1332 service swift] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:52.572787 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:52.581685 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780a649-83b4-404a-b284-380afdca1332 service swift] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:52.589889 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf233b3-5932-4ad7-8dae-a31404708f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:52.591114 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf233b3-5932-4ad7-8dae-a31404708f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:52.591762 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf233b3-5932-4ad7-8dae-a31404708f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:52.592275 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf233b3-5932-4ad7-8dae-a31404708f59 admin admin] PATH_INFO: `/v3/users/4379b624ca084ca288bbf1d068c9ff49` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:52.593783 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf233b3-5932-4ad7-8dae-a31404708f59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4379b624ca084ca288bbf1d068c9ff49)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:52.599730 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf233b3-5932-4ad7-8dae-a31404708f59 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:52.738911 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-4bf233b3-5932-4ad7-8dae-a31404708f59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4379b624ca084ca288bbf1d068c9ff49'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:52.785254 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-4bf233b3-5932-4ad7-8dae-a31404708f59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4379b624ca084ca288bbf1d068c9ff49'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:52.791070 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-4bf233b3-5932-4ad7-8dae-a31404708f59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4379b624ca084ca288bbf1d068c9ff49'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:52.793080 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-4bf233b3-5932-4ad7-8dae-a31404708f59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4379b624ca084ca288bbf1d068c9ff49'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:52.819433 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-4bf233b3-5932-4ad7-8dae-a31404708f59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4379b624ca084ca288bbf1d068c9ff49'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:52.908940 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 887/1791] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:20:52 2022] DELETE /identity/v3/users/4379b624ca084ca288bbf1d068c9ff49 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:20:52.913952 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d4ae1-e0ff-46d7-815d-576d27544116 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:52.914848 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d4ae1-e0ff-46d7-815d-576d27544116 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:52.915275 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3d4ae1-e0ff-46d7-815d-576d27544116 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:52.925747 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:52.978311 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-eb3d4ae1-e0ff-46d7-815d-576d27544116 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:52.985687 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-eb3d4ae1-e0ff-46d7-815d-576d27544116 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:53.228850 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 905/1792] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:20:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:53.390986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf233b3-5932-4ad7-8dae-a31404708f59 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:53.393190 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-4bf233b3-5932-4ad7-8dae-a31404708f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:53.564763 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf233b3-5932-4ad7-8dae-a31404708f59 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:53.570593 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3b5fbc-b758-4b12-ba86-af3e0b1ef777 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:53.571518 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b5fbc-b758-4b12-ba86-af3e0b1ef777 service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:53.572420 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b5fbc-b758-4b12-ba86-af3e0b1ef777 service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:53.572420 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3b5fbc-b758-4b12-ba86-af3e0b1ef777 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:53.614144 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b5fbc-b758-4b12-ba86-af3e0b1ef777 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:53.615791 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3b5fbc-b758-4b12-ba86-af3e0b1ef777 service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:53.670777 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 888/1793] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:20:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 275 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:20:56.133886 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c251a28-06aa-484b-a7e9-d57874d24a1e None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:56.134849 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c251a28-06aa-484b-a7e9-d57874d24a1e None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:56.135391 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c251a28-06aa-484b-a7e9-d57874d24a1e None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:56.137075 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 906/1794] 10.222.0.15 () {54 vars in 921 bytes} [Fri Aug 5 02:20:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:20:56.170298 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f674a1-ad72-4a43-ad96-40626f14f06c None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:56.170903 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f674a1-ad72-4a43-ad96-40626f14f06c None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:56.170903 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f674a1-ad72-4a43-ad96-40626f14f06c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:56.215169 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-c6f674a1-ad72-4a43-ad96-40626f14f06c None None] MFA Rules not processed for user `4b5c0958604b436daa44b1f67c9dec26`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:56.217569 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-c6f674a1-ad72-4a43-ad96-40626f14f06c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:56.398264 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 889/1795] 10.222.0.15 () {58 vars in 1018 bytes} [Fri Aug 5 02:20:56 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:57.415304 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c251a28-06aa-484b-a7e9-d57874d24a1e None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:57.418491 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-5c251a28-06aa-484b-a7e9-d57874d24a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:57.478640 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c251a28-06aa-484b-a7e9-d57874d24a1e None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:57.492654 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6c695-82c6-4f5c-b3d3-9f64ce4dc932 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:57.494798 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6c695-82c6-4f5c-b3d3-9f64ce4dc932 service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:57.495431 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6c695-82c6-4f5c-b3d3-9f64ce4dc932 service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:57.495825 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa6c695-82c6-4f5c-b3d3-9f64ce4dc932 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:57.515269 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757bad14-2d51-40d1-b3f0-ad7a2cb6460b None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:57.515869 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757bad14-2d51-40d1-b3f0-ad7a2cb6460b None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:57.515869 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757bad14-2d51-40d1-b3f0-ad7a2cb6460b None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:57.518095 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 890/1796] 10.222.0.15 () {54 vars in 921 bytes} [Fri Aug 5 02:20:57 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:20:57.540735 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa6c695-82c6-4f5c-b3d3-9f64ce4dc932 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:57.545022 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa6c695-82c6-4f5c-b3d3-9f64ce4dc932 service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:57.550880 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2830e8e-a1db-4805-bc13-8c60d299930f None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:57.551131 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2830e8e-a1db-4805-bc13-8c60d299930f None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:57.551635 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2830e8e-a1db-4805-bc13-8c60d299930f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:57.567378 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 907/1797] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:20:57 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:20:57.587230 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6c695-82c6-4f5c-b3d3-9f64ce4dc932 service nova] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:57.592694 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-7fa6c695-82c6-4f5c-b3d3-9f64ce4dc932 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:57.594718 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-f2830e8e-a1db-4805-bc13-8c60d299930f None None] MFA Rules not processed for user `4b5c0958604b436daa44b1f67c9dec26`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:20:57.595942 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-f2830e8e-a1db-4805-bc13-8c60d299930f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:57.618206 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa6c695-82c6-4f5c-b3d3-9f64ce4dc932 service nova] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:57.620729 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 891/1798] 10.222.0.15 () {58 vars in 1018 bytes} [Fri Aug 5 02:20:57 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:20:57.646116 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0de9c9-944c-45c2-ac1a-07525fb23285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:57.647333 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0de9c9-944c-45c2-ac1a-07525fb23285 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:57.647850 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0de9c9-944c-45c2-ac1a-07525fb23285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:57.653756 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c0de9c9-944c-45c2-ac1a-07525fb23285 admin admin] PATH_INFO: `/v3/projects/2de8d8949f7c4c599cc404cafc591721` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:57.660010 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0de9c9-944c-45c2-ac1a-07525fb23285 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2de8d8949f7c4c599cc404cafc591721)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:57.667622 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c0de9c9-944c-45c2-ac1a-07525fb23285 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:57.821935 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9c0de9c9-944c-45c2-ac1a-07525fb23285 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2de8d8949f7c4c599cc404cafc591721', 'request_id': 'req-9c0de9c9-944c-45c2-ac1a-07525fb23285'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:57.842324 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9c0de9c9-944c-45c2-ac1a-07525fb23285 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2de8d8949f7c4c599cc404cafc591721', 'request_id': 'req-9c0de9c9-944c-45c2-ac1a-07525fb23285'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:57.857292 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9c0de9c9-944c-45c2-ac1a-07525fb23285 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2de8d8949f7c4c599cc404cafc591721', 'request_id': 'req-9c0de9c9-944c-45c2-ac1a-07525fb23285'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:57.884478 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9c0de9c9-944c-45c2-ac1a-07525fb23285 admin admin] The token cache is being invalidate because project 2de8d8949f7c4c599cc404cafc591721 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:20:57.885917 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9c0de9c9-944c-45c2-ac1a-07525fb23285 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:57.887010 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9c0de9c9-944c-45c2-ac1a-07525fb23285 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:57.892465 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 908/1799] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:20:57 2022] DELETE /identity/v3/projects/2de8d8949f7c4c599cc404cafc591721 => generated 0 bytes in 306 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:20:57.904434 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2830e8e-a1db-4805-bc13-8c60d299930f None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:57.909882 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:57.920119 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2830e8e-a1db-4805-bc13-8c60d299930f None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:58.053156 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f40672-6253-41b8-b76e-90f7b2662760 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:58.054326 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f40672-6253-41b8-b76e-90f7b2662760 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:58.054798 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f40672-6253-41b8-b76e-90f7b2662760 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:58.055689 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f40672-6253-41b8-b76e-90f7b2662760 admin admin] PATH_INFO: `/v3/users/f9052b0ab26346f4937357d67bd60e09` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:58.057293 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f40672-6253-41b8-b76e-90f7b2662760 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f9052b0ab26346f4937357d67bd60e09)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:58.062475 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f40672-6253-41b8-b76e-90f7b2662760 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:58.092859 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0de9c9-944c-45c2-ac1a-07525fb23285 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:20:58.094286 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9c0de9c9-944c-45c2-ac1a-07525fb23285 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:58.243005 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-13f40672-6253-41b8-b76e-90f7b2662760 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f9052b0ab26346f4937357d67bd60e09'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:58.287097 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-13f40672-6253-41b8-b76e-90f7b2662760 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f9052b0ab26346f4937357d67bd60e09'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:58.296238 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-13f40672-6253-41b8-b76e-90f7b2662760 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f9052b0ab26346f4937357d67bd60e09'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:58.297823 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-13f40672-6253-41b8-b76e-90f7b2662760 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f9052b0ab26346f4937357d67bd60e09'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:58.315994 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-13f40672-6253-41b8-b76e-90f7b2662760 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f9052b0ab26346f4937357d67bd60e09'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:20:58.360919 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c0de9c9-944c-45c2-ac1a-07525fb23285 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:20:58.368411 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 892/1800] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:20:57 2022] DELETE /identity/v3/users/f9052b0ab26346f4937357d67bd60e09 => generated 0 bytes in 472 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:20:58.394406 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:20:58.535028 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae2364b-a7be-4b3a-aa30-ecbd39f8e9a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:20:58.535028 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2364b-a7be-4b3a-aa30-ecbd39f8e9a0 service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:20:58.535028 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2364b-a7be-4b3a-aa30-ecbd39f8e9a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:20:58.535028 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae2364b-a7be-4b3a-aa30-ecbd39f8e9a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:20:58.543300 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-3ae2364b-a7be-4b3a-aa30-ecbd39f8e9a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:20:58.567564 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae2364b-a7be-4b3a-aa30-ecbd39f8e9a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:20:58.574562 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae2364b-a7be-4b3a-aa30-ecbd39f8e9a0 service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:20:58.610513 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 909/1801] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:20:58 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:21:00.089883 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f40672-6253-41b8-b76e-90f7b2662760 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:00.091997 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-13f40672-6253-41b8-b76e-90f7b2662760 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:00.241111 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f40672-6253-41b8-b76e-90f7b2662760 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:00.255295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd7472e-9075-41f4-91cd-0e2d49c9967e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:00.256399 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7472e-9075-41f4-91cd-0e2d49c9967e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:00.256897 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7472e-9075-41f4-91cd-0e2d49c9967e admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:00.257504 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd7472e-9075-41f4-91cd-0e2d49c9967e admin admin] PATH_INFO: `/v3/projects/9e32123b50044aea9e1ad0c30da629d2` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:00.259898 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7472e-9075-41f4-91cd-0e2d49c9967e admin admin] RBAC: Authorizing `identity:delete_project(project_id=9e32123b50044aea9e1ad0c30da629d2)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:00.263477 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd7472e-9075-41f4-91cd-0e2d49c9967e admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:00.308915 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:00.341967 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-5cd7472e-9075-41f4-91cd-0e2d49c9967e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9e32123b50044aea9e1ad0c30da629d2', 'request_id': 'req-5cd7472e-9075-41f4-91cd-0e2d49c9967e'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:00.349094 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-5cd7472e-9075-41f4-91cd-0e2d49c9967e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9e32123b50044aea9e1ad0c30da629d2', 'request_id': 'req-5cd7472e-9075-41f4-91cd-0e2d49c9967e'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:00.369317 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-5cd7472e-9075-41f4-91cd-0e2d49c9967e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9e32123b50044aea9e1ad0c30da629d2', 'request_id': 'req-5cd7472e-9075-41f4-91cd-0e2d49c9967e'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:00.390400 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-5cd7472e-9075-41f4-91cd-0e2d49c9967e admin admin] The token cache is being invalidate because project 9e32123b50044aea9e1ad0c30da629d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:21:00.390760 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-5cd7472e-9075-41f4-91cd-0e2d49c9967e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:00.391421 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-5cd7472e-9075-41f4-91cd-0e2d49c9967e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:00.393103 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 893/1802] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:21:00 2022] DELETE /identity/v3/projects/9e32123b50044aea9e1ad0c30da629d2 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:21:00.398685 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600c29e-d714-428d-8b63-4f427db6e080 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:00.399195 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600c29e-d714-428d-8b63-4f427db6e080 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:00.399946 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7600c29e-d714-428d-8b63-4f427db6e080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:00.420925 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-7600c29e-d714-428d-8b63-4f427db6e080 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:21:00.422298 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-7600c29e-d714-428d-8b63-4f427db6e080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:00.504553 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 910/1803] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:21:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:21:00.512346 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3170a-f3e7-458b-9c10-1736a6fd0d1d None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:00.513177 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3170a-f3e7-458b-9c10-1736a6fd0d1d None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:00.513916 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae3170a-f3e7-458b-9c10-1736a6fd0d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:00.537646 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-6ae3170a-f3e7-458b-9c10-1736a6fd0d1d None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:21:00.539488 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-6ae3170a-f3e7-458b-9c10-1736a6fd0d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:00.549874 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 894/1804] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:21:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:21:00.554404 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600c29e-d714-428d-8b63-4f427db6e080 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:00.567338 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7600c29e-d714-428d-8b63-4f427db6e080 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:00.574185 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315ce0c-1cad-4e63-adbb-055de3e178e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:00.575731 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315ce0c-1cad-4e63-adbb-055de3e178e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:00.576150 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315ce0c-1cad-4e63-adbb-055de3e178e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:00.576709 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a315ce0c-1cad-4e63-adbb-055de3e178e2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:00.577233 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a315ce0c-1cad-4e63-adbb-055de3e178e2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:21:00.577568 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a315ce0c-1cad-4e63-adbb-055de3e178e2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:00.579574 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a315ce0c-1cad-4e63-adbb-055de3e178e2 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:00.593014 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 911/1805] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:21:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:21:00.597552 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae3170a-f3e7-458b-9c10-1736a6fd0d1d None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:00.608586 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae3170a-f3e7-458b-9c10-1736a6fd0d1d None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:00.614018 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed5530-84cc-4d30-9cb7-067558a9463e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:00.614766 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed5530-84cc-4d30-9cb7-067558a9463e admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:00.615170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed5530-84cc-4d30-9cb7-067558a9463e admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:00.615506 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aed5530-84cc-4d30-9cb7-067558a9463e admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:00.616431 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed5530-84cc-4d30-9cb7-067558a9463e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:00.618580 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aed5530-84cc-4d30-9cb7-067558a9463e admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:00.660360 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 895/1806] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:21:00 2022] POST /identity/v3/projects => generated 383 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:21:00.664623 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315ce0c-1cad-4e63-adbb-055de3e178e2 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:00.675278 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a315ce0c-1cad-4e63-adbb-055de3e178e2 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:00.747427 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a2c53-ad6b-4251-8228-5c173fe60910 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:00.747693 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a2c53-ad6b-4251-8228-5c173fe60910 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:00.747874 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a2c53-ad6b-4251-8228-5c173fe60910 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:00.748148 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f34a2c53-ad6b-4251-8228-5c173fe60910 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:00.748852 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a2c53-ad6b-4251-8228-5c173fe60910 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:00.750747 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f34a2c53-ad6b-4251-8228-5c173fe60910 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:00.773393 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 912/1807] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:21:00 2022] POST /identity/v3/users => generated 292 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:21:00.777630 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed5530-84cc-4d30-9cb7-067558a9463e admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:00.789376 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aed5530-84cc-4d30-9cb7-067558a9463e admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:00.794236 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf59ab-ce4e-43e1-b4ef-a3c5adaa067d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:00.794846 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf59ab-ce4e-43e1-b4ef-a3c5adaa067d admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:00.795124 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf59ab-ce4e-43e1-b4ef-a3c5adaa067d admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:00.795397 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcf59ab-ce4e-43e1-b4ef-a3c5adaa067d admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:00.796089 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf59ab-ce4e-43e1-b4ef-a3c5adaa067d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:00.797712 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcf59ab-ce4e-43e1-b4ef-a3c5adaa067d admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:00.807915 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 896/1808] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:21:00.812046 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a2c53-ad6b-4251-8228-5c173fe60910 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:00.821858 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f34a2c53-ad6b-4251-8228-5c173fe60910 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:00.827241 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafaadbf-6c97-4b97-aeaa-8097ce1eb297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:00.827868 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafaadbf-6c97-4b97-aeaa-8097ce1eb297 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:00.828129 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafaadbf-6c97-4b97-aeaa-8097ce1eb297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:00.828443 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafaadbf-6c97-4b97-aeaa-8097ce1eb297 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:00.829134 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafaadbf-6c97-4b97-aeaa-8097ce1eb297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:00.830703 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafaadbf-6c97-4b97-aeaa-8097ce1eb297 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:00.842607 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 913/1809] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:21:00.847267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf59ab-ce4e-43e1-b4ef-a3c5adaa067d admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:00.857151 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcf59ab-ce4e-43e1-b4ef-a3c5adaa067d admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:00.861649 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720af4c7-50d3-4056-a84a-62cd2525e712 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:00.862293 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720af4c7-50d3-4056-a84a-62cd2525e712 admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:00.862573 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720af4c7-50d3-4056-a84a-62cd2525e712 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:00.862849 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720af4c7-50d3-4056-a84a-62cd2525e712 admin admin] PATH_INFO: `/v3/projects/e0a3bb548cf848d688133b9c6c6c0b17/users/010644e34a3f49db915e273abb07c34b/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:00.877027 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720af4c7-50d3-4056-a84a-62cd2525e712 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e0a3bb548cf848d688133b9c6c6c0b17, user_id=010644e34a3f49db915e273abb07c34b, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:00.879647 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720af4c7-50d3-4056-a84a-62cd2525e712 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:00.893085 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 897/1810] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:21:00 2022] PUT /identity/v3/projects/e0a3bb548cf848d688133b9c6c6c0b17/users/010644e34a3f49db915e273abb07c34b/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:21:00.903946 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b01a8f-621d-4300-a841-747d4750bc34 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:00.904177 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b01a8f-621d-4300-a841-747d4750bc34 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:00.904565 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b01a8f-621d-4300-a841-747d4750bc34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:00.912564 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:00.933344 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-66b01a8f-621d-4300-a841-747d4750bc34 None None] MFA Rules not processed for user `010644e34a3f49db915e273abb07c34b`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:21:00.934602 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-66b01a8f-621d-4300-a841-747d4750bc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:01.004991 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 914/1811] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:21:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:21:01.009611 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720af4c7-50d3-4056-a84a-62cd2525e712 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:01.079774 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720af4c7-50d3-4056-a84a-62cd2525e712 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:01.084647 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95af3cf-4ec5-41ad-9c48-93550a486159 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:01.085274 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95af3cf-4ec5-41ad-9c48-93550a486159 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:01.085603 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95af3cf-4ec5-41ad-9c48-93550a486159 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:01.085886 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c95af3cf-4ec5-41ad-9c48-93550a486159 admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:01.086552 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95af3cf-4ec5-41ad-9c48-93550a486159 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:01.088622 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c95af3cf-4ec5-41ad-9c48-93550a486159 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:01.126318 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 898/1812] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:21:01 2022] POST /identity/v3/projects => generated 383 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:21:01.130363 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b01a8f-621d-4300-a841-747d4750bc34 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:01.142839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b01a8f-621d-4300-a841-747d4750bc34 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:01.210465 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0074201b-cae4-4c49-b85f-23a41bec0d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:01.211204 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074201b-cae4-4c49-b85f-23a41bec0d93 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:01.211598 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074201b-cae4-4c49-b85f-23a41bec0d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:01.211733 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0074201b-cae4-4c49-b85f-23a41bec0d93 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:01.212595 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0074201b-cae4-4c49-b85f-23a41bec0d93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:01.214833 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0074201b-cae4-4c49-b85f-23a41bec0d93 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:01.259285 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 915/1813] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:21:01 2022] POST /identity/v3/users => generated 298 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:21:01.260130 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95af3cf-4ec5-41ad-9c48-93550a486159 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:01.272458 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c95af3cf-4ec5-41ad-9c48-93550a486159 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:01.279854 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707aa1e-dc62-44dd-a802-b5df3c8f3894 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:01.280689 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707aa1e-dc62-44dd-a802-b5df3c8f3894 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:01.280889 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707aa1e-dc62-44dd-a802-b5df3c8f3894 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:01.281238 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707aa1e-dc62-44dd-a802-b5df3c8f3894 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:01.282233 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3707aa1e-dc62-44dd-a802-b5df3c8f3894 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:01.283830 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3707aa1e-dc62-44dd-a802-b5df3c8f3894 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:01.299910 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 899/1814] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:21:01.310065 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0074201b-cae4-4c49-b85f-23a41bec0d93 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:01.320083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0074201b-cae4-4c49-b85f-23a41bec0d93 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:01.324803 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c99db-a19d-41f7-afed-7feaea12afb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:01.326174 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c99db-a19d-41f7-afed-7feaea12afb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:01.326564 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c99db-a19d-41f7-afed-7feaea12afb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:01.326841 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878c99db-a19d-41f7-afed-7feaea12afb1 admin admin] PATH_INFO: `/v3/projects/62a5b7c5c5b44f109a19ec9ff17f0863/users/80985c9ebda7496ea58f6ea377498f0c/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:01.341814 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878c99db-a19d-41f7-afed-7feaea12afb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62a5b7c5c5b44f109a19ec9ff17f0863, user_id=80985c9ebda7496ea58f6ea377498f0c, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:01.344469 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878c99db-a19d-41f7-afed-7feaea12afb1 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:01.357568 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 916/1815] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:21:01 2022] PUT /identity/v3/projects/62a5b7c5c5b44f109a19ec9ff17f0863/users/80985c9ebda7496ea58f6ea377498f0c/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:21:01.361526 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707aa1e-dc62-44dd-a802-b5df3c8f3894 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:01.372524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3707aa1e-dc62-44dd-a802-b5df3c8f3894 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:01.396294 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=90,keystone:DELETE=6,keystone:INSERT=4 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:01.440737 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d3ffe7-72a8-4024-8c81-b80061a02ebf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:01.441354 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3ffe7-72a8-4024-8c81-b80061a02ebf admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:01.441635 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3ffe7-72a8-4024-8c81-b80061a02ebf admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:01.441906 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d3ffe7-72a8-4024-8c81-b80061a02ebf admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:01.442599 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d3ffe7-72a8-4024-8c81-b80061a02ebf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:01.444189 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d3ffe7-72a8-4024-8c81-b80061a02ebf admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:01.454486 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 900/1816] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:21:01 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:21:01.458895 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c99db-a19d-41f7-afed-7feaea12afb1 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:01.469552 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878c99db-a19d-41f7-afed-7feaea12afb1 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:01.474336 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1386b9-3106-4b3c-b825-1755f1793322 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:01.475005 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1386b9-3106-4b3c-b825-1755f1793322 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:01.475287 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1386b9-3106-4b3c-b825-1755f1793322 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:01.475563 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1386b9-3106-4b3c-b825-1755f1793322 admin admin] PATH_INFO: `/v3/projects/62a5b7c5c5b44f109a19ec9ff17f0863/users/80985c9ebda7496ea58f6ea377498f0c/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:01.477587 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1386b9-3106-4b3c-b825-1755f1793322 admin admin] RBAC: Authorizing `identity:create_grant(project_id=62a5b7c5c5b44f109a19ec9ff17f0863, user_id=80985c9ebda7496ea58f6ea377498f0c, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:01.480244 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1386b9-3106-4b3c-b825-1755f1793322 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:01.491440 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 917/1817] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:21:01 2022] PUT /identity/v3/projects/62a5b7c5c5b44f109a19ec9ff17f0863/users/80985c9ebda7496ea58f6ea377498f0c/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:21:01.504293 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65b590-f66e-4b76-b703-71b54c472ece None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:01.504632 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65b590-f66e-4b76-b703-71b54c472ece None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:01.504916 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c65b590-f66e-4b76-b703-71b54c472ece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:01.536171 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-6c65b590-f66e-4b76-b703-71b54c472ece None None] MFA Rules not processed for user `80985c9ebda7496ea58f6ea377498f0c`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:21:01.537455 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-6c65b590-f66e-4b76-b703-71b54c472ece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:01.618518 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 901/1818] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:21:01 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:21:01.634943 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1386b9-3106-4b3c-b825-1755f1793322 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:01.637615 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-5a1386b9-3106-4b3c-b825-1755f1793322 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:01.702597 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:01.709299 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1386b9-3106-4b3c-b825-1755f1793322 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:01.713401 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7b94f-d59e-41e9-8e38-33bf23f96552 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:01.714050 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7b94f-d59e-41e9-8e38-33bf23f96552 service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:01.714328 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7b94f-d59e-41e9-8e38-33bf23f96552 service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:01.714605 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b7b94f-d59e-41e9-8e38-33bf23f96552 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:01.726952 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b7b94f-d59e-41e9-8e38-33bf23f96552 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:01.728480 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b7b94f-d59e-41e9-8e38-33bf23f96552 service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:01.743503 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 918/1819] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:21:01 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:21:01.871889 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c65b590-f66e-4b76-b703-71b54c472ece None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:01.882147 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c65b590-f66e-4b76-b703-71b54c472ece None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:01.886613 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f167edf8-d7eb-4be4-b2c3-62c1c6e8fb20 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:01.886857 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167edf8-d7eb-4be4-b2c3-62c1c6e8fb20 service cinder] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:01.887197 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167edf8-d7eb-4be4-b2c3-62c1c6e8fb20 service cinder] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:01.887785 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f167edf8-d7eb-4be4-b2c3-62c1c6e8fb20 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:01.954679 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167edf8-d7eb-4be4-b2c3-62c1c6e8fb20 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:01.956225 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f167edf8-d7eb-4be4-b2c3-62c1c6e8fb20 service cinder] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:01.967288 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 902/1820] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:21:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:21:02.227090 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7b94f-d59e-41e9-8e38-33bf23f96552 service cinder] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:02.288595 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b7b94f-d59e-41e9-8e38-33bf23f96552 service cinder] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:02.293106 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a1295-3ffe-4f15-ab9d-731d9a103a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:02.293855 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a1295-3ffe-4f15-ab9d-731d9a103a21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:02.294150 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a1295-3ffe-4f15-ab9d-731d9a103a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:02.294411 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-428a1295-3ffe-4f15-ab9d-731d9a103a21 admin admin] PATH_INFO: `/v3/users/010644e34a3f49db915e273abb07c34b` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:02.295615 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a1295-3ffe-4f15-ab9d-731d9a103a21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=010644e34a3f49db915e273abb07c34b)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:02.297602 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-428a1295-3ffe-4f15-ab9d-731d9a103a21 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:02.358678 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-428a1295-3ffe-4f15-ab9d-731d9a103a21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '010644e34a3f49db915e273abb07c34b'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:02.375449 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-428a1295-3ffe-4f15-ab9d-731d9a103a21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '010644e34a3f49db915e273abb07c34b'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:02.376198 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-428a1295-3ffe-4f15-ab9d-731d9a103a21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '010644e34a3f49db915e273abb07c34b'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:02.377084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-428a1295-3ffe-4f15-ab9d-731d9a103a21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '010644e34a3f49db915e273abb07c34b'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:02.386076 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-428a1295-3ffe-4f15-ab9d-731d9a103a21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '010644e34a3f49db915e273abb07c34b'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:02.408268 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 919/1821] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:21:02 2022] DELETE /identity/v3/users/010644e34a3f49db915e273abb07c34b => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:21:02.409346 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a3983-43fc-4d2b-8db2-5fa0f079ddb4 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:02.410378 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a3983-43fc-4d2b-8db2-5fa0f079ddb4 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:02.410726 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83a3983-43fc-4d2b-8db2-5fa0f079ddb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:02.432466 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-b83a3983-43fc-4d2b-8db2-5fa0f079ddb4 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:21:02.433969 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-b83a3983-43fc-4d2b-8db2-5fa0f079ddb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:02.484046 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:02.511415 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 903/1822] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:21:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:21:02.519999 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a1295-3ffe-4f15-ab9d-731d9a103a21 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:02.521927 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-428a1295-3ffe-4f15-ab9d-731d9a103a21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:02.614412 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-428a1295-3ffe-4f15-ab9d-731d9a103a21 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:02.618405 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67000a33-44c8-4ee6-9ab2-acbf26b8b481 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:02.619533 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67000a33-44c8-4ee6-9ab2-acbf26b8b481 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:02.624578 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67000a33-44c8-4ee6-9ab2-acbf26b8b481 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:02.628503 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67000a33-44c8-4ee6-9ab2-acbf26b8b481 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:02.646269 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67000a33-44c8-4ee6-9ab2-acbf26b8b481 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:02.647726 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67000a33-44c8-4ee6-9ab2-acbf26b8b481 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:02.663000 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 920/1823] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:21:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:21:03.011156 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a3983-43fc-4d2b-8db2-5fa0f079ddb4 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:03.013619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-b83a3983-43fc-4d2b-8db2-5fa0f079ddb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:03.029141 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83a3983-43fc-4d2b-8db2-5fa0f079ddb4 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:03.035336 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e2e6a-54c4-4b29-a263-c411bebd77ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:03.036353 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e2e6a-54c4-4b29-a263-c411bebd77ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:03.036681 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e2e6a-54c4-4b29-a263-c411bebd77ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:03.037086 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1e2e6a-54c4-4b29-a263-c411bebd77ec admin admin] PATH_INFO: `/v3/projects/e0a3bb548cf848d688133b9c6c6c0b17` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:03.038428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e2e6a-54c4-4b29-a263-c411bebd77ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=e0a3bb548cf848d688133b9c6c6c0b17)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:03.040663 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1e2e6a-54c4-4b29-a263-c411bebd77ec admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:03.118235 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-1a1e2e6a-54c4-4b29-a263-c411bebd77ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e0a3bb548cf848d688133b9c6c6c0b17', 'request_id': 'req-1a1e2e6a-54c4-4b29-a263-c411bebd77ec'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:03.124725 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-1a1e2e6a-54c4-4b29-a263-c411bebd77ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e0a3bb548cf848d688133b9c6c6c0b17', 'request_id': 'req-1a1e2e6a-54c4-4b29-a263-c411bebd77ec'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:03.134374 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-1a1e2e6a-54c4-4b29-a263-c411bebd77ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e0a3bb548cf848d688133b9c6c6c0b17', 'request_id': 'req-1a1e2e6a-54c4-4b29-a263-c411bebd77ec'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:03.150504 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-1a1e2e6a-54c4-4b29-a263-c411bebd77ec admin admin] The token cache is being invalidate because project e0a3bb548cf848d688133b9c6c6c0b17 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:21:03.150914 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-1a1e2e6a-54c4-4b29-a263-c411bebd77ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:03.152085 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-1a1e2e6a-54c4-4b29-a263-c411bebd77ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:03.155587 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 904/1824] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:21:03 2022] DELETE /identity/v3/projects/e0a3bb548cf848d688133b9c6c6c0b17 => generated 0 bytes in 145 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:21:03.160285 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67000a33-44c8-4ee6-9ab2-acbf26b8b481 service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:03.170536 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67000a33-44c8-4ee6-9ab2-acbf26b8b481 service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:03.179485 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:03.262889 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f635f-9592-4eab-b1c1-6d596a0e2310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:03.263549 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f635f-9592-4eab-b1c1-6d596a0e2310 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:03.263831 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f635f-9592-4eab-b1c1-6d596a0e2310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:03.264436 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f635f-9592-4eab-b1c1-6d596a0e2310 admin admin] PATH_INFO: `/v3/users/80985c9ebda7496ea58f6ea377498f0c` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:03.265870 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f635f-9592-4eab-b1c1-6d596a0e2310 admin admin] RBAC: Authorizing `identity:delete_user(user_id=80985c9ebda7496ea58f6ea377498f0c)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:03.268572 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f635f-9592-4eab-b1c1-6d596a0e2310 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:03.324136 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-165f635f-9592-4eab-b1c1-6d596a0e2310 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '80985c9ebda7496ea58f6ea377498f0c'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:03.343362 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-165f635f-9592-4eab-b1c1-6d596a0e2310 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '80985c9ebda7496ea58f6ea377498f0c'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:03.344476 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-165f635f-9592-4eab-b1c1-6d596a0e2310 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '80985c9ebda7496ea58f6ea377498f0c'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:03.345327 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-165f635f-9592-4eab-b1c1-6d596a0e2310 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '80985c9ebda7496ea58f6ea377498f0c'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:03.358592 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-165f635f-9592-4eab-b1c1-6d596a0e2310 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '80985c9ebda7496ea58f6ea377498f0c'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:03.376377 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 921/1825] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:21:03 2022] DELETE /identity/v3/users/80985c9ebda7496ea58f6ea377498f0c => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:21:04.092416 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e2e6a-54c4-4b29-a263-c411bebd77ec admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:04.094242 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-1a1e2e6a-54c4-4b29-a263-c411bebd77ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:04.122181 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1e2e6a-54c4-4b29-a263-c411bebd77ec admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:04.185949 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2e558-e570-4371-ab32-9fe5b3a2df1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:04.186703 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2e558-e570-4371-ab32-9fe5b3a2df1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:04.187111 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2e558-e570-4371-ab32-9fe5b3a2df1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:04.187516 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2e558-e570-4371-ab32-9fe5b3a2df1c admin admin] PATH_INFO: `/v3/projects/62a5b7c5c5b44f109a19ec9ff17f0863` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:04.189020 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c2e558-e570-4371-ab32-9fe5b3a2df1c admin admin] RBAC: Authorizing `identity:delete_project(project_id=62a5b7c5c5b44f109a19ec9ff17f0863)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:04.191098 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c2e558-e570-4371-ab32-9fe5b3a2df1c admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:04.249747 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-f7c2e558-e570-4371-ab32-9fe5b3a2df1c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '62a5b7c5c5b44f109a19ec9ff17f0863', 'request_id': 'req-f7c2e558-e570-4371-ab32-9fe5b3a2df1c'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:04.257646 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-f7c2e558-e570-4371-ab32-9fe5b3a2df1c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '62a5b7c5c5b44f109a19ec9ff17f0863', 'request_id': 'req-f7c2e558-e570-4371-ab32-9fe5b3a2df1c'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:04.269001 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-f7c2e558-e570-4371-ab32-9fe5b3a2df1c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '62a5b7c5c5b44f109a19ec9ff17f0863', 'request_id': 'req-f7c2e558-e570-4371-ab32-9fe5b3a2df1c'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:04.271767 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:04.291706 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-f7c2e558-e570-4371-ab32-9fe5b3a2df1c admin admin] The token cache is being invalidate because project 62a5b7c5c5b44f109a19ec9ff17f0863 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:21:04.292137 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-f7c2e558-e570-4371-ab32-9fe5b3a2df1c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:04.293464 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-f7c2e558-e570-4371-ab32-9fe5b3a2df1c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:04.299786 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 905/1826] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:21:04 2022] DELETE /identity/v3/projects/62a5b7c5c5b44f109a19ec9ff17f0863 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:21:04.301189 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b7c0f-2b4f-4994-b18f-61522209a3b5 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:04.301652 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b7c0f-2b4f-4994-b18f-61522209a3b5 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:04.301763 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b7c0f-2b4f-4994-b18f-61522209a3b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:04.323943 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-e72b7c0f-2b4f-4994-b18f-61522209a3b5 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:21:04.325418 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-e72b7c0f-2b4f-4994-b18f-61522209a3b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:04.416975 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 922/1827] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:21:04.425518 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf34d4f-bc6b-4ed2-ae6f-5ab4d004e761 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:04.426048 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf34d4f-bc6b-4ed2-ae6f-5ab4d004e761 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:04.426333 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf34d4f-bc6b-4ed2-ae6f-5ab4d004e761 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:04.448313 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-1bf34d4f-bc6b-4ed2-ae6f-5ab4d004e761 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:21:04.449566 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-1bf34d4f-bc6b-4ed2-ae6f-5ab4d004e761 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:04.458825 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 906/1828] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:21:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:21:04.463221 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b7c0f-2b4f-4994-b18f-61522209a3b5 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:04.475365 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b7c0f-2b4f-4994-b18f-61522209a3b5 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:04.481009 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775484fe-98fc-47f4-81b8-5004d9430ac2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:04.481631 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775484fe-98fc-47f4-81b8-5004d9430ac2 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:04.482063 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775484fe-98fc-47f4-81b8-5004d9430ac2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:04.482343 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775484fe-98fc-47f4-81b8-5004d9430ac2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:04.483744 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775484fe-98fc-47f4-81b8-5004d9430ac2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:21:04.483744 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775484fe-98fc-47f4-81b8-5004d9430ac2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:04.485068 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775484fe-98fc-47f4-81b8-5004d9430ac2 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:04.497816 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 923/1829] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:21:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:21:04.508187 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf34d4f-bc6b-4ed2-ae6f-5ab4d004e761 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:04.518614 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf34d4f-bc6b-4ed2-ae6f-5ab4d004e761 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:04.523259 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc034ee2-fe10-4a34-855f-2b99656a52e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:04.523809 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc034ee2-fe10-4a34-855f-2b99656a52e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:04.524091 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc034ee2-fe10-4a34-855f-2b99656a52e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:04.524398 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc034ee2-fe10-4a34-855f-2b99656a52e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:04.525077 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc034ee2-fe10-4a34-855f-2b99656a52e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:04.527017 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc034ee2-fe10-4a34-855f-2b99656a52e7 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:04.554494 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 907/1830] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:21:04 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:21:04.558708 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775484fe-98fc-47f4-81b8-5004d9430ac2 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:04.568859 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775484fe-98fc-47f4-81b8-5004d9430ac2 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:04.582408 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:04.628595 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc59dae-0ee2-4076-aed4-6effbbead87c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:04.629224 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc59dae-0ee2-4076-aed4-6effbbead87c admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:04.629519 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc59dae-0ee2-4076-aed4-6effbbead87c admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:04.629822 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc59dae-0ee2-4076-aed4-6effbbead87c admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:04.630528 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc59dae-0ee2-4076-aed4-6effbbead87c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:04.632489 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc59dae-0ee2-4076-aed4-6effbbead87c admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:04.656102 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 924/1831] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:21:04 2022] POST /identity/v3/users => generated 293 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:21:04.660248 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc034ee2-fe10-4a34-855f-2b99656a52e7 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:04.670640 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc034ee2-fe10-4a34-855f-2b99656a52e7 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:04.675374 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ccceb-35ef-417d-85de-7eb743e75044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:04.675981 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ccceb-35ef-417d-85de-7eb743e75044 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:04.676282 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ccceb-35ef-417d-85de-7eb743e75044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:04.676572 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7ccceb-35ef-417d-85de-7eb743e75044 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:04.677264 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ccceb-35ef-417d-85de-7eb743e75044 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:04.678863 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7ccceb-35ef-417d-85de-7eb743e75044 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:04.689743 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 908/1832] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:21:04.694215 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc59dae-0ee2-4076-aed4-6effbbead87c admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:04.706669 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc59dae-0ee2-4076-aed4-6effbbead87c admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:04.711608 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce4bb5c-7aa6-4abe-ab96-b0ce2ba633fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:04.712266 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4bb5c-7aa6-4abe-ab96-b0ce2ba633fb admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:04.712599 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4bb5c-7aa6-4abe-ab96-b0ce2ba633fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:04.712900 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce4bb5c-7aa6-4abe-ab96-b0ce2ba633fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:04.713606 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce4bb5c-7aa6-4abe-ab96-b0ce2ba633fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:04.715224 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce4bb5c-7aa6-4abe-ab96-b0ce2ba633fb admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:04.727891 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 925/1833] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:21:04 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:21:04.732047 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ccceb-35ef-417d-85de-7eb743e75044 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:04.742185 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7ccceb-35ef-417d-85de-7eb743e75044 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:04.747131 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec8ec8-81d1-419d-8615-aaddfd1904e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:04.747786 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec8ec8-81d1-419d-8615-aaddfd1904e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:04.748068 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec8ec8-81d1-419d-8615-aaddfd1904e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:04.748891 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ec8ec8-81d1-419d-8615-aaddfd1904e3 admin admin] PATH_INFO: `/v3/projects/46dc6dea2e554deeb7b94bfd36c4815c/users/a244ffdcec494943b73786b9c6b02c60/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:04.763525 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec8ec8-81d1-419d-8615-aaddfd1904e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=46dc6dea2e554deeb7b94bfd36c4815c, user_id=a244ffdcec494943b73786b9c6b02c60, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:04.766779 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ec8ec8-81d1-419d-8615-aaddfd1904e3 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:04.779448 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 909/1834] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:21:04 2022] PUT /identity/v3/projects/46dc6dea2e554deeb7b94bfd36c4815c/users/a244ffdcec494943b73786b9c6b02c60/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:21:04.789614 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cf0a7-32bf-48b2-8ee4-43821eddfe3b None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:04.789901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cf0a7-32bf-48b2-8ee4-43821eddfe3b None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:04.790173 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425cf0a7-32bf-48b2-8ee4-43821eddfe3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:04.817594 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-425cf0a7-32bf-48b2-8ee4-43821eddfe3b None None] MFA Rules not processed for user `a244ffdcec494943b73786b9c6b02c60`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:21:04.818810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-425cf0a7-32bf-48b2-8ee4-43821eddfe3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:04.881805 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 926/1835] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:21:04 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:21:04.886268 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec8ec8-81d1-419d-8615-aaddfd1904e3 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:04.949403 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ec8ec8-81d1-419d-8615-aaddfd1904e3 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:04.954857 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192de5c-03bd-4b37-aa6e-64d501cf87b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:04.955567 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192de5c-03bd-4b37-aa6e-64d501cf87b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:04.955909 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192de5c-03bd-4b37-aa6e-64d501cf87b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:04.956187 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a192de5c-03bd-4b37-aa6e-64d501cf87b2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:04.956911 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a192de5c-03bd-4b37-aa6e-64d501cf87b2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:04.958813 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a192de5c-03bd-4b37-aa6e-64d501cf87b2 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:04.991525 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 910/1836] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:21:04 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:21:04.993097 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425cf0a7-32bf-48b2-8ee4-43821eddfe3b None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:05.013532 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425cf0a7-32bf-48b2-8ee4-43821eddfe3b None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:05.085939 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1653b-271c-4fc5-8cf4-8f2431030963 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:05.086696 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1653b-271c-4fc5-8cf4-8f2431030963 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:05.086979 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1653b-271c-4fc5-8cf4-8f2431030963 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:05.087251 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19f1653b-271c-4fc5-8cf4-8f2431030963 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:05.087914 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f1653b-271c-4fc5-8cf4-8f2431030963 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:05.089856 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19f1653b-271c-4fc5-8cf4-8f2431030963 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:05.119186 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 927/1837] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:21:04 2022] POST /identity/v3/users => generated 299 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:21:05.120347 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192de5c-03bd-4b37-aa6e-64d501cf87b2 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:05.139700 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a192de5c-03bd-4b37-aa6e-64d501cf87b2 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:05.145143 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdccc47-97cd-45ad-a552-30953e754af9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:05.146001 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdccc47-97cd-45ad-a552-30953e754af9 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:05.146467 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdccc47-97cd-45ad-a552-30953e754af9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:05.146948 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdccc47-97cd-45ad-a552-30953e754af9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:05.148523 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdccc47-97cd-45ad-a552-30953e754af9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:05.150199 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdccc47-97cd-45ad-a552-30953e754af9 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:05.165540 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 911/1838] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:21:05.169626 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1653b-271c-4fc5-8cf4-8f2431030963 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:05.179658 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19f1653b-271c-4fc5-8cf4-8f2431030963 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:05.187623 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8369706-0cfe-44a5-ab29-105bb3cd3da1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:05.188310 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8369706-0cfe-44a5-ab29-105bb3cd3da1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:05.188619 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8369706-0cfe-44a5-ab29-105bb3cd3da1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:05.188899 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8369706-0cfe-44a5-ab29-105bb3cd3da1 admin admin] PATH_INFO: `/v3/projects/5110a35e9f5f41339cb6e9c3c3dcfbbc/users/acdafda5caf4403cab9783e747d344d0/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:05.232448 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:05.238786 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8369706-0cfe-44a5-ab29-105bb3cd3da1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5110a35e9f5f41339cb6e9c3c3dcfbbc, user_id=acdafda5caf4403cab9783e747d344d0, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:05.242279 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8369706-0cfe-44a5-ab29-105bb3cd3da1 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:05.297695 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 928/1839] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:21:05 2022] PUT /identity/v3/projects/5110a35e9f5f41339cb6e9c3c3dcfbbc/users/acdafda5caf4403cab9783e747d344d0/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:21:05.300464 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdccc47-97cd-45ad-a552-30953e754af9 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:05.318810 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdccc47-97cd-45ad-a552-30953e754af9 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:05.387265 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8635d64-7440-4aa4-bacf-9cf8f023c46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:05.387887 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8635d64-7440-4aa4-bacf-9cf8f023c46d admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:05.388164 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8635d64-7440-4aa4-bacf-9cf8f023c46d admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:05.388476 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8635d64-7440-4aa4-bacf-9cf8f023c46d admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:05.389807 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8635d64-7440-4aa4-bacf-9cf8f023c46d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:05.391481 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8635d64-7440-4aa4-bacf-9cf8f023c46d admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:05.405274 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 912/1840] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:21:05 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:21:05.406588 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8369706-0cfe-44a5-ab29-105bb3cd3da1 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:05.416896 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8369706-0cfe-44a5-ab29-105bb3cd3da1 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:05.422734 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004f0f3-e22d-496d-82b8-2e9e08764edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:05.423424 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004f0f3-e22d-496d-82b8-2e9e08764edb admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:05.423712 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004f0f3-e22d-496d-82b8-2e9e08764edb admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:05.423992 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5004f0f3-e22d-496d-82b8-2e9e08764edb admin admin] PATH_INFO: `/v3/projects/5110a35e9f5f41339cb6e9c3c3dcfbbc/users/acdafda5caf4403cab9783e747d344d0/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:05.426065 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5004f0f3-e22d-496d-82b8-2e9e08764edb admin admin] RBAC: Authorizing `identity:create_grant(project_id=5110a35e9f5f41339cb6e9c3c3dcfbbc, user_id=acdafda5caf4403cab9783e747d344d0, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:05.428739 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5004f0f3-e22d-496d-82b8-2e9e08764edb admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:05.440072 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 929/1841] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:21:05 2022] PUT /identity/v3/projects/5110a35e9f5f41339cb6e9c3c3dcfbbc/users/acdafda5caf4403cab9783e747d344d0/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:21:05.451134 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40ab8a-9704-4cfc-9148-0e432de7c45c None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:05.451563 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40ab8a-9704-4cfc-9148-0e432de7c45c None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:05.451998 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab40ab8a-9704-4cfc-9148-0e432de7c45c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:05.459286 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:05.498279 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-ab40ab8a-9704-4cfc-9148-0e432de7c45c None None] MFA Rules not processed for user `acdafda5caf4403cab9783e747d344d0`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:21:05.500009 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-ab40ab8a-9704-4cfc-9148-0e432de7c45c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:05.605366 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 913/1842] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:21:05 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:21:05.618575 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004f0f3-e22d-496d-82b8-2e9e08764edb admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:05.620455 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-5004f0f3-e22d-496d-82b8-2e9e08764edb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:05.691112 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5004f0f3-e22d-496d-82b8-2e9e08764edb admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:05.694753 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c48ad15-80e1-45e3-816a-86249d473e91 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:05.695377 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48ad15-80e1-45e3-816a-86249d473e91 service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:05.695661 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48ad15-80e1-45e3-816a-86249d473e91 service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:05.695931 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c48ad15-80e1-45e3-816a-86249d473e91 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:05.754329 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c48ad15-80e1-45e3-816a-86249d473e91 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:05.755770 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c48ad15-80e1-45e3-816a-86249d473e91 service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:05.765204 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 930/1843] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:21:05 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:21:06.533761 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95dcfe-b0f1-47b9-8323-3d08f09b5da4 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:06.534295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95dcfe-b0f1-47b9-8323-3d08f09b5da4 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:06.534483 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c95dcfe-b0f1-47b9-8323-3d08f09b5da4 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:06.536001 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 914/1844] 10.222.0.15 () {54 vars in 921 bytes} [Fri Aug 5 02:21:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:21:06.564246 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1e369-e280-4d4f-b4f3-88387a94d1d5 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:06.564246 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1e369-e280-4d4f-b4f3-88387a94d1d5 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:06.564886 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b1e369-e280-4d4f-b4f3-88387a94d1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:06.590056 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-e0b1e369-e280-4d4f-b4f3-88387a94d1d5 None None] MFA Rules not processed for user `e84ea976b5914aea94c4d8f805139daf`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:21:06.591481 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-e0b1e369-e280-4d4f-b4f3-88387a94d1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:06.717446 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 931/1845] 10.222.0.15 () {58 vars in 1018 bytes} [Fri Aug 5 02:21:06 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:21:06.745546 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95dcfe-b0f1-47b9-8323-3d08f09b5da4 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:06.748145 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-4c95dcfe-b0f1-47b9-8323-3d08f09b5da4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:06.781231 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c95dcfe-b0f1-47b9-8323-3d08f09b5da4 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:06.787703 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323928c-1686-400a-8cff-dc674136ac98 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e84ea976b5914aea94c4d8f805139daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:06.788590 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323928c-1686-400a-8cff-dc674136ac98 service placement] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:06.788976 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323928c-1686-400a-8cff-dc674136ac98 service placement] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:06.789322 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4323928c-1686-400a-8cff-dc674136ac98 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:06.800204 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4323928c-1686-400a-8cff-dc674136ac98 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:06.802334 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4323928c-1686-400a-8cff-dc674136ac98 service placement] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:06.818488 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 915/1846] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:21:06 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:21:07.359908 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1e369-e280-4d4f-b4f3-88387a94d1d5 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:07.361429 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-e0b1e369-e280-4d4f-b4f3-88387a94d1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:07.400281 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:07.454103 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b1e369-e280-4d4f-b4f3-88387a94d1d5 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:07.459900 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922300c3-6b99-4fdb-b80a-40e5a94223e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:07.460907 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922300c3-6b99-4fdb-b80a-40e5a94223e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:07.461229 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922300c3-6b99-4fdb-b80a-40e5a94223e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:07.461608 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922300c3-6b99-4fdb-b80a-40e5a94223e8 admin admin] PATH_INFO: `/v3/users/f8fd12e29ae843399a8a9b7a228d9a42` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:07.465391 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922300c3-6b99-4fdb-b80a-40e5a94223e8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8fd12e29ae843399a8a9b7a228d9a42)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:07.467460 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922300c3-6b99-4fdb-b80a-40e5a94223e8 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:07.532570 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-922300c3-6b99-4fdb-b80a-40e5a94223e8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8fd12e29ae843399a8a9b7a228d9a42'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:07.547816 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-922300c3-6b99-4fdb-b80a-40e5a94223e8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8fd12e29ae843399a8a9b7a228d9a42'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:07.548596 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-922300c3-6b99-4fdb-b80a-40e5a94223e8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8fd12e29ae843399a8a9b7a228d9a42'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:07.549229 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-922300c3-6b99-4fdb-b80a-40e5a94223e8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8fd12e29ae843399a8a9b7a228d9a42'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:07.558446 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-922300c3-6b99-4fdb-b80a-40e5a94223e8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8fd12e29ae843399a8a9b7a228d9a42'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:07.579219 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 932/1847] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:21:07 2022] DELETE /identity/v3/users/f8fd12e29ae843399a8a9b7a228d9a42 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:21:07.818256 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323928c-1686-400a-8cff-dc674136ac98 service placement] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:07.834511 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4323928c-1686-400a-8cff-dc674136ac98 service placement] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:07.907163 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df5270-7a57-4758-8fb4-d68c73a171cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:07.907801 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df5270-7a57-4758-8fb4-d68c73a171cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:07.908080 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df5270-7a57-4758-8fb4-d68c73a171cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:07.908371 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43df5270-7a57-4758-8fb4-d68c73a171cc admin admin] PATH_INFO: `/v3/projects/bf64708e6a4d4951b4c42b609ba301de` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:07.909529 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df5270-7a57-4758-8fb4-d68c73a171cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf64708e6a4d4951b4c42b609ba301de)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:07.911512 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43df5270-7a57-4758-8fb4-d68c73a171cc admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:07.960850 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-43df5270-7a57-4758-8fb4-d68c73a171cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf64708e6a4d4951b4c42b609ba301de', 'request_id': 'req-43df5270-7a57-4758-8fb4-d68c73a171cc'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:07.966343 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-43df5270-7a57-4758-8fb4-d68c73a171cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf64708e6a4d4951b4c42b609ba301de', 'request_id': 'req-43df5270-7a57-4758-8fb4-d68c73a171cc'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:07.974739 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-43df5270-7a57-4758-8fb4-d68c73a171cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf64708e6a4d4951b4c42b609ba301de', 'request_id': 'req-43df5270-7a57-4758-8fb4-d68c73a171cc'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:07.986389 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-43df5270-7a57-4758-8fb4-d68c73a171cc admin admin] The token cache is being invalidate because project bf64708e6a4d4951b4c42b609ba301de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:21:07.986672 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-43df5270-7a57-4758-8fb4-d68c73a171cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:07.987308 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-43df5270-7a57-4758-8fb4-d68c73a171cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:07.988896 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 916/1848] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:21:07 2022] DELETE /identity/v3/projects/bf64708e6a4d4951b4c42b609ba301de => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:21:07.992947 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922300c3-6b99-4fdb-b80a-40e5a94223e8 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:07.994340 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-922300c3-6b99-4fdb-b80a-40e5a94223e8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:08.010363 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922300c3-6b99-4fdb-b80a-40e5a94223e8 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:08.084646 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0484c5c0-9eff-4741-b519-4dace6dd18cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:08.085303 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484c5c0-9eff-4741-b519-4dace6dd18cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:08.085582 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484c5c0-9eff-4741-b519-4dace6dd18cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:08.085980 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0484c5c0-9eff-4741-b519-4dace6dd18cf admin admin] PATH_INFO: `/v3/users/2a2474a9bb1d470ba9ee4b1695502d4f` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:08.087149 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0484c5c0-9eff-4741-b519-4dace6dd18cf admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a2474a9bb1d470ba9ee4b1695502d4f)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:08.089250 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0484c5c0-9eff-4741-b519-4dace6dd18cf admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:08.139355 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-0484c5c0-9eff-4741-b519-4dace6dd18cf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a2474a9bb1d470ba9ee4b1695502d4f'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:08.141323 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:08.153866 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-0484c5c0-9eff-4741-b519-4dace6dd18cf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a2474a9bb1d470ba9ee4b1695502d4f'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:08.154842 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-0484c5c0-9eff-4741-b519-4dace6dd18cf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a2474a9bb1d470ba9ee4b1695502d4f'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:08.155470 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-0484c5c0-9eff-4741-b519-4dace6dd18cf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a2474a9bb1d470ba9ee4b1695502d4f'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:08.165389 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-0484c5c0-9eff-4741-b519-4dace6dd18cf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a2474a9bb1d470ba9ee4b1695502d4f'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:08.180051 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 933/1849] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:21:07 2022] DELETE /identity/v3/users/2a2474a9bb1d470ba9ee4b1695502d4f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:21:08.352296 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df5270-7a57-4758-8fb4-d68c73a171cc admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:08.354075 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-43df5270-7a57-4758-8fb4-d68c73a171cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:08.364824 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:08.369645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43df5270-7a57-4758-8fb4-d68c73a171cc admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:08.428020 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43418fd4-bbb4-4719-bfdd-feecbc9bafea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:08.428696 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43418fd4-bbb4-4719-bfdd-feecbc9bafea admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:08.428976 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43418fd4-bbb4-4719-bfdd-feecbc9bafea admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:08.429287 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43418fd4-bbb4-4719-bfdd-feecbc9bafea admin admin] PATH_INFO: `/v3/projects/7fd8191678fc41699f2d796ce761dd71` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:08.430440 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43418fd4-bbb4-4719-bfdd-feecbc9bafea admin admin] RBAC: Authorizing `identity:delete_project(project_id=7fd8191678fc41699f2d796ce761dd71)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:08.432408 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43418fd4-bbb4-4719-bfdd-feecbc9bafea admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:08.477529 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-43418fd4-bbb4-4719-bfdd-feecbc9bafea admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7fd8191678fc41699f2d796ce761dd71', 'request_id': 'req-43418fd4-bbb4-4719-bfdd-feecbc9bafea'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:08.483588 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-43418fd4-bbb4-4719-bfdd-feecbc9bafea admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7fd8191678fc41699f2d796ce761dd71', 'request_id': 'req-43418fd4-bbb4-4719-bfdd-feecbc9bafea'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:08.490802 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-43418fd4-bbb4-4719-bfdd-feecbc9bafea admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7fd8191678fc41699f2d796ce761dd71', 'request_id': 'req-43418fd4-bbb4-4719-bfdd-feecbc9bafea'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:08.502317 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-43418fd4-bbb4-4719-bfdd-feecbc9bafea admin admin] The token cache is being invalidate because project 7fd8191678fc41699f2d796ce761dd71 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:21:08.502599 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-43418fd4-bbb4-4719-bfdd-feecbc9bafea admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:08.503228 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-43418fd4-bbb4-4719-bfdd-feecbc9bafea admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:08.504760 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 917/1850] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:21:08 2022] DELETE /identity/v3/projects/7fd8191678fc41699f2d796ce761dd71 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:21:08.511165 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb964d31-dfda-4c76-bdec-8bfdcb8232bc None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:08.511493 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb964d31-dfda-4c76-bdec-8bfdcb8232bc None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:08.511769 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb964d31-dfda-4c76-bdec-8bfdcb8232bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:08.532097 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-cb964d31-dfda-4c76-bdec-8bfdcb8232bc None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:21:08.533349 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-cb964d31-dfda-4c76-bdec-8bfdcb8232bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:08.601367 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 934/1851] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:21:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:21:08.613289 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fcce5-f237-4901-b419-417cbd992181 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:08.613580 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fcce5-f237-4901-b419-417cbd992181 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:08.613860 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5fcce5-f237-4901-b419-417cbd992181 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:08.634132 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-fd5fcce5-f237-4901-b419-417cbd992181 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:21:08.635352 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-fd5fcce5-f237-4901-b419-417cbd992181 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:08.644553 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 918/1852] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:21:08 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:21:08.648825 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb964d31-dfda-4c76-bdec-8bfdcb8232bc None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:08.659514 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb964d31-dfda-4c76-bdec-8bfdcb8232bc None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:08.664164 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51058519-3d49-4d71-a4f0-b2b5d5636954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:08.664824 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51058519-3d49-4d71-a4f0-b2b5d5636954 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:08.665111 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51058519-3d49-4d71-a4f0-b2b5d5636954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:08.665389 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51058519-3d49-4d71-a4f0-b2b5d5636954 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:08.666091 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51058519-3d49-4d71-a4f0-b2b5d5636954 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:21:08.666396 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51058519-3d49-4d71-a4f0-b2b5d5636954 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:08.667963 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51058519-3d49-4d71-a4f0-b2b5d5636954 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:08.681413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 935/1853] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:21:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:21:08.685620 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5fcce5-f237-4901-b419-417cbd992181 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:08.694985 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5fcce5-f237-4901-b419-417cbd992181 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:08.699590 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc63d13-d100-41d1-ad03-ea96569939f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:08.700195 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc63d13-d100-41d1-ad03-ea96569939f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:08.700514 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc63d13-d100-41d1-ad03-ea96569939f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:08.700796 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbc63d13-d100-41d1-ad03-ea96569939f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:08.701635 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc63d13-d100-41d1-ad03-ea96569939f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:08.703519 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbc63d13-d100-41d1-ad03-ea96569939f9 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:08.735570 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 919/1854] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:21:08 2022] POST /identity/v3/projects => generated 385 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:21:08.736750 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51058519-3d49-4d71-a4f0-b2b5d5636954 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:08.746802 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51058519-3d49-4d71-a4f0-b2b5d5636954 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:08.808983 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d858890-2f49-4960-a0b5-5585edd6ee11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:08.809591 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d858890-2f49-4960-a0b5-5585edd6ee11 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:08.809868 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d858890-2f49-4960-a0b5-5585edd6ee11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:08.810138 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d858890-2f49-4960-a0b5-5585edd6ee11 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:08.811362 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d858890-2f49-4960-a0b5-5585edd6ee11 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:08.813280 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d858890-2f49-4960-a0b5-5585edd6ee11 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:08.836213 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 936/1855] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:21:08 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:21:08.840246 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc63d13-d100-41d1-ad03-ea96569939f9 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:08.853491 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbc63d13-d100-41d1-ad03-ea96569939f9 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:08.859139 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ababe6-a4c5-48af-9397-9f5b141c39c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:08.859862 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ababe6-a4c5-48af-9397-9f5b141c39c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:08.860217 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ababe6-a4c5-48af-9397-9f5b141c39c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:08.860588 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ababe6-a4c5-48af-9397-9f5b141c39c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:08.861442 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ababe6-a4c5-48af-9397-9f5b141c39c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:08.863192 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ababe6-a4c5-48af-9397-9f5b141c39c4 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:08.874877 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 920/1856] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:21:08.879330 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d858890-2f49-4960-a0b5-5585edd6ee11 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:08.891751 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d858890-2f49-4960-a0b5-5585edd6ee11 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:08.896595 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d77d32f-7915-45b8-bd1f-8b93cfddbd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:08.897219 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77d32f-7915-45b8-bd1f-8b93cfddbd4d admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:08.897496 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77d32f-7915-45b8-bd1f-8b93cfddbd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:08.897763 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d77d32f-7915-45b8-bd1f-8b93cfddbd4d admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:08.898460 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d77d32f-7915-45b8-bd1f-8b93cfddbd4d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:08.900281 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d77d32f-7915-45b8-bd1f-8b93cfddbd4d admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:08.922509 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 937/1857] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:21:08 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:21:08.923777 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ababe6-a4c5-48af-9397-9f5b141c39c4 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:08.934068 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ababe6-a4c5-48af-9397-9f5b141c39c4 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:08.939302 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065d5bd-093e-4616-9114-d91bef2bb2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:08.939964 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065d5bd-093e-4616-9114-d91bef2bb2be admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:08.940245 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065d5bd-093e-4616-9114-d91bef2bb2be admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:08.940556 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e065d5bd-093e-4616-9114-d91bef2bb2be admin admin] PATH_INFO: `/v3/projects/beac9cf5bfa5453c92392a96ba2e975f/users/59c15242d2dd49559675385ff90cbeb1/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:08.955949 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e065d5bd-093e-4616-9114-d91bef2bb2be admin admin] RBAC: Authorizing `identity:create_grant(project_id=beac9cf5bfa5453c92392a96ba2e975f, user_id=59c15242d2dd49559675385ff90cbeb1, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:08.958736 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e065d5bd-093e-4616-9114-d91bef2bb2be admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:08.972370 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 921/1858] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:21:08 2022] PUT /identity/v3/projects/beac9cf5bfa5453c92392a96ba2e975f/users/59c15242d2dd49559675385ff90cbeb1/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:21:08.983334 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4be3a-3ecb-4bb9-ac5e-bea958b06b2e None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:08.983794 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4be3a-3ecb-4bb9-ac5e-bea958b06b2e None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:08.984074 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d4be3a-3ecb-4bb9-ac5e-bea958b06b2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:09.015311 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-50d4be3a-3ecb-4bb9-ac5e-bea958b06b2e None None] MFA Rules not processed for user `59c15242d2dd49559675385ff90cbeb1`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:21:09.016586 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-50d4be3a-3ecb-4bb9-ac5e-bea958b06b2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:09.037302 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:09.096408 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 938/1859] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:21:08 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:21:09.108142 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065d5bd-093e-4616-9114-d91bef2bb2be admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:09.109944 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-e065d5bd-093e-4616-9114-d91bef2bb2be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:09.146274 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:09.173435 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e065d5bd-093e-4616-9114-d91bef2bb2be admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:09.177001 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-682be02d-de66-4291-b719-da14fa11c54b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:09.177612 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682be02d-de66-4291-b719-da14fa11c54b service cinder] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:09.177890 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682be02d-de66-4291-b719-da14fa11c54b service cinder] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:09.178189 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-682be02d-de66-4291-b719-da14fa11c54b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:09.188296 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682be02d-de66-4291-b719-da14fa11c54b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:09.190176 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-682be02d-de66-4291-b719-da14fa11c54b service cinder] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:09.200502 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 922/1860] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:21:09 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:21:18.243792 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4be3a-3ecb-4bb9-ac5e-bea958b06b2e None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:18.308251 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d4be3a-3ecb-4bb9-ac5e-bea958b06b2e None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:18.313228 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c2a513-5d51-4ffb-8d1c-7ec74d04c366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:18.313879 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2a513-5d51-4ffb-8d1c-7ec74d04c366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:18.314164 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2a513-5d51-4ffb-8d1c-7ec74d04c366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:18.314444 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c2a513-5d51-4ffb-8d1c-7ec74d04c366 admin admin] PATH_INFO: `/v3/users/59c15242d2dd49559675385ff90cbeb1` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:18.315647 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c2a513-5d51-4ffb-8d1c-7ec74d04c366 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59c15242d2dd49559675385ff90cbeb1)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:18.317796 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c2a513-5d51-4ffb-8d1c-7ec74d04c366 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:18.371830 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-17c2a513-5d51-4ffb-8d1c-7ec74d04c366 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59c15242d2dd49559675385ff90cbeb1'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:18.389065 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-17c2a513-5d51-4ffb-8d1c-7ec74d04c366 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59c15242d2dd49559675385ff90cbeb1'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:18.390205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-17c2a513-5d51-4ffb-8d1c-7ec74d04c366 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59c15242d2dd49559675385ff90cbeb1'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:18.391283 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-17c2a513-5d51-4ffb-8d1c-7ec74d04c366 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59c15242d2dd49559675385ff90cbeb1'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:18.400202 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-17c2a513-5d51-4ffb-8d1c-7ec74d04c366 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59c15242d2dd49559675385ff90cbeb1'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:18.415343 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 939/1861] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:21:18 2022] DELETE /identity/v3/users/59c15242d2dd49559675385ff90cbeb1 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:21:18.421921 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0696c-4ca4-4571-b64a-7bd272aaa4cb None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:18.422937 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0696c-4ca4-4571-b64a-7bd272aaa4cb None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:18.423415 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29a0696c-4ca4-4571-b64a-7bd272aaa4cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:18.448959 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-29a0696c-4ca4-4571-b64a-7bd272aaa4cb None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:21:18.450471 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-29a0696c-4ca4-4571-b64a-7bd272aaa4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:18.537961 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 923/1862] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:21:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:21:18.570160 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c2a513-5d51-4ffb-8d1c-7ec74d04c366 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:18.571730 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-17c2a513-5d51-4ffb-8d1c-7ec74d04c366 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:18.626121 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0696c-4ca4-4571-b64a-7bd272aaa4cb None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:18.628458 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-29a0696c-4ca4-4571-b64a-7bd272aaa4cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:18.700759 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:18.719514 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c2a513-5d51-4ffb-8d1c-7ec74d04c366 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:18.727847 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ba218-4bd8-4d1c-b456-1a8399ee64eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:18.729222 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ba218-4bd8-4d1c-b456-1a8399ee64eb service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:18.730063 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ba218-4bd8-4d1c-b456-1a8399ee64eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:18.730440 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ba218-4bd8-4d1c-b456-1a8399ee64eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:18.742694 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ba218-4bd8-4d1c-b456-1a8399ee64eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:18.744306 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ba218-4bd8-4d1c-b456-1a8399ee64eb service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:18.758973 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 940/1863] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:21:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:21:18.791016 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29a0696c-4ca4-4571-b64a-7bd272aaa4cb None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:18.801276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb5033-32a8-4899-8d67-dfd0c96f87bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:18.801978 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb5033-32a8-4899-8d67-dfd0c96f87bf service cinder] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:18.802326 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb5033-32a8-4899-8d67-dfd0c96f87bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:18.802900 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb5033-32a8-4899-8d67-dfd0c96f87bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:18.809173 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-d9cb5033-32a8-4899-8d67-dfd0c96f87bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:18.949387 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edd888-2525-4819-936f-0e71a725b57e None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:18.949481 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edd888-2525-4819-936f-0e71a725b57e None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:18.950368 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7edd888-2525-4819-936f-0e71a725b57e None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:18.953255 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 941/1864] 10.222.0.15 () {54 vars in 921 bytes} [Fri Aug 5 02:21:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:21:18.986823 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb5033-32a8-4899-8d67-dfd0c96f87bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:18.988283 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb5033-32a8-4899-8d67-dfd0c96f87bf service cinder] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:19.014889 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 924/1865] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:21:18 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:21:19.109648 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e93a5-adfb-4bc9-9bde-c5f0252e0c16 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:19.109933 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e93a5-adfb-4bc9-9bde-c5f0252e0c16 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:19.111203 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48e93a5-adfb-4bc9-9bde-c5f0252e0c16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:19.166923 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-d48e93a5-adfb-4bc9-9bde-c5f0252e0c16 None None] MFA Rules not processed for user `4b5c0958604b436daa44b1f67c9dec26`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:21:19.168155 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-d48e93a5-adfb-4bc9-9bde-c5f0252e0c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:19.279498 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 942/1866] 10.222.0.15 () {58 vars in 1018 bytes} [Fri Aug 5 02:21:19 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:21:19.397722 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb5033-32a8-4899-8d67-dfd0c96f87bf service cinder] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:19.399345 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-d9cb5033-32a8-4899-8d67-dfd0c96f87bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:19.421701 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb5033-32a8-4899-8d67-dfd0c96f87bf service cinder] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:19.423917 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e93a5-adfb-4bc9-9bde-c5f0252e0c16 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:19.425598 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-d48e93a5-adfb-4bc9-9bde-c5f0252e0c16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:19.460546 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a165ee47-6e90-4ac4-996c-0eaf2a358c1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:19.460546 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165ee47-6e90-4ac4-996c-0eaf2a358c1f service nova] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:19.460546 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165ee47-6e90-4ac4-996c-0eaf2a358c1f service nova] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:19.461259 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48e93a5-adfb-4bc9-9bde-c5f0252e0c16 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:19.461349 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a165ee47-6e90-4ac4-996c-0eaf2a358c1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:19.474864 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8407a489-a2f1-4eee-8fae-8a26e6632f0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:19.475537 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407a489-a2f1-4eee-8fae-8a26e6632f0f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:19.475823 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407a489-a2f1-4eee-8fae-8a26e6632f0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:19.476101 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8407a489-a2f1-4eee-8fae-8a26e6632f0f admin admin] PATH_INFO: `/v3/projects/beac9cf5bfa5453c92392a96ba2e975f` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:19.477818 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8407a489-a2f1-4eee-8fae-8a26e6632f0f admin admin] RBAC: Authorizing `identity:delete_project(project_id=beac9cf5bfa5453c92392a96ba2e975f)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:19.480930 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a165ee47-6e90-4ac4-996c-0eaf2a358c1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:19.481524 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8407a489-a2f1-4eee-8fae-8a26e6632f0f admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:19.485183 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a165ee47-6e90-4ac4-996c-0eaf2a358c1f service nova] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:19.519896 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 925/1867] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:21:19 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:21:19.566510 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-8407a489-a2f1-4eee-8fae-8a26e6632f0f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'beac9cf5bfa5453c92392a96ba2e975f', 'request_id': 'req-8407a489-a2f1-4eee-8fae-8a26e6632f0f'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:19.573763 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-8407a489-a2f1-4eee-8fae-8a26e6632f0f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'beac9cf5bfa5453c92392a96ba2e975f', 'request_id': 'req-8407a489-a2f1-4eee-8fae-8a26e6632f0f'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:19.587959 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-8407a489-a2f1-4eee-8fae-8a26e6632f0f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'beac9cf5bfa5453c92392a96ba2e975f', 'request_id': 'req-8407a489-a2f1-4eee-8fae-8a26e6632f0f'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:19.602567 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-8407a489-a2f1-4eee-8fae-8a26e6632f0f admin admin] The token cache is being invalidate because project beac9cf5bfa5453c92392a96ba2e975f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:21:19.602852 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-8407a489-a2f1-4eee-8fae-8a26e6632f0f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:19.603691 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-8407a489-a2f1-4eee-8fae-8a26e6632f0f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:19.605701 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 943/1868] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:21:19 2022] DELETE /identity/v3/projects/beac9cf5bfa5453c92392a96ba2e975f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:21:19.611710 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b40ff-d632-4bce-96c7-8c614ec646b7 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:19.612075 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b40ff-d632-4bce-96c7-8c614ec646b7 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:19.612537 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a3b40ff-d632-4bce-96c7-8c614ec646b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:19.632539 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-6a3b40ff-d632-4bce-96c7-8c614ec646b7 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:21:19.633808 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-6a3b40ff-d632-4bce-96c7-8c614ec646b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:19.639424 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:19.696971 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 926/1869] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:21:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:21:19.706202 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b37e40-281d-4951-a637-85695edb5934 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:19.706489 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b37e40-281d-4951-a637-85695edb5934 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:19.706769 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b37e40-281d-4951-a637-85695edb5934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:19.727073 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-46b37e40-281d-4951-a637-85695edb5934 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:21:19.728271 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-46b37e40-281d-4951-a637-85695edb5934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:19.736842 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 944/1870] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:21:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:21:19.741067 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b40ff-d632-4bce-96c7-8c614ec646b7 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:19.751070 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a3b40ff-d632-4bce-96c7-8c614ec646b7 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:19.755624 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300a019-8246-4781-b63e-fe0413450275 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:19.756227 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300a019-8246-4781-b63e-fe0413450275 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:19.756544 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300a019-8246-4781-b63e-fe0413450275 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:19.756820 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5300a019-8246-4781-b63e-fe0413450275 admin admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:19.757513 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5300a019-8246-4781-b63e-fe0413450275 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:21:19.757817 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5300a019-8246-4781-b63e-fe0413450275 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:19.759403 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5300a019-8246-4781-b63e-fe0413450275 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:19.774760 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 927/1871] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:21:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:21:19.779756 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b37e40-281d-4951-a637-85695edb5934 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:19.788963 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b37e40-281d-4951-a637-85695edb5934 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:19.793445 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2afca3d-9630-468b-b4c9-1da8fa010baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:19.794052 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afca3d-9630-468b-b4c9-1da8fa010baf admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:19.794327 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afca3d-9630-468b-b4c9-1da8fa010baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:19.794628 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2afca3d-9630-468b-b4c9-1da8fa010baf admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:19.795294 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2afca3d-9630-468b-b4c9-1da8fa010baf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:19.797238 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2afca3d-9630-468b-b4c9-1da8fa010baf admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:19.824756 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 945/1872] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:21:19 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:21:19.829732 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300a019-8246-4781-b63e-fe0413450275 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:19.840304 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5300a019-8246-4781-b63e-fe0413450275 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:19.898189 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379e818-0679-4da9-bb36-9eb1abebe81e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:19.899159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379e818-0679-4da9-bb36-9eb1abebe81e admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:19.899444 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379e818-0679-4da9-bb36-9eb1abebe81e admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:19.899840 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f379e818-0679-4da9-bb36-9eb1abebe81e admin admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:19.900581 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f379e818-0679-4da9-bb36-9eb1abebe81e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:19.902793 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f379e818-0679-4da9-bb36-9eb1abebe81e admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:19.927902 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 928/1873] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:21:19 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:21:19.932091 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2afca3d-9630-468b-b4c9-1da8fa010baf admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:19.943638 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2afca3d-9630-468b-b4c9-1da8fa010baf admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:19.948261 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d492c2-dea9-4ab6-9b88-f01398e46daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:19.948963 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d492c2-dea9-4ab6-9b88-f01398e46daf admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:19.949408 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d492c2-dea9-4ab6-9b88-f01398e46daf admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:19.949686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5d492c2-dea9-4ab6-9b88-f01398e46daf admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:19.950390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d492c2-dea9-4ab6-9b88-f01398e46daf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:19.952124 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5d492c2-dea9-4ab6-9b88-f01398e46daf admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:19.962775 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 946/1874] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:21:19.966868 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379e818-0679-4da9-bb36-9eb1abebe81e admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:19.978175 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f379e818-0679-4da9-bb36-9eb1abebe81e admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:19.983799 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a95b8-b18a-4704-bdcc-8feefbfa046f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:19.984429 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a95b8-b18a-4704-bdcc-8feefbfa046f admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:19.984717 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a95b8-b18a-4704-bdcc-8feefbfa046f admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:19.984994 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a95b8-b18a-4704-bdcc-8feefbfa046f admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:19.985693 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a95b8-b18a-4704-bdcc-8feefbfa046f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:19.987280 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a95b8-b18a-4704-bdcc-8feefbfa046f admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:19.998716 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 929/1875] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:21:19 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:21:20.002896 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d492c2-dea9-4ab6-9b88-f01398e46daf admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:20.012939 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5d492c2-dea9-4ab6-9b88-f01398e46daf admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:20.018288 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108b7eb-5476-4b97-b78e-132498c6c04b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:20.018964 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108b7eb-5476-4b97-b78e-132498c6c04b admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:20.019245 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108b7eb-5476-4b97-b78e-132498c6c04b admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:20.019522 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d108b7eb-5476-4b97-b78e-132498c6c04b admin admin] PATH_INFO: `/v3/projects/a5d8a01fa4024794b4dde3beebbbd7f1/users/836dfe4afeef41ab86636b38cb9ccfc1/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:20.034783 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108b7eb-5476-4b97-b78e-132498c6c04b admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5d8a01fa4024794b4dde3beebbbd7f1, user_id=836dfe4afeef41ab86636b38cb9ccfc1, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:20.037519 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d108b7eb-5476-4b97-b78e-132498c6c04b admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:20.040590 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:20.056539 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 947/1876] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:21:20 2022] PUT /identity/v3/projects/a5d8a01fa4024794b4dde3beebbbd7f1/users/836dfe4afeef41ab86636b38cb9ccfc1/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:21:20.058156 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edcb12-e53e-4263-865c-bb2c10a5f122 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:20.058447 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edcb12-e53e-4263-865c-bb2c10a5f122 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:20.058882 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8edcb12-e53e-4263-865c-bb2c10a5f122 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:20.080086 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-f8edcb12-e53e-4263-865c-bb2c10a5f122 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:21:20.081327 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-f8edcb12-e53e-4263-865c-bb2c10a5f122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:20.142424 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 930/1877] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:21:20 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:21:20.152029 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108b7eb-5476-4b97-b78e-132498c6c04b admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:20.154435 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-d108b7eb-5476-4b97-b78e-132498c6c04b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:20.237167 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d108b7eb-5476-4b97-b78e-132498c6c04b admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:20.240891 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4da6efc-0cb4-423b-9aa9-c47e151fc462 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:20.241508 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da6efc-0cb4-423b-9aa9-c47e151fc462 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:20.241787 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da6efc-0cb4-423b-9aa9-c47e151fc462 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:20.242058 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4da6efc-0cb4-423b-9aa9-c47e151fc462 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:20.253189 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da6efc-0cb4-423b-9aa9-c47e151fc462 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:20.254744 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4da6efc-0cb4-423b-9aa9-c47e151fc462 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:20.266212 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 948/1878] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:21:20 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:21:24.470627 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8edcb12-e53e-4263-865c-bb2c10a5f122 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:24.474043 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-f8edcb12-e53e-4263-865c-bb2c10a5f122 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:24.502635 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8edcb12-e53e-4263-865c-bb2c10a5f122 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:24.516445 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d88677-4e62-45f4-a4c6-bba2d858209b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:24.520352 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d88677-4e62-45f4-a4c6-bba2d858209b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:24.521019 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d88677-4e62-45f4-a4c6-bba2d858209b admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:24.521617 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81d88677-4e62-45f4-a4c6-bba2d858209b admin admin] PATH_INFO: `/v3/users/a244ffdcec494943b73786b9c6b02c60` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:24.526502 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d88677-4e62-45f4-a4c6-bba2d858209b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a244ffdcec494943b73786b9c6b02c60)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:24.534821 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81d88677-4e62-45f4-a4c6-bba2d858209b admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:24.562361 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:24.623908 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-81d88677-4e62-45f4-a4c6-bba2d858209b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a244ffdcec494943b73786b9c6b02c60'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:24.643324 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-81d88677-4e62-45f4-a4c6-bba2d858209b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a244ffdcec494943b73786b9c6b02c60'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:24.644778 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-81d88677-4e62-45f4-a4c6-bba2d858209b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a244ffdcec494943b73786b9c6b02c60'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:24.648416 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-81d88677-4e62-45f4-a4c6-bba2d858209b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a244ffdcec494943b73786b9c6b02c60'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:24.660798 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-81d88677-4e62-45f4-a4c6-bba2d858209b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a244ffdcec494943b73786b9c6b02c60'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:24.686324 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 931/1879] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:21:24 2022] DELETE /identity/v3/users/a244ffdcec494943b73786b9c6b02c60 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:21:24.691265 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6973b4fd-588d-48d1-b99b-21cebafae284 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:24.691807 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6973b4fd-588d-48d1-b99b-21cebafae284 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:24.691807 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6973b4fd-588d-48d1-b99b-21cebafae284 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:24.713976 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-6973b4fd-588d-48d1-b99b-21cebafae284 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:21:24.715428 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-6973b4fd-588d-48d1-b99b-21cebafae284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:24.798579 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 949/1880] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:21:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:21:24.810074 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d88677-4e62-45f4-a4c6-bba2d858209b admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:24.811873 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-81d88677-4e62-45f4-a4c6-bba2d858209b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:24.894802 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81d88677-4e62-45f4-a4c6-bba2d858209b admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:24.898789 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90770e2-804e-45fa-9772-46339b504f77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:24.899417 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90770e2-804e-45fa-9772-46339b504f77 service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:24.899699 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90770e2-804e-45fa-9772-46339b504f77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:24.900622 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90770e2-804e-45fa-9772-46339b504f77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:24.916215 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90770e2-804e-45fa-9772-46339b504f77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:24.918600 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90770e2-804e-45fa-9772-46339b504f77 service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:24.932506 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 932/1881] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:21:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:21:25.586832 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6973b4fd-588d-48d1-b99b-21cebafae284 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:25.590225 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-6973b4fd-588d-48d1-b99b-21cebafae284 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:25.616952 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6973b4fd-588d-48d1-b99b-21cebafae284 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:25.631074 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c2d308-28fb-4922-87eb-9fd9b72a2f1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:25.631826 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2d308-28fb-4922-87eb-9fd9b72a2f1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:25.632027 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2d308-28fb-4922-87eb-9fd9b72a2f1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:25.632292 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c2d308-28fb-4922-87eb-9fd9b72a2f1b admin admin] PATH_INFO: `/v3/projects/46dc6dea2e554deeb7b94bfd36c4815c` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:25.633690 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c2d308-28fb-4922-87eb-9fd9b72a2f1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=46dc6dea2e554deeb7b94bfd36c4815c)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:25.636862 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c2d308-28fb-4922-87eb-9fd9b72a2f1b admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:25.731187 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-10c2d308-28fb-4922-87eb-9fd9b72a2f1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '46dc6dea2e554deeb7b94bfd36c4815c', 'request_id': 'req-10c2d308-28fb-4922-87eb-9fd9b72a2f1b'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:25.741266 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-10c2d308-28fb-4922-87eb-9fd9b72a2f1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '46dc6dea2e554deeb7b94bfd36c4815c', 'request_id': 'req-10c2d308-28fb-4922-87eb-9fd9b72a2f1b'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:25.766004 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-10c2d308-28fb-4922-87eb-9fd9b72a2f1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '46dc6dea2e554deeb7b94bfd36c4815c', 'request_id': 'req-10c2d308-28fb-4922-87eb-9fd9b72a2f1b'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:25.781407 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-10c2d308-28fb-4922-87eb-9fd9b72a2f1b admin admin] The token cache is being invalidate because project 46dc6dea2e554deeb7b94bfd36c4815c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:21:25.782010 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-10c2d308-28fb-4922-87eb-9fd9b72a2f1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:25.783444 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-10c2d308-28fb-4922-87eb-9fd9b72a2f1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:25.785540 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 950/1882] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:21:25 2022] DELETE /identity/v3/projects/46dc6dea2e554deeb7b94bfd36c4815c => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:21:25.789278 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90770e2-804e-45fa-9772-46339b504f77 service neutron] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:25.804264 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90770e2-804e-45fa-9772-46339b504f77 service neutron] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:25.929204 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75daccd-6482-4f10-8a67-7a24aff30f59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:25.930763 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75daccd-6482-4f10-8a67-7a24aff30f59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:25.931238 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75daccd-6482-4f10-8a67-7a24aff30f59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:25.931771 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75daccd-6482-4f10-8a67-7a24aff30f59 admin admin] PATH_INFO: `/v3/users/acdafda5caf4403cab9783e747d344d0` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:25.933503 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75daccd-6482-4f10-8a67-7a24aff30f59 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acdafda5caf4403cab9783e747d344d0)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:25.941888 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75daccd-6482-4f10-8a67-7a24aff30f59 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:26.014886 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:26.072634 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-f75daccd-6482-4f10-8a67-7a24aff30f59 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acdafda5caf4403cab9783e747d344d0'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:26.100550 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-f75daccd-6482-4f10-8a67-7a24aff30f59 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acdafda5caf4403cab9783e747d344d0'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:26.101315 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-f75daccd-6482-4f10-8a67-7a24aff30f59 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acdafda5caf4403cab9783e747d344d0'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:26.101994 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-f75daccd-6482-4f10-8a67-7a24aff30f59 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acdafda5caf4403cab9783e747d344d0'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:26.121845 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-f75daccd-6482-4f10-8a67-7a24aff30f59 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acdafda5caf4403cab9783e747d344d0'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:26.142149 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 933/1883] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:21:25 2022] DELETE /identity/v3/users/acdafda5caf4403cab9783e747d344d0 => generated 0 bytes in 353 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:21:26.809079 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd97d4a-b247-4c6b-bef7-2054cce495d5 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:26.810555 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd97d4a-b247-4c6b-bef7-2054cce495d5 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:26.811019 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd97d4a-b247-4c6b-bef7-2054cce495d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:26.833842 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75daccd-6482-4f10-8a67-7a24aff30f59 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:26.843030 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-f75daccd-6482-4f10-8a67-7a24aff30f59 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:26.873464 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-dbd97d4a-b247-4c6b-bef7-2054cce495d5 None None] MFA Rules not processed for user `836dfe4afeef41ab86636b38cb9ccfc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:21:26.875554 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-dbd97d4a-b247-4c6b-bef7-2054cce495d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:26.887259 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:26.941638 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75daccd-6482-4f10-8a67-7a24aff30f59 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:26.947175 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fa6ec8-400b-4905-834e-ae46d7851863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:26.948098 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa6ec8-400b-4905-834e-ae46d7851863 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:26.948585 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa6ec8-400b-4905-834e-ae46d7851863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:26.948991 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fa6ec8-400b-4905-834e-ae46d7851863 admin admin] PATH_INFO: `/v3/projects/5110a35e9f5f41339cb6e9c3c3dcfbbc` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:26.951214 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa6ec8-400b-4905-834e-ae46d7851863 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5110a35e9f5f41339cb6e9c3c3dcfbbc)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:26.955090 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 951/1884] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:21:26 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:21:26.955235 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fa6ec8-400b-4905-834e-ae46d7851863 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:26.956220 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd97d4a-b247-4c6b-bef7-2054cce495d5 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:26.958533 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-dbd97d4a-b247-4c6b-bef7-2054cce495d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:26.974593 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd97d4a-b247-4c6b-bef7-2054cce495d5 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:26.979702 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935b291-7d18-47cf-98a0-9a85d6656358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:26.980819 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935b291-7d18-47cf-98a0-9a85d6656358 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:26.981180 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935b291-7d18-47cf-98a0-9a85d6656358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:26.981525 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e935b291-7d18-47cf-98a0-9a85d6656358 admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:26.982503 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e935b291-7d18-47cf-98a0-9a85d6656358 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:26.984669 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e935b291-7d18-47cf-98a0-9a85d6656358 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:27.006918 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-59fa6ec8-400b-4905-834e-ae46d7851863 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5110a35e9f5f41339cb6e9c3c3dcfbbc', 'request_id': 'req-59fa6ec8-400b-4905-834e-ae46d7851863'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:27.015386 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-59fa6ec8-400b-4905-834e-ae46d7851863 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5110a35e9f5f41339cb6e9c3c3dcfbbc', 'request_id': 'req-59fa6ec8-400b-4905-834e-ae46d7851863'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:27.019839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 952/1885] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:21:26 2022] POST /identity/v3/projects => generated 385 bytes in 64 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:21:27.024014 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-59fa6ec8-400b-4905-834e-ae46d7851863 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5110a35e9f5f41339cb6e9c3c3dcfbbc', 'request_id': 'req-59fa6ec8-400b-4905-834e-ae46d7851863'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:27.024188 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935b291-7d18-47cf-98a0-9a85d6656358 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:27.038945 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-59fa6ec8-400b-4905-834e-ae46d7851863 admin admin] The token cache is being invalidate because project 5110a35e9f5f41339cb6e9c3c3dcfbbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:21:27.039389 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-59fa6ec8-400b-4905-834e-ae46d7851863 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:27.040061 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-59fa6ec8-400b-4905-834e-ae46d7851863 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:27.047205 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 934/1886] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:21:26 2022] DELETE /identity/v3/projects/5110a35e9f5f41339cb6e9c3c3dcfbbc => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:21:27.049519 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb285674-864b-49e4-b1de-ef61cb4466ec None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:27.049804 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb285674-864b-49e4-b1de-ef61cb4466ec None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:27.050078 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb285674-864b-49e4-b1de-ef61cb4466ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:27.081109 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-cb285674-864b-49e4-b1de-ef61cb4466ec None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:21:27.082309 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-cb285674-864b-49e4-b1de-ef61cb4466ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:27.089573 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e935b291-7d18-47cf-98a0-9a85d6656358 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:27.090460 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 935/1887] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:21:27.094602 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ddfff2-7d0b-4474-b23c-6eaf8f65ea9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:27.095228 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddfff2-7d0b-4474-b23c-6eaf8f65ea9e admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:27.095512 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddfff2-7d0b-4474-b23c-6eaf8f65ea9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:27.095789 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ddfff2-7d0b-4474-b23c-6eaf8f65ea9e admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:27.096747 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ddfff2-7d0b-4474-b23c-6eaf8f65ea9e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:27.098675 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ddfff2-7d0b-4474-b23c-6eaf8f65ea9e admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:27.099800 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456533e-cf71-4d04-a9c6-1086b89dd47e None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:27.100092 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456533e-cf71-4d04-a9c6-1086b89dd47e None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:27.100465 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9456533e-cf71-4d04-a9c6-1086b89dd47e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:27.124082 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 953/1888] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:21:27 2022] POST /identity/v3/users => generated 299 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:21:27.124277 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-9456533e-cf71-4d04-a9c6-1086b89dd47e None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:21:27.124277 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-9456533e-cf71-4d04-a9c6-1086b89dd47e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:27.125157 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ddfff2-7d0b-4474-b23c-6eaf8f65ea9e admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:27.126743 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-c4ddfff2-7d0b-4474-b23c-6eaf8f65ea9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:27.132359 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 936/1889] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:21:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:21:27.135215 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456533e-cf71-4d04-a9c6-1086b89dd47e None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:27.140995 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ddfff2-7d0b-4474-b23c-6eaf8f65ea9e admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:27.146592 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6a39c-f3ae-450e-8735-148962b28f48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:27.147220 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6a39c-f3ae-450e-8735-148962b28f48 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:27.147380 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9456533e-cf71-4d04-a9c6-1086b89dd47e None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:27.147525 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6a39c-f3ae-450e-8735-148962b28f48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:27.147780 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c6a39c-f3ae-450e-8735-148962b28f48 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:27.150306 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6a39c-f3ae-450e-8735-148962b28f48 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:27.151794 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c6a39c-f3ae-450e-8735-148962b28f48 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:27.154473 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af891d76-b732-4a57-9df5-406559ee6a6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:27.155093 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af891d76-b732-4a57-9df5-406559ee6a6d admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:27.155377 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af891d76-b732-4a57-9df5-406559ee6a6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:27.155649 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af891d76-b732-4a57-9df5-406559ee6a6d admin admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:27.156375 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af891d76-b732-4a57-9df5-406559ee6a6d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:21:27.156685 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af891d76-b732-4a57-9df5-406559ee6a6d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:27.158282 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af891d76-b732-4a57-9df5-406559ee6a6d admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:27.171749 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 954/1890] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:21:27.176649 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 937/1891] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:21:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:21:27.176781 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6a39c-f3ae-450e-8735-148962b28f48 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:27.177941 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af891d76-b732-4a57-9df5-406559ee6a6d admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:27.187013 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c6a39c-f3ae-450e-8735-148962b28f48 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:27.189608 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af891d76-b732-4a57-9df5-406559ee6a6d admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:27.192098 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e07af0-f64a-4105-b886-73e3ee20ae91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:27.192804 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e07af0-f64a-4105-b886-73e3ee20ae91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:27.193242 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e07af0-f64a-4105-b886-73e3ee20ae91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:27.193528 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e07af0-f64a-4105-b886-73e3ee20ae91 admin admin] PATH_INFO: `/v3/projects/6d514bb1894c4cbeabba468f621e9845/users/25a3999ecb3f4a3bb52351cf752aa1b7/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:27.194304 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048e342-efe9-4085-87d9-a8586646e2f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:27.194903 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048e342-efe9-4085-87d9-a8586646e2f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:27.195181 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048e342-efe9-4085-87d9-a8586646e2f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:27.195451 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b048e342-efe9-4085-87d9-a8586646e2f4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:27.196309 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b048e342-efe9-4085-87d9-a8586646e2f4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:27.199105 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b048e342-efe9-4085-87d9-a8586646e2f4 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:27.211264 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e07af0-f64a-4105-b886-73e3ee20ae91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d514bb1894c4cbeabba468f621e9845, user_id=25a3999ecb3f4a3bb52351cf752aa1b7, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:27.213756 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e07af0-f64a-4105-b886-73e3ee20ae91 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:27.215314 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:27.229902 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 955/1892] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:21:27 2022] PUT /identity/v3/projects/6d514bb1894c4cbeabba468f621e9845/users/25a3999ecb3f4a3bb52351cf752aa1b7/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:21:27.234437 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e07af0-f64a-4105-b886-73e3ee20ae91 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:27.235918 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 938/1893] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:21:27 2022] POST /identity/v3/projects => generated 373 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:21:27.240119 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048e342-efe9-4085-87d9-a8586646e2f4 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:27.303911 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:27.314142 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e07af0-f64a-4105-b886-73e3ee20ae91 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:27.329466 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b048e342-efe9-4085-87d9-a8586646e2f4 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:27.334653 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc41419f-b9e3-4930-a5e2-057490a984e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:27.335281 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41419f-b9e3-4930-a5e2-057490a984e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:27.335571 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41419f-b9e3-4930-a5e2-057490a984e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:27.335848 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc41419f-b9e3-4930-a5e2-057490a984e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:27.336551 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc41419f-b9e3-4930-a5e2-057490a984e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:27.338528 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc41419f-b9e3-4930-a5e2-057490a984e7 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:27.361339 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 939/1894] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:21:27 2022] POST /identity/v3/users => generated 287 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:21:27.365383 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc41419f-b9e3-4930-a5e2-057490a984e7 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:27.374673 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9fa42-9d5b-4579-83fa-0d9d94b39ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:27.375179 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc41419f-b9e3-4930-a5e2-057490a984e7 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:27.375349 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9fa42-9d5b-4579-83fa-0d9d94b39ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:27.375635 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9fa42-9d5b-4579-83fa-0d9d94b39ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:27.375911 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f9fa42-9d5b-4579-83fa-0d9d94b39ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:27.376863 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f9fa42-9d5b-4579-83fa-0d9d94b39ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:27.378485 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f9fa42-9d5b-4579-83fa-0d9d94b39ec4 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:27.379971 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79cbab7-289e-45cd-b8ac-308604f4924d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:27.380615 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79cbab7-289e-45cd-b8ac-308604f4924d admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:27.380898 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79cbab7-289e-45cd-b8ac-308604f4924d admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:27.381181 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79cbab7-289e-45cd-b8ac-308604f4924d admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:27.381871 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79cbab7-289e-45cd-b8ac-308604f4924d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:27.383439 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79cbab7-289e-45cd-b8ac-308604f4924d admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:27.389291 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 956/1895] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:21:27.393374 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9fa42-9d5b-4579-83fa-0d9d94b39ec4 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:27.394504 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 940/1896] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:21:27.398296 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79cbab7-289e-45cd-b8ac-308604f4924d admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:27.406189 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f9fa42-9d5b-4579-83fa-0d9d94b39ec4 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:27.408777 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79cbab7-289e-45cd-b8ac-308604f4924d admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:27.413394 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8c100-543d-4815-a0de-42f87f5cbc6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:27.414015 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8c100-543d-4815-a0de-42f87f5cbc6e admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:27.414184 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c47f9ea-4829-47a6-8205-156ecf829efa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:27.414311 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8c100-543d-4815-a0de-42f87f5cbc6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:27.414556 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb8c100-543d-4815-a0de-42f87f5cbc6e admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:27.415169 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47f9ea-4829-47a6-8205-156ecf829efa admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:27.415278 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8c100-543d-4815-a0de-42f87f5cbc6e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:27.415519 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47f9ea-4829-47a6-8205-156ecf829efa admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:27.415925 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c47f9ea-4829-47a6-8205-156ecf829efa admin admin] PATH_INFO: `/v3/projects/6d514bb1894c4cbeabba468f621e9845/users/25a3999ecb3f4a3bb52351cf752aa1b7/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:27.416905 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb8c100-543d-4815-a0de-42f87f5cbc6e admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:27.418054 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c47f9ea-4829-47a6-8205-156ecf829efa admin admin] RBAC: Authorizing `identity:create_grant(project_id=6d514bb1894c4cbeabba468f621e9845, user_id=25a3999ecb3f4a3bb52351cf752aa1b7, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:27.421649 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c47f9ea-4829-47a6-8205-156ecf829efa admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:27.428646 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 941/1897] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:21:27.432741 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 957/1898] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:21:27 2022] PUT /identity/v3/projects/6d514bb1894c4cbeabba468f621e9845/users/25a3999ecb3f4a3bb52351cf752aa1b7/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:21:27.432891 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8c100-543d-4815-a0de-42f87f5cbc6e admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:27.444037 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb8c100-543d-4815-a0de-42f87f5cbc6e admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:27.507114 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09bc951-3039-4d69-93d6-2759ea704fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:27.507811 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09bc951-3039-4d69-93d6-2759ea704fae admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:27.508089 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09bc951-3039-4d69-93d6-2759ea704fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:27.508828 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f09bc951-3039-4d69-93d6-2759ea704fae admin admin] PATH_INFO: `/v3/projects/e1b1b0bc2a114b0b8c027b2e28831c31/users/c672e67b68b24732b915c4a9ec8650ec/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:27.526305 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09bc951-3039-4d69-93d6-2759ea704fae admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1b1b0bc2a114b0b8c027b2e28831c31, user_id=c672e67b68b24732b915c4a9ec8650ec, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:27.529319 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f09bc951-3039-4d69-93d6-2759ea704fae admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:27.546424 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 942/1899] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:21:27 2022] PUT /identity/v3/projects/e1b1b0bc2a114b0b8c027b2e28831c31/users/c672e67b68b24732b915c4a9ec8650ec/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:21:27.558649 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7d46d-7e55-4d01-8250-521d35672462 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:27.559015 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7d46d-7e55-4d01-8250-521d35672462 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:27.559302 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7d46d-7e55-4d01-8250-521d35672462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:27.591102 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-b4b7d46d-7e55-4d01-8250-521d35672462 None None] MFA Rules not processed for user `c672e67b68b24732b915c4a9ec8650ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:21:27.592505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-b4b7d46d-7e55-4d01-8250-521d35672462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:27.673161 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 958/1900] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:21:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:21:27.687379 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09bc951-3039-4d69-93d6-2759ea704fae admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:27.689421 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-f09bc951-3039-4d69-93d6-2759ea704fae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:27.766312 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:27.807326 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f09bc951-3039-4d69-93d6-2759ea704fae admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:27.813158 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe280217-9c49-4f86-9932-f1e234b88453 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c09080c507f4c35b81d482cfbaa6a88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:27.813926 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe280217-9c49-4f86-9932-f1e234b88453 service glance] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:27.814219 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe280217-9c49-4f86-9932-f1e234b88453 service glance] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:27.814498 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe280217-9c49-4f86-9932-f1e234b88453 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:27.823859 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe280217-9c49-4f86-9932-f1e234b88453 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:27.826492 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe280217-9c49-4f86-9932-f1e234b88453 service glance] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:27.848830 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 943/1901] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:21:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:21:32.249913 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7d46d-7e55-4d01-8250-521d35672462 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:32.251425 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-b4b7d46d-7e55-4d01-8250-521d35672462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:32.498538 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7d46d-7e55-4d01-8250-521d35672462 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:32.533231 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b9c997-829d-47f8-827a-7e6ede39b372 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:32.533927 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9c997-829d-47f8-827a-7e6ede39b372 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:32.534211 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9c997-829d-47f8-827a-7e6ede39b372 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:32.534494 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03b9c997-829d-47f8-827a-7e6ede39b372 admin admin] PATH_INFO: `/v3/users/126629652bec43c2b733ac9a55ec7888` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:32.540091 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b9c997-829d-47f8-827a-7e6ede39b372 admin admin] RBAC: Authorizing `identity:delete_user(user_id=126629652bec43c2b733ac9a55ec7888)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:32.548592 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03b9c997-829d-47f8-827a-7e6ede39b372 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:32.567807 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:32.712281 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-03b9c997-829d-47f8-827a-7e6ede39b372 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '126629652bec43c2b733ac9a55ec7888'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:32.738837 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-03b9c997-829d-47f8-827a-7e6ede39b372 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '126629652bec43c2b733ac9a55ec7888'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:32.739792 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-03b9c997-829d-47f8-827a-7e6ede39b372 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '126629652bec43c2b733ac9a55ec7888'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:32.740565 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-03b9c997-829d-47f8-827a-7e6ede39b372 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '126629652bec43c2b733ac9a55ec7888'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:32.754506 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-03b9c997-829d-47f8-827a-7e6ede39b372 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '126629652bec43c2b733ac9a55ec7888'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:32.780471 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 959/1902] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:21:32 2022] DELETE /identity/v3/users/126629652bec43c2b733ac9a55ec7888 => generated 0 bytes in 532 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:21:32.785489 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af95d52-d946-4113-b05d-14d8788dcf07 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:32.786649 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af95d52-d946-4113-b05d-14d8788dcf07 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:32.787167 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0af95d52-d946-4113-b05d-14d8788dcf07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:32.816442 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-0af95d52-d946-4113-b05d-14d8788dcf07 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:21:32.818098 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-0af95d52-d946-4113-b05d-14d8788dcf07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:32.980107 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 944/1903] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:21:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:21:33.735205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b9c997-829d-47f8-827a-7e6ede39b372 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:33.736793 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-03b9c997-829d-47f8-827a-7e6ede39b372 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:33.883557 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03b9c997-829d-47f8-827a-7e6ede39b372 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:33.899503 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcee235-be97-40ae-97a9-5b0566390e03 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:33.900207 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcee235-be97-40ae-97a9-5b0566390e03 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:33.900626 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcee235-be97-40ae-97a9-5b0566390e03 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:33.901325 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fcee235-be97-40ae-97a9-5b0566390e03 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:33.921473 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcee235-be97-40ae-97a9-5b0566390e03 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:33.922697 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fcee235-be97-40ae-97a9-5b0566390e03 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:33.946072 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 960/1904] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:21:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:21:35.203597 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af95d52-d946-4113-b05d-14d8788dcf07 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:35.205093 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-0af95d52-d946-4113-b05d-14d8788dcf07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:35.239201 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0af95d52-d946-4113-b05d-14d8788dcf07 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:35.245660 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd8681-122d-434c-8385-86104915ddf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:35.246658 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd8681-122d-434c-8385-86104915ddf8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:35.247941 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd8681-122d-434c-8385-86104915ddf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:35.248549 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dd8681-122d-434c-8385-86104915ddf8 admin admin] PATH_INFO: `/v3/projects/8de3eee4065f4002ac30d956b311378f` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:35.252687 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd8681-122d-434c-8385-86104915ddf8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8de3eee4065f4002ac30d956b311378f)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:35.259860 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dd8681-122d-434c-8385-86104915ddf8 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:35.380733 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-a7dd8681-122d-434c-8385-86104915ddf8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8de3eee4065f4002ac30d956b311378f', 'request_id': 'req-a7dd8681-122d-434c-8385-86104915ddf8'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:35.394745 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-a7dd8681-122d-434c-8385-86104915ddf8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8de3eee4065f4002ac30d956b311378f', 'request_id': 'req-a7dd8681-122d-434c-8385-86104915ddf8'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:35.422372 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-a7dd8681-122d-434c-8385-86104915ddf8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8de3eee4065f4002ac30d956b311378f', 'request_id': 'req-a7dd8681-122d-434c-8385-86104915ddf8'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:35.439940 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-a7dd8681-122d-434c-8385-86104915ddf8 admin admin] The token cache is being invalidate because project 8de3eee4065f4002ac30d956b311378f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:21:35.440653 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-a7dd8681-122d-434c-8385-86104915ddf8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:35.441591 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-a7dd8681-122d-434c-8385-86104915ddf8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:35.443866 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 945/1905] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:21:35 2022] DELETE /identity/v3/projects/8de3eee4065f4002ac30d956b311378f => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:21:35.448411 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcee235-be97-40ae-97a9-5b0566390e03 service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:35.462011 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fcee235-be97-40ae-97a9-5b0566390e03 service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:35.605706 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f87ab1-506f-480e-84ac-8df9130f147d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:35.607141 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f87ab1-506f-480e-84ac-8df9130f147d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:35.607848 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f87ab1-506f-480e-84ac-8df9130f147d admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:35.608367 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f87ab1-506f-480e-84ac-8df9130f147d admin admin] PATH_INFO: `/v3/users/62a4d59683744efa8671ebaa8108a206` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:35.610017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f87ab1-506f-480e-84ac-8df9130f147d admin admin] RBAC: Authorizing `identity:delete_user(user_id=62a4d59683744efa8671ebaa8108a206)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:35.612475 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f87ab1-506f-480e-84ac-8df9130f147d admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:35.665507 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:35.702621 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-38f87ab1-506f-480e-84ac-8df9130f147d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '62a4d59683744efa8671ebaa8108a206'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:35.725050 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-38f87ab1-506f-480e-84ac-8df9130f147d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '62a4d59683744efa8671ebaa8108a206'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:35.725923 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-38f87ab1-506f-480e-84ac-8df9130f147d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '62a4d59683744efa8671ebaa8108a206'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:35.732877 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-38f87ab1-506f-480e-84ac-8df9130f147d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '62a4d59683744efa8671ebaa8108a206'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:35.749281 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-38f87ab1-506f-480e-84ac-8df9130f147d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '62a4d59683744efa8671ebaa8108a206'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:35.775491 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 961/1906] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:21:35 2022] DELETE /identity/v3/users/62a4d59683744efa8671ebaa8108a206 => generated 0 bytes in 328 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:21:36.498870 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd8681-122d-434c-8385-86104915ddf8 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:36.500369 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-a7dd8681-122d-434c-8385-86104915ddf8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:36.520614 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dd8681-122d-434c-8385-86104915ddf8 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:36.620420 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:36.637685 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d8b3b6-fd11-461f-9963-ae9e5dfc3c43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:36.638700 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8b3b6-fd11-461f-9963-ae9e5dfc3c43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:36.639232 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8b3b6-fd11-461f-9963-ae9e5dfc3c43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:36.639613 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d8b3b6-fd11-461f-9963-ae9e5dfc3c43 admin admin] PATH_INFO: `/v3/projects/4d645813c33c466f914893246ce1134f` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:36.641548 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8b3b6-fd11-461f-9963-ae9e5dfc3c43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4d645813c33c466f914893246ce1134f)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:36.643820 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d8b3b6-fd11-461f-9963-ae9e5dfc3c43 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:36.718160 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-e6d8b3b6-fd11-461f-9963-ae9e5dfc3c43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4d645813c33c466f914893246ce1134f', 'request_id': 'req-e6d8b3b6-fd11-461f-9963-ae9e5dfc3c43'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:36.727926 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-e6d8b3b6-fd11-461f-9963-ae9e5dfc3c43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4d645813c33c466f914893246ce1134f', 'request_id': 'req-e6d8b3b6-fd11-461f-9963-ae9e5dfc3c43'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:36.740008 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-e6d8b3b6-fd11-461f-9963-ae9e5dfc3c43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4d645813c33c466f914893246ce1134f', 'request_id': 'req-e6d8b3b6-fd11-461f-9963-ae9e5dfc3c43'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:36.754490 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-e6d8b3b6-fd11-461f-9963-ae9e5dfc3c43 admin admin] The token cache is being invalidate because project 4d645813c33c466f914893246ce1134f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:21:36.755027 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-e6d8b3b6-fd11-461f-9963-ae9e5dfc3c43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:36.755853 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-e6d8b3b6-fd11-461f-9963-ae9e5dfc3c43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:36.764162 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 946/1907] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:21:36 2022] DELETE /identity/v3/projects/4d645813c33c466f914893246ce1134f => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:21:36.764442 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767dd17b-0130-4b8f-a9b5-af47009e50f9 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:36.764883 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767dd17b-0130-4b8f-a9b5-af47009e50f9 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:36.765028 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-767dd17b-0130-4b8f-a9b5-af47009e50f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:36.795169 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-767dd17b-0130-4b8f-a9b5-af47009e50f9 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:21:36.797490 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-767dd17b-0130-4b8f-a9b5-af47009e50f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:36.895404 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 962/1908] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:21:36.906475 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e9025-cae0-488b-a8c9-ad452cccfec3 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:36.906758 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e9025-cae0-488b-a8c9-ad452cccfec3 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:36.907031 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3e9025-cae0-488b-a8c9-ad452cccfec3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:36.940723 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-7f3e9025-cae0-488b-a8c9-ad452cccfec3 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:21:36.946298 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-7f3e9025-cae0-488b-a8c9-ad452cccfec3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:36.976290 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767dd17b-0130-4b8f-a9b5-af47009e50f9 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:36.990072 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 947/1909] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:21:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:21:36.993470 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-767dd17b-0130-4b8f-a9b5-af47009e50f9 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:37.004688 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70798902-9fb7-4588-85fe-419a69ff635d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:37.005214 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70798902-9fb7-4588-85fe-419a69ff635d admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:37.005500 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70798902-9fb7-4588-85fe-419a69ff635d admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:37.005769 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70798902-9fb7-4588-85fe-419a69ff635d admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:37.006486 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70798902-9fb7-4588-85fe-419a69ff635d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:21:37.006785 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70798902-9fb7-4588-85fe-419a69ff635d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:37.008753 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70798902-9fb7-4588-85fe-419a69ff635d admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:37.032512 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e9025-cae0-488b-a8c9-ad452cccfec3 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:37.040714 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 963/1910] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:21:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:21:37.045517 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3e9025-cae0-488b-a8c9-ad452cccfec3 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:37.058305 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eff223-affd-42e6-99a2-2bf464b51b79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:37.058965 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eff223-affd-42e6-99a2-2bf464b51b79 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:37.060586 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eff223-affd-42e6-99a2-2bf464b51b79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:37.061161 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76eff223-affd-42e6-99a2-2bf464b51b79 admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:37.061907 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eff223-affd-42e6-99a2-2bf464b51b79 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:37.065172 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76eff223-affd-42e6-99a2-2bf464b51b79 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:37.112072 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 948/1911] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:21:37 2022] POST /identity/v3/projects => generated 381 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:21:37.117167 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70798902-9fb7-4588-85fe-419a69ff635d admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:37.134957 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70798902-9fb7-4588-85fe-419a69ff635d admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:37.265121 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f627a6-d211-4e2b-a5d8-3c2e5dc1664f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:37.265765 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f627a6-d211-4e2b-a5d8-3c2e5dc1664f admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:37.266077 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f627a6-d211-4e2b-a5d8-3c2e5dc1664f admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:37.266320 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f627a6-d211-4e2b-a5d8-3c2e5dc1664f admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:37.267141 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f627a6-d211-4e2b-a5d8-3c2e5dc1664f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:37.269156 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f627a6-d211-4e2b-a5d8-3c2e5dc1664f admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:37.311969 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eff223-affd-42e6-99a2-2bf464b51b79 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:37.319936 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 964/1912] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:21:37 2022] POST /identity/v3/users => generated 291 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:21:37.328429 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76eff223-affd-42e6-99a2-2bf464b51b79 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:37.337901 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30815f19-9888-4648-b243-edfa6bb6468c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:37.338532 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30815f19-9888-4648-b243-edfa6bb6468c admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:37.338879 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30815f19-9888-4648-b243-edfa6bb6468c admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:37.339157 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30815f19-9888-4648-b243-edfa6bb6468c admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:37.339859 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30815f19-9888-4648-b243-edfa6bb6468c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:37.343586 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30815f19-9888-4648-b243-edfa6bb6468c admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:37.365717 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 949/1913] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:21:37.370173 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f627a6-d211-4e2b-a5d8-3c2e5dc1664f admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:37.394136 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f627a6-d211-4e2b-a5d8-3c2e5dc1664f admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:37.399662 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1aeeb3-f333-4db4-8bc5-cb943daf8676 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:37.400874 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1aeeb3-f333-4db4-8bc5-cb943daf8676 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:37.401301 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1aeeb3-f333-4db4-8bc5-cb943daf8676 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:37.402491 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1aeeb3-f333-4db4-8bc5-cb943daf8676 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:37.404936 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1aeeb3-f333-4db4-8bc5-cb943daf8676 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:37.407282 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f1aeeb3-f333-4db4-8bc5-cb943daf8676 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:37.436584 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30815f19-9888-4648-b243-edfa6bb6468c admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:37.437173 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 965/1914] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:21:37 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:21:37.449415 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30815f19-9888-4648-b243-edfa6bb6468c admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:37.464456 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a31ac1-52e5-48e2-b43c-ac0a6d2a42d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:37.465932 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a31ac1-52e5-48e2-b43c-ac0a6d2a42d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:37.466318 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a31ac1-52e5-48e2-b43c-ac0a6d2a42d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:37.466741 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a31ac1-52e5-48e2-b43c-ac0a6d2a42d9 admin admin] PATH_INFO: `/v3/projects/bfc03a10353543ff925e668c0766b433/users/69f6a4a879ea4525a0c9b8c531c061f9/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:37.495973 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a31ac1-52e5-48e2-b43c-ac0a6d2a42d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bfc03a10353543ff925e668c0766b433, user_id=69f6a4a879ea4525a0c9b8c531c061f9, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:37.498852 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a31ac1-52e5-48e2-b43c-ac0a6d2a42d9 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:37.524239 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 950/1915] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:21:37 2022] PUT /identity/v3/projects/bfc03a10353543ff925e668c0766b433/users/69f6a4a879ea4525a0c9b8c531c061f9/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:21:37.535865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658c0ce-5a82-4665-bb00-d9d4686d8718 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:37.536152 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658c0ce-5a82-4665-bb00-d9d4686d8718 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:37.536459 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6658c0ce-5a82-4665-bb00-d9d4686d8718 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:37.565013 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:37.604937 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-6658c0ce-5a82-4665-bb00-d9d4686d8718 None None] MFA Rules not processed for user `69f6a4a879ea4525a0c9b8c531c061f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:21:37.607054 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-6658c0ce-5a82-4665-bb00-d9d4686d8718 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:37.641029 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4da30-a065-490d-b6c3-34d5158a87f5 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:37.641798 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4da30-a065-490d-b6c3-34d5158a87f5 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:37.642282 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad4da30-a065-490d-b6c3-34d5158a87f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:37.717917 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-6ad4da30-a065-490d-b6c3-34d5158a87f5 None None] MFA Rules not processed for user `25a3999ecb3f4a3bb52351cf752aa1b7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:21:37.719257 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-6ad4da30-a065-490d-b6c3-34d5158a87f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:37.789002 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 966/1916] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:21:37 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:21:37.793234 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658c0ce-5a82-4665-bb00-d9d4686d8718 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:37.824473 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 951/1917] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:21:37 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:21:37.848110 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4da30-a065-490d-b6c3-34d5158a87f5 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:37.849684 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-6ad4da30-a065-490d-b6c3-34d5158a87f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:37.855273 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:37.918736 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6658c0ce-5a82-4665-bb00-d9d4686d8718 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:37.932240 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bafee8-49c0-4aa7-b674-86f07997e35f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:37.932924 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bafee8-49c0-4aa7-b674-86f07997e35f admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:37.933212 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bafee8-49c0-4aa7-b674-86f07997e35f admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:37.933519 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bafee8-49c0-4aa7-b674-86f07997e35f admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:37.935214 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bafee8-49c0-4aa7-b674-86f07997e35f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:37.937271 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bafee8-49c0-4aa7-b674-86f07997e35f admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:37.937974 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad4da30-a065-490d-b6c3-34d5158a87f5 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:37.942509 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd95be-9e77-4a41-9620-39de86dfb318 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c09080c507f4c35b81d482cfbaa6a88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:37.943225 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd95be-9e77-4a41-9620-39de86dfb318 service glance] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:37.943576 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd95be-9e77-4a41-9620-39de86dfb318 service glance] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:37.943922 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acd95be-9e77-4a41-9620-39de86dfb318 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:37.946010 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-7acd95be-9e77-4a41-9620-39de86dfb318 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:37.995826 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 967/1918] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:21:37 2022] POST /identity/v3/projects => generated 379 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:21:37.998730 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bafee8-49c0-4aa7-b674-86f07997e35f admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:38.120990 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd95be-9e77-4a41-9620-39de86dfb318 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:38.122998 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acd95be-9e77-4a41-9620-39de86dfb318 service glance] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:38.141947 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bafee8-49c0-4aa7-b674-86f07997e35f admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:38.146606 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 952/1919] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:21:37 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:21:38.148274 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48654120-9041-4165-aed1-18371b98e68c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:38.148958 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48654120-9041-4165-aed1-18371b98e68c admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:38.149762 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48654120-9041-4165-aed1-18371b98e68c admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:38.150047 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48654120-9041-4165-aed1-18371b98e68c admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:38.155085 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48654120-9041-4165-aed1-18371b98e68c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:38.157379 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48654120-9041-4165-aed1-18371b98e68c admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:38.193078 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 968/1920] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:21:37 2022] POST /identity/v3/users => generated 296 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:21:38.197287 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd95be-9e77-4a41-9620-39de86dfb318 service glance] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:38.213476 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acd95be-9e77-4a41-9620-39de86dfb318 service glance] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:38.224586 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34746b-cdf4-427a-8a86-0775d1ad27aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:38.225479 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34746b-cdf4-427a-8a86-0775d1ad27aa admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:38.225914 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34746b-cdf4-427a-8a86-0775d1ad27aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:38.227329 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af34746b-cdf4-427a-8a86-0775d1ad27aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:38.228850 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af34746b-cdf4-427a-8a86-0775d1ad27aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:38.232126 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af34746b-cdf4-427a-8a86-0775d1ad27aa admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:38.254266 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 953/1921] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:21:38.258791 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48654120-9041-4165-aed1-18371b98e68c admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:38.272074 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48654120-9041-4165-aed1-18371b98e68c admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:38.279076 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908050bf-e178-479c-a857-5799663af386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:38.279860 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908050bf-e178-479c-a857-5799663af386 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:38.280155 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908050bf-e178-479c-a857-5799663af386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:38.280963 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908050bf-e178-479c-a857-5799663af386 admin admin] PATH_INFO: `/v3/projects/f7fa49e4cb874ea783d7033cb706848c/users/acb9f3031a874bc6853f6fecefdc7f3b/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:38.298615 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:38.303053 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908050bf-e178-479c-a857-5799663af386 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7fa49e4cb874ea783d7033cb706848c, user_id=acb9f3031a874bc6853f6fecefdc7f3b, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:38.309791 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908050bf-e178-479c-a857-5799663af386 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:38.340188 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 969/1922] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:21:38 2022] PUT /identity/v3/projects/f7fa49e4cb874ea783d7033cb706848c/users/acb9f3031a874bc6853f6fecefdc7f3b/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:21:38.345218 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34746b-cdf4-427a-8a86-0775d1ad27aa admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:38.360820 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af34746b-cdf4-427a-8a86-0775d1ad27aa admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:38.467755 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7452ce-467a-48e4-adac-0c0e02388023 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:38.468047 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7452ce-467a-48e4-adac-0c0e02388023 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:38.468352 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7452ce-467a-48e4-adac-0c0e02388023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:38.489579 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f944f0a-7663-4e74-bcb4-270974fa790d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:38.490117 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f944f0a-7663-4e74-bcb4-270974fa790d admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:38.490404 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f944f0a-7663-4e74-bcb4-270974fa790d admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:38.490682 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f944f0a-7663-4e74-bcb4-270974fa790d admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:38.491393 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f944f0a-7663-4e74-bcb4-270974fa790d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:38.493510 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f944f0a-7663-4e74-bcb4-270974fa790d admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:38.508427 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 954/1923] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:21:38.510360 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f944f0a-7663-4e74-bcb4-270974fa790d admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:38.523875 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-df7452ce-467a-48e4-adac-0c0e02388023 None None] MFA Rules not processed for user `36970f0778384576b599cd7217b5084d`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:21:38.526355 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-df7452ce-467a-48e4-adac-0c0e02388023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:38.533202 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f944f0a-7663-4e74-bcb4-270974fa790d admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:38.551792 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13221a83-0884-4e58-afcb-8d2aeda8dde6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:38.555215 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13221a83-0884-4e58-afcb-8d2aeda8dde6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:38.557738 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13221a83-0884-4e58-afcb-8d2aeda8dde6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:38.558256 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13221a83-0884-4e58-afcb-8d2aeda8dde6 admin admin] PATH_INFO: `/v3/projects/f7fa49e4cb874ea783d7033cb706848c/users/acb9f3031a874bc6853f6fecefdc7f3b/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:38.566222 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13221a83-0884-4e58-afcb-8d2aeda8dde6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7fa49e4cb874ea783d7033cb706848c, user_id=acb9f3031a874bc6853f6fecefdc7f3b, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:38.579053 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13221a83-0884-4e58-afcb-8d2aeda8dde6 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:38.628250 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 955/1924] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:21:38 2022] PUT /identity/v3/projects/f7fa49e4cb874ea783d7033cb706848c/users/acb9f3031a874bc6853f6fecefdc7f3b/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:21:38.631761 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30e59e-e5a0-4b7d-a97f-fae6a5a7834b None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:38.632116 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30e59e-e5a0-4b7d-a97f-fae6a5a7834b None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:38.632425 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f30e59e-e5a0-4b7d-a97f-fae6a5a7834b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:38.652433 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 970/1925] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Aug 5 02:21:38 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:21:38.673217 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7452ce-467a-48e4-adac-0c0e02388023 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:38.675295 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-df7452ce-467a-48e4-adac-0c0e02388023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:38.681769 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-9f30e59e-e5a0-4b7d-a97f-fae6a5a7834b None None] MFA Rules not processed for user `acb9f3031a874bc6853f6fecefdc7f3b`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:21:38.687041 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-9f30e59e-e5a0-4b7d-a97f-fae6a5a7834b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:38.736950 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:38.846870 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 956/1926] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:21:38 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:21:38.860951 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30e59e-e5a0-4b7d-a97f-fae6a5a7834b None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:38.861517 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7452ce-467a-48e4-adac-0c0e02388023 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:38.862959 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-9f30e59e-e5a0-4b7d-a97f-fae6a5a7834b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:39.037660 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f30e59e-e5a0-4b7d-a97f-fae6a5a7834b None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:39.051605 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5571c3-6c96-4bb5-a817-521660b75515 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:39.052259 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5571c3-6c96-4bb5-a817-521660b75515 service cinder] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:39.052978 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5571c3-6c96-4bb5-a817-521660b75515 service cinder] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:39.053266 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5571c3-6c96-4bb5-a817-521660b75515 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:39.059946 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b25710-2ea1-4b32-a2c7-ca3f1e6c381a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f03233b0ee3540cdb5105f6603cfdff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:39.070040 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b25710-2ea1-4b32-a2c7-ca3f1e6c381a service swift] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:39.070514 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b25710-2ea1-4b32-a2c7-ca3f1e6c381a service swift] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:39.070980 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b25710-2ea1-4b32-a2c7-ca3f1e6c381a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:39.102532 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5571c3-6c96-4bb5-a817-521660b75515 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:39.108630 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5571c3-6c96-4bb5-a817-521660b75515 service cinder] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:39.125298 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 957/1927] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:21:38 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:21:39.152243 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:39.182204 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b25710-2ea1-4b32-a2c7-ca3f1e6c381a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:39.183465 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b25710-2ea1-4b32-a2c7-ca3f1e6c381a service swift] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:39.211234 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 971/1928] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Aug 5 02:21:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 539 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 02:21:39.251942 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5571c3-6c96-4bb5-a817-521660b75515 service cinder] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:39.265752 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5571c3-6c96-4bb5-a817-521660b75515 service cinder] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:39.276389 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faca8b3-d28c-4a1b-9053-e4a194aa59f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:39.281271 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faca8b3-d28c-4a1b-9053-e4a194aa59f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:39.281587 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faca8b3-d28c-4a1b-9053-e4a194aa59f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:39.281864 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faca8b3-d28c-4a1b-9053-e4a194aa59f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:39.489653 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faca8b3-d28c-4a1b-9053-e4a194aa59f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:39.491143 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2faca8b3-d28c-4a1b-9053-e4a194aa59f4 service cinder] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:39.522442 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 958/1929] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:21:39 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 271 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:21:49.204023 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=9 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:49.505608 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=75 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:50.790089 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10b829-0b9f-48f4-8af0-950476289226 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:50.790625 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10b829-0b9f-48f4-8af0-950476289226 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:50.790743 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac10b829-0b9f-48f4-8af0-950476289226 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:50.810150 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-ac10b829-0b9f-48f4-8af0-950476289226 None None] MFA Rules not processed for user `836dfe4afeef41ab86636b38cb9ccfc1`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:21:50.811365 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-ac10b829-0b9f-48f4-8af0-950476289226 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:50.865099 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 972/1930] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:21:50 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:21:53.862295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a706c-87b0-4ee2-a300-c2b7f0d8ed25 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:53.862824 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a706c-87b0-4ee2-a300-c2b7f0d8ed25 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:53.862824 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b8a706c-87b0-4ee2-a300-c2b7f0d8ed25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:53.882931 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-5b8a706c-87b0-4ee2-a300-c2b7f0d8ed25 None None] MFA Rules not processed for user `36970f0778384576b599cd7217b5084d`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:21:53.887597 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-5b8a706c-87b0-4ee2-a300-c2b7f0d8ed25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:53.903688 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 959/1931] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Aug 5 02:21:53 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:21:53.917083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10b829-0b9f-48f4-8af0-950476289226 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:53.929971 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac10b829-0b9f-48f4-8af0-950476289226 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:53.936037 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6ded5ec-75bc-4074-8340-11b1320c5f29 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f03233b0ee3540cdb5105f6603cfdff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:53.936693 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ded5ec-75bc-4074-8340-11b1320c5f29 service swift] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:53.936972 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ded5ec-75bc-4074-8340-11b1320c5f29 service swift] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:53.937241 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6ded5ec-75bc-4074-8340-11b1320c5f29 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:53.946410 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ded5ec-75bc-4074-8340-11b1320c5f29 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:53.948197 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6ded5ec-75bc-4074-8340-11b1320c5f29 service swift] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:53.957451 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 973/1932] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Aug 5 02:21:53 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 02:21:55.076426 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a706c-87b0-4ee2-a300-c2b7f0d8ed25 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:55.181840 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b8a706c-87b0-4ee2-a300-c2b7f0d8ed25 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:55.189216 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f14917-feb8-40eb-a3e5-77700e098f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:55.189958 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f14917-feb8-40eb-a3e5-77700e098f15 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:55.190125 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f14917-feb8-40eb-a3e5-77700e098f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:55.190423 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f14917-feb8-40eb-a3e5-77700e098f15 admin admin] PATH_INFO: `/v3/users/69f6a4a879ea4525a0c9b8c531c061f9` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:55.191658 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f14917-feb8-40eb-a3e5-77700e098f15 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69f6a4a879ea4525a0c9b8c531c061f9)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:55.193748 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f14917-feb8-40eb-a3e5-77700e098f15 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:55.262512 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-f5f14917-feb8-40eb-a3e5-77700e098f15 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69f6a4a879ea4525a0c9b8c531c061f9'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:55.277444 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-f5f14917-feb8-40eb-a3e5-77700e098f15 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69f6a4a879ea4525a0c9b8c531c061f9'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:55.278453 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-f5f14917-feb8-40eb-a3e5-77700e098f15 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69f6a4a879ea4525a0c9b8c531c061f9'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:55.279123 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-f5f14917-feb8-40eb-a3e5-77700e098f15 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69f6a4a879ea4525a0c9b8c531c061f9'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:55.290980 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-f5f14917-feb8-40eb-a3e5-77700e098f15 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69f6a4a879ea4525a0c9b8c531c061f9'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:55.307039 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 960/1933] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:21:55 2022] DELETE /identity/v3/users/69f6a4a879ea4525a0c9b8c531c061f9 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:21:55.312270 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e7b75-2458-467b-86cc-16da6193161f None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:55.312774 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e7b75-2458-467b-86cc-16da6193161f None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:55.312882 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341e7b75-2458-467b-86cc-16da6193161f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:55.332734 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-341e7b75-2458-467b-86cc-16da6193161f None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:21:55.333967 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-341e7b75-2458-467b-86cc-16da6193161f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:55.395802 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 974/1934] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:21:55 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:21:55.406326 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f14917-feb8-40eb-a3e5-77700e098f15 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:55.408237 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-f5f14917-feb8-40eb-a3e5-77700e098f15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:55.485715 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f14917-feb8-40eb-a3e5-77700e098f15 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:55.489343 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28974fb-823c-434e-a382-f835c1f39c5d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:55.490067 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28974fb-823c-434e-a382-f835c1f39c5d service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:55.490347 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28974fb-823c-434e-a382-f835c1f39c5d service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:55.490618 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28974fb-823c-434e-a382-f835c1f39c5d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:55.500695 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28974fb-823c-434e-a382-f835c1f39c5d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:55.502177 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28974fb-823c-434e-a382-f835c1f39c5d service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:55.512548 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 961/1935] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:21:55 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:21:55.861235 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e7b75-2458-467b-86cc-16da6193161f None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:55.862935 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-341e7b75-2458-467b-86cc-16da6193161f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:55.888816 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341e7b75-2458-467b-86cc-16da6193161f None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:55.894073 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5669a-4afd-4c2a-82af-a6d557faecc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:55.894999 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5669a-4afd-4c2a-82af-a6d557faecc8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:55.895437 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5669a-4afd-4c2a-82af-a6d557faecc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:55.895803 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da5669a-4afd-4c2a-82af-a6d557faecc8 admin admin] PATH_INFO: `/v3/projects/bfc03a10353543ff925e668c0766b433` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:55.897174 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da5669a-4afd-4c2a-82af-a6d557faecc8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bfc03a10353543ff925e668c0766b433)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:55.899160 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2da5669a-4afd-4c2a-82af-a6d557faecc8 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:55.949826 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-2da5669a-4afd-4c2a-82af-a6d557faecc8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bfc03a10353543ff925e668c0766b433', 'request_id': 'req-2da5669a-4afd-4c2a-82af-a6d557faecc8'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:55.955229 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-2da5669a-4afd-4c2a-82af-a6d557faecc8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bfc03a10353543ff925e668c0766b433', 'request_id': 'req-2da5669a-4afd-4c2a-82af-a6d557faecc8'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:55.962204 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-2da5669a-4afd-4c2a-82af-a6d557faecc8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bfc03a10353543ff925e668c0766b433', 'request_id': 'req-2da5669a-4afd-4c2a-82af-a6d557faecc8'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:55.973816 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-2da5669a-4afd-4c2a-82af-a6d557faecc8 admin admin] The token cache is being invalidate because project bfc03a10353543ff925e668c0766b433 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:21:55.974008 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-2da5669a-4afd-4c2a-82af-a6d557faecc8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:55.974639 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-2da5669a-4afd-4c2a-82af-a6d557faecc8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:55.976165 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 975/1936] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:21:55 2022] DELETE /identity/v3/projects/bfc03a10353543ff925e668c0766b433 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:21:55.980051 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28974fb-823c-434e-a382-f835c1f39c5d service neutron] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:55.991148 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28974fb-823c-434e-a382-f835c1f39c5d service neutron] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:56.011763 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:56.057524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff3511-33f3-4e3e-99f6-ec040d7b1859 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:56.058160 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff3511-33f3-4e3e-99f6-ec040d7b1859 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:56.058997 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff3511-33f3-4e3e-99f6-ec040d7b1859 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:56.059271 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eff3511-33f3-4e3e-99f6-ec040d7b1859 admin admin] PATH_INFO: `/v3/users/acb9f3031a874bc6853f6fecefdc7f3b` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:56.060471 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff3511-33f3-4e3e-99f6-ec040d7b1859 admin admin] RBAC: Authorizing `identity:delete_user(user_id=acb9f3031a874bc6853f6fecefdc7f3b)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:56.062375 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eff3511-33f3-4e3e-99f6-ec040d7b1859 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:56.111061 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-1eff3511-33f3-4e3e-99f6-ec040d7b1859 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'acb9f3031a874bc6853f6fecefdc7f3b'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:56.126216 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-1eff3511-33f3-4e3e-99f6-ec040d7b1859 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'acb9f3031a874bc6853f6fecefdc7f3b'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:56.127026 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-1eff3511-33f3-4e3e-99f6-ec040d7b1859 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'acb9f3031a874bc6853f6fecefdc7f3b'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:56.127632 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-1eff3511-33f3-4e3e-99f6-ec040d7b1859 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'acb9f3031a874bc6853f6fecefdc7f3b'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:56.135528 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-1eff3511-33f3-4e3e-99f6-ec040d7b1859 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'acb9f3031a874bc6853f6fecefdc7f3b'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:56.154820 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 962/1937] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:21:55 2022] DELETE /identity/v3/users/acb9f3031a874bc6853f6fecefdc7f3b => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:21:56.364278 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5669a-4afd-4c2a-82af-a6d557faecc8 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:56.366506 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-2da5669a-4afd-4c2a-82af-a6d557faecc8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:56.380680 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2da5669a-4afd-4c2a-82af-a6d557faecc8 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:56.393991 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:56.495358 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50ca364-a6a1-4c06-b0ab-963eca2ebad1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:56.496491 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ca364-a6a1-4c06-b0ab-963eca2ebad1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:56.496491 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ca364-a6a1-4c06-b0ab-963eca2ebad1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:56.499138 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50ca364-a6a1-4c06-b0ab-963eca2ebad1 admin admin] PATH_INFO: `/v3/users/c672e67b68b24732b915c4a9ec8650ec` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:56.499138 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ca364-a6a1-4c06-b0ab-963eca2ebad1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c672e67b68b24732b915c4a9ec8650ec)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:56.500430 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50ca364-a6a1-4c06-b0ab-963eca2ebad1 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:56.552484 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-b50ca364-a6a1-4c06-b0ab-963eca2ebad1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c672e67b68b24732b915c4a9ec8650ec'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:56.561851 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff3511-33f3-4e3e-99f6-ec040d7b1859 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:56.563562 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-1eff3511-33f3-4e3e-99f6-ec040d7b1859 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:56.569497 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-b50ca364-a6a1-4c06-b0ab-963eca2ebad1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c672e67b68b24732b915c4a9ec8650ec'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:56.570390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-b50ca364-a6a1-4c06-b0ab-963eca2ebad1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c672e67b68b24732b915c4a9ec8650ec'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:56.570975 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-b50ca364-a6a1-4c06-b0ab-963eca2ebad1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c672e67b68b24732b915c4a9ec8650ec'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:56.578468 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eff3511-33f3-4e3e-99f6-ec040d7b1859 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:56.582960 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-b50ca364-a6a1-4c06-b0ab-963eca2ebad1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c672e67b68b24732b915c4a9ec8650ec'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:56.584934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a6724-0bec-4f7a-bd60-731fa98c3ad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:56.586015 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a6724-0bec-4f7a-bd60-731fa98c3ad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:56.586460 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a6724-0bec-4f7a-bd60-731fa98c3ad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:56.586833 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a6724-0bec-4f7a-bd60-731fa98c3ad6 admin admin] PATH_INFO: `/v3/projects/f7fa49e4cb874ea783d7033cb706848c` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:56.588479 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81a6724-0bec-4f7a-bd60-731fa98c3ad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7fa49e4cb874ea783d7033cb706848c)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:56.591927 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81a6724-0bec-4f7a-bd60-731fa98c3ad6 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:56.601666 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 976/1938] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:21:56 2022] DELETE /identity/v3/users/c672e67b68b24732b915c4a9ec8650ec => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:21:56.606549 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e057dc9-a373-4010-a808-585c3f9779a8 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:56.607104 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e057dc9-a373-4010-a808-585c3f9779a8 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:56.607532 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e057dc9-a373-4010-a808-585c3f9779a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:56.649117 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-e81a6724-0bec-4f7a-bd60-731fa98c3ad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7fa49e4cb874ea783d7033cb706848c', 'request_id': 'req-e81a6724-0bec-4f7a-bd60-731fa98c3ad6'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:56.651482 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-2e057dc9-a373-4010-a808-585c3f9779a8 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:21:56.655819 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-e81a6724-0bec-4f7a-bd60-731fa98c3ad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7fa49e4cb874ea783d7033cb706848c', 'request_id': 'req-e81a6724-0bec-4f7a-bd60-731fa98c3ad6'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:56.661103 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-2e057dc9-a373-4010-a808-585c3f9779a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:56.667064 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-e81a6724-0bec-4f7a-bd60-731fa98c3ad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7fa49e4cb874ea783d7033cb706848c', 'request_id': 'req-e81a6724-0bec-4f7a-bd60-731fa98c3ad6'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:56.680742 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-e81a6724-0bec-4f7a-bd60-731fa98c3ad6 admin admin] The token cache is being invalidate because project f7fa49e4cb874ea783d7033cb706848c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:21:56.681278 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-e81a6724-0bec-4f7a-bd60-731fa98c3ad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:56.682073 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-e81a6724-0bec-4f7a-bd60-731fa98c3ad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:56.684046 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 963/1939] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:21:56 2022] DELETE /identity/v3/projects/f7fa49e4cb874ea783d7033cb706848c => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:21:56.689886 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5afe4f-0ca4-4e28-b846-3f815eae38d2 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:56.690845 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5afe4f-0ca4-4e28-b846-3f815eae38d2 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:56.691300 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5afe4f-0ca4-4e28-b846-3f815eae38d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:56.719960 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-cb5afe4f-0ca4-4e28-b846-3f815eae38d2 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:21:56.721724 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-cb5afe4f-0ca4-4e28-b846-3f815eae38d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:56.739452 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:56.762443 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 977/1940] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:21:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:21:56.774947 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e057dc9-a373-4010-a808-585c3f9779a8 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:56.776868 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-2e057dc9-a373-4010-a808-585c3f9779a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:56.818601 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 964/1941] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:21:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:21:56.827688 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c93ab-2350-4d2a-aa55-1e5b1d5e0726 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:56.827979 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c93ab-2350-4d2a-aa55-1e5b1d5e0726 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:56.828252 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1c93ab-2350-4d2a-aa55-1e5b1d5e0726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:56.837355 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:56.861745 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-1a1c93ab-2350-4d2a-aa55-1e5b1d5e0726 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:21:56.863046 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-1a1c93ab-2350-4d2a-aa55-1e5b1d5e0726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:56.865550 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e057dc9-a373-4010-a808-585c3f9779a8 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:56.872233 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503dea42-b912-4fba-8dc4-2b516831936f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:56.872990 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503dea42-b912-4fba-8dc4-2b516831936f service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:56.873259 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503dea42-b912-4fba-8dc4-2b516831936f service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:56.873535 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503dea42-b912-4fba-8dc4-2b516831936f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:56.874353 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 965/1942] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:21:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:21:56.878309 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c93ab-2350-4d2a-aa55-1e5b1d5e0726 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:56.888206 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503dea42-b912-4fba-8dc4-2b516831936f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:56.890183 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503dea42-b912-4fba-8dc4-2b516831936f service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:56.894096 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1c93ab-2350-4d2a-aa55-1e5b1d5e0726 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:56.901856 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94ef38-cfdb-4a26-864d-2c2d5d37dc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:56.903634 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94ef38-cfdb-4a26-864d-2c2d5d37dc74 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:56.904108 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94ef38-cfdb-4a26-864d-2c2d5d37dc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:56.904585 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d94ef38-cfdb-4a26-864d-2c2d5d37dc74 admin admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:56.905304 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d94ef38-cfdb-4a26-864d-2c2d5d37dc74 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:21:56.905738 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d94ef38-cfdb-4a26-864d-2c2d5d37dc74 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:56.908598 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 978/1943] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:21:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:21:56.916655 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d94ef38-cfdb-4a26-864d-2c2d5d37dc74 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:56.940398 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 966/1944] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:21:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:21:56.944501 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503dea42-b912-4fba-8dc4-2b516831936f service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:56.956061 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503dea42-b912-4fba-8dc4-2b516831936f service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:56.961212 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db58295-49e6-4c94-9c72-f78cd20d25a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:56.961853 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db58295-49e6-4c94-9c72-f78cd20d25a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:56.962180 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db58295-49e6-4c94-9c72-f78cd20d25a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:56.962460 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db58295-49e6-4c94-9c72-f78cd20d25a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:56.963259 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db58295-49e6-4c94-9c72-f78cd20d25a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:56.965777 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db58295-49e6-4c94-9c72-f78cd20d25a4 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:57.020434 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 979/1945] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:21:56 2022] POST /identity/v3/projects => generated 365 bytes in 75 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:21:57.023082 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94ef38-cfdb-4a26-864d-2c2d5d37dc74 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:57.034259 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d94ef38-cfdb-4a26-864d-2c2d5d37dc74 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:57.101971 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186d22a-2710-45be-bd97-0d2ce43bad16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:57.103008 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186d22a-2710-45be-bd97-0d2ce43bad16 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:57.103289 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186d22a-2710-45be-bd97-0d2ce43bad16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:57.103563 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c186d22a-2710-45be-bd97-0d2ce43bad16 admin admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:57.104239 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186d22a-2710-45be-bd97-0d2ce43bad16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:57.107300 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c186d22a-2710-45be-bd97-0d2ce43bad16 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:57.159787 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db58295-49e6-4c94-9c72-f78cd20d25a4 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:57.159993 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 967/1946] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:21:57 2022] POST /identity/v3/users => generated 283 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:21:57.171235 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db58295-49e6-4c94-9c72-f78cd20d25a4 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:57.197763 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb1e2a3-5d83-4c70-93a1-075e52f63d51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:57.197763 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1e2a3-5d83-4c70-93a1-075e52f63d51 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:57.197763 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1e2a3-5d83-4c70-93a1-075e52f63d51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:57.197763 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb1e2a3-5d83-4c70-93a1-075e52f63d51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:57.198259 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb1e2a3-5d83-4c70-93a1-075e52f63d51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:57.198259 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbb1e2a3-5d83-4c70-93a1-075e52f63d51 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:57.211529 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 980/1947] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:21:57.215977 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186d22a-2710-45be-bd97-0d2ce43bad16 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:57.226043 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c186d22a-2710-45be-bd97-0d2ce43bad16 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:57.236352 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e9015-6343-4241-9b7f-072bd108780a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:57.237510 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e9015-6343-4241-9b7f-072bd108780a admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:57.238082 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e9015-6343-4241-9b7f-072bd108780a admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:57.238636 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-366e9015-6343-4241-9b7f-072bd108780a admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:57.239934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e9015-6343-4241-9b7f-072bd108780a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:57.242117 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-366e9015-6343-4241-9b7f-072bd108780a admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:57.257622 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 968/1948] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:21:57.266423 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb1e2a3-5d83-4c70-93a1-075e52f63d51 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:57.278875 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e9015-6343-4241-9b7f-072bd108780a admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:57.280854 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-366e9015-6343-4241-9b7f-072bd108780a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:57.282631 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb1e2a3-5d83-4c70-93a1-075e52f63d51 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:57.291719 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5d7a2-4fea-450d-a8d4-eda288beace2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:57.294058 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5d7a2-4fea-450d-a8d4-eda288beace2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:57.294058 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5d7a2-4fea-450d-a8d4-eda288beace2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:57.294058 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5d7a2-4fea-450d-a8d4-eda288beace2 admin admin] PATH_INFO: `/v3/projects/8eaab07df767462c94108e0651587970/users/d9c684af7a0f439e918f20962cb41889/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:57.304535 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-366e9015-6343-4241-9b7f-072bd108780a admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:57.318020 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4e0834-a848-4a49-a822-48a1b070cd1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:57.318664 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e0834-a848-4a49-a822-48a1b070cd1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:57.318990 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e0834-a848-4a49-a822-48a1b070cd1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:57.319213 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4e0834-a848-4a49-a822-48a1b070cd1d admin admin] PATH_INFO: `/v3/projects/e1b1b0bc2a114b0b8c027b2e28831c31` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:57.320486 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4e0834-a848-4a49-a822-48a1b070cd1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1b1b0bc2a114b0b8c027b2e28831c31)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:57.321772 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5d7a2-4fea-450d-a8d4-eda288beace2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8eaab07df767462c94108e0651587970, user_id=d9c684af7a0f439e918f20962cb41889, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:57.322507 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be4e0834-a848-4a49-a822-48a1b070cd1d admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:57.325288 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5d7a2-4fea-450d-a8d4-eda288beace2 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:57.343053 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 981/1949] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:21:57 2022] PUT /identity/v3/projects/8eaab07df767462c94108e0651587970/users/d9c684af7a0f439e918f20962cb41889/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 79 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:21:57.353710 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6a537-3d6f-4770-ab51-30e4d366f888 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:57.353999 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6a537-3d6f-4770-ab51-30e4d366f888 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:57.354257 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d6a537-3d6f-4770-ab51-30e4d366f888 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:57.385749 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-be4e0834-a848-4a49-a822-48a1b070cd1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1b1b0bc2a114b0b8c027b2e28831c31', 'request_id': 'req-be4e0834-a848-4a49-a822-48a1b070cd1d'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:57.385996 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-20d6a537-3d6f-4770-ab51-30e4d366f888 None None] MFA Rules not processed for user `d9c684af7a0f439e918f20962cb41889`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:21:57.387683 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-20d6a537-3d6f-4770-ab51-30e4d366f888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:57.394000 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-be4e0834-a848-4a49-a822-48a1b070cd1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1b1b0bc2a114b0b8c027b2e28831c31', 'request_id': 'req-be4e0834-a848-4a49-a822-48a1b070cd1d'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:57.409163 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-be4e0834-a848-4a49-a822-48a1b070cd1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1b1b0bc2a114b0b8c027b2e28831c31', 'request_id': 'req-be4e0834-a848-4a49-a822-48a1b070cd1d'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:57.417630 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:57.423868 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-be4e0834-a848-4a49-a822-48a1b070cd1d admin admin] The token cache is being invalidate because project e1b1b0bc2a114b0b8c027b2e28831c31 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:21:57.424144 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-be4e0834-a848-4a49-a822-48a1b070cd1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:57.425183 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-be4e0834-a848-4a49-a822-48a1b070cd1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:57.428604 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 969/1950] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:21:57 2022] DELETE /identity/v3/projects/e1b1b0bc2a114b0b8c027b2e28831c31 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:21:57.432963 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d1057-9f6d-4385-86a2-01c340d31990 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:57.433479 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d1057-9f6d-4385-86a2-01c340d31990 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:57.434058 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d1057-9f6d-4385-86a2-01c340d31990 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:57.457223 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-959d1057-9f6d-4385-86a2-01c340d31990 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:21:57.458422 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-959d1057-9f6d-4385-86a2-01c340d31990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:57.470666 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 982/1951] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:21:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:21:57.475461 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6a537-3d6f-4770-ab51-30e4d366f888 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:57.476987 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-20d6a537-3d6f-4770-ab51-30e4d366f888 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:57.547588 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 970/1952] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:21:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:21:57.548958 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052493c7-57f0-4c2e-854a-ff0c52bd4e5f None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:57.549284 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052493c7-57f0-4c2e-854a-ff0c52bd4e5f None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:57.549517 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-052493c7-57f0-4c2e-854a-ff0c52bd4e5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:57.576554 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d6a537-3d6f-4770-ab51-30e4d366f888 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:57.580581 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-052493c7-57f0-4c2e-854a-ff0c52bd4e5f None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:21:57.582683 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-052493c7-57f0-4c2e-854a-ff0c52bd4e5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:57.586476 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8b840-621d-4f48-aa7d-e9e1703b0285 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:57.587562 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8b840-621d-4f48-aa7d-e9e1703b0285 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:57.587837 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8b840-621d-4f48-aa7d-e9e1703b0285 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:57.588355 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc8b840-621d-4f48-aa7d-e9e1703b0285 admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:57.589194 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8b840-621d-4f48-aa7d-e9e1703b0285 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:57.593175 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afc8b840-621d-4f48-aa7d-e9e1703b0285 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:57.604258 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 971/1953] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:21:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:21:57.605864 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052493c7-57f0-4c2e-854a-ff0c52bd4e5f None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:57.618054 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-052493c7-57f0-4c2e-854a-ff0c52bd4e5f None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:57.619435 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:57.633231 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e256da7-171b-4212-943d-ff5f48dad265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:57.633849 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e256da7-171b-4212-943d-ff5f48dad265 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:57.634146 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e256da7-171b-4212-943d-ff5f48dad265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:57.634405 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e256da7-171b-4212-943d-ff5f48dad265 admin admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:57.635220 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e256da7-171b-4212-943d-ff5f48dad265 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:21:57.635529 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e256da7-171b-4212-943d-ff5f48dad265 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:57.637394 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e256da7-171b-4212-943d-ff5f48dad265 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:57.638928 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 983/1954] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:21:57 2022] POST /identity/v3/projects => generated 365 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:21:57.642978 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8b840-621d-4f48-aa7d-e9e1703b0285 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:57.651095 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 972/1955] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:21:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:21:57.656413 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e256da7-171b-4212-943d-ff5f48dad265 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:57.666578 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e256da7-171b-4212-943d-ff5f48dad265 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:57.721553 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc8b840-621d-4f48-aa7d-e9e1703b0285 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:57.725094 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42c9a9-8f45-4082-ab63-16cb09890cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:57.725705 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42c9a9-8f45-4082-ab63-16cb09890cc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:57.725991 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42c9a9-8f45-4082-ab63-16cb09890cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:57.726215 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291435b-6a99-44b8-b646-6547d8ae4ed1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:57.726425 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e42c9a9-8f45-4082-ab63-16cb09890cc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:57.726829 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291435b-6a99-44b8-b646-6547d8ae4ed1 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:57.726926 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e42c9a9-8f45-4082-ab63-16cb09890cc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:57.727105 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291435b-6a99-44b8-b646-6547d8ae4ed1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:57.727376 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a291435b-6a99-44b8-b646-6547d8ae4ed1 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:57.728028 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291435b-6a99-44b8-b646-6547d8ae4ed1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:57.728831 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e42c9a9-8f45-4082-ab63-16cb09890cc7 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:57.729956 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a291435b-6a99-44b8-b646-6547d8ae4ed1 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:57.752725 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 984/1956] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:21:57 2022] POST /identity/v3/users => generated 289 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:21:57.757150 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291435b-6a99-44b8-b646-6547d8ae4ed1 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:57.764316 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 973/1957] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:21:57 2022] POST /identity/v3/projects => generated 375 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:21:57.768464 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42c9a9-8f45-4082-ab63-16cb09890cc7 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:57.772831 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a291435b-6a99-44b8-b646-6547d8ae4ed1 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:57.839354 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d644e0d-fd83-49a3-85e9-c7320186b361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:57.840504 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d644e0d-fd83-49a3-85e9-c7320186b361 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:57.840791 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d644e0d-fd83-49a3-85e9-c7320186b361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:57.841074 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d644e0d-fd83-49a3-85e9-c7320186b361 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:57.841777 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d644e0d-fd83-49a3-85e9-c7320186b361 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:57.843623 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d644e0d-fd83-49a3-85e9-c7320186b361 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:57.844456 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e42c9a9-8f45-4082-ab63-16cb09890cc7 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:57.850868 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e68cef-ab42-41ee-8217-c75f030a61f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:57.850868 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e68cef-ab42-41ee-8217-c75f030a61f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:57.850868 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e68cef-ab42-41ee-8217-c75f030a61f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:57.850868 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e68cef-ab42-41ee-8217-c75f030a61f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:57.851544 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e68cef-ab42-41ee-8217-c75f030a61f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:57.853502 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e68cef-ab42-41ee-8217-c75f030a61f6 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:57.858970 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 985/1958] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:21:57.859977 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d644e0d-fd83-49a3-85e9-c7320186b361 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:57.872909 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d644e0d-fd83-49a3-85e9-c7320186b361 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:57.873710 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:57.881570 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b8920c-c55b-4512-a99e-9c186bcdcb7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:57.882343 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8920c-c55b-4512-a99e-9c186bcdcb7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:57.882686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8920c-c55b-4512-a99e-9c186bcdcb7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:57.883180 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b8920c-c55b-4512-a99e-9c186bcdcb7c admin admin] PATH_INFO: `/v3/projects/f7d082d54fb444aaa42f416d56cbae69/users/669150dced17422493b102f43a309f1c/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:57.891904 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 974/1959] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:21:57 2022] POST /identity/v3/users => generated 288 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:21:57.895904 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e68cef-ab42-41ee-8217-c75f030a61f6 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:57.905975 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b8920c-c55b-4512-a99e-9c186bcdcb7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7d082d54fb444aaa42f416d56cbae69, user_id=669150dced17422493b102f43a309f1c, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:57.910052 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b8920c-c55b-4512-a99e-9c186bcdcb7c admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:57.920957 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e68cef-ab42-41ee-8217-c75f030a61f6 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:57.930141 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff6c71-fc7b-4417-87a0-85bac1c340f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:57.931453 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff6c71-fc7b-4417-87a0-85bac1c340f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:57.932508 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff6c71-fc7b-4417-87a0-85bac1c340f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:57.932987 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ff6c71-fc7b-4417-87a0-85bac1c340f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:57.933892 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff6c71-fc7b-4417-87a0-85bac1c340f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:57.936441 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ff6c71-fc7b-4417-87a0-85bac1c340f9 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:57.937676 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 986/1960] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:21:57 2022] PUT /identity/v3/projects/f7d082d54fb444aaa42f416d56cbae69/users/669150dced17422493b102f43a309f1c/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 78 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:21:57.941704 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b8920c-c55b-4512-a99e-9c186bcdcb7c admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:57.951015 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 975/1961] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:21:57.954801 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff6c71-fc7b-4417-87a0-85bac1c340f9 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:57.966703 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ff6c71-fc7b-4417-87a0-85bac1c340f9 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:58.056005 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f68b8b-beb3-49e8-8fd0-16224c89d610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:58.057031 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f68b8b-beb3-49e8-8fd0-16224c89d610 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:58.057554 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f68b8b-beb3-49e8-8fd0-16224c89d610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:58.058015 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f68b8b-beb3-49e8-8fd0-16224c89d610 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:58.059438 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f68b8b-beb3-49e8-8fd0-16224c89d610 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:58.060459 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:58.061234 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f68b8b-beb3-49e8-8fd0-16224c89d610 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:58.072263 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 976/1962] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:21:58.075653 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b8920c-c55b-4512-a99e-9c186bcdcb7c admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:58.078557 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f68b8b-beb3-49e8-8fd0-16224c89d610 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:58.081773 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26d0d5-fe28-4ed2-a1da-a8915bbd943d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:58.082525 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26d0d5-fe28-4ed2-a1da-a8915bbd943d admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:58.082807 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26d0d5-fe28-4ed2-a1da-a8915bbd943d admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:58.083099 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e26d0d5-fe28-4ed2-a1da-a8915bbd943d admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:58.083946 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26d0d5-fe28-4ed2-a1da-a8915bbd943d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:58.085648 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e26d0d5-fe28-4ed2-a1da-a8915bbd943d admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:58.091365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f68b8b-beb3-49e8-8fd0-16224c89d610 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:58.096519 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a220d-4c77-4608-a5a8-8c09d2b4d1ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:58.097188 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 987/1963] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:21:58.097301 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a220d-4c77-4608-a5a8-8c09d2b4d1ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:58.097490 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a220d-4c77-4608-a5a8-8c09d2b4d1ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:58.097738 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a220d-4c77-4608-a5a8-8c09d2b4d1ea admin admin] PATH_INFO: `/v3/projects/72234dc79eb84cbdb45436a6448c6a49/users/bbb511682e4346ed94d62f092a27d58a/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:58.100935 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26d0d5-fe28-4ed2-a1da-a8915bbd943d admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:58.124478 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a220d-4c77-4608-a5a8-8c09d2b4d1ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=72234dc79eb84cbdb45436a6448c6a49, user_id=bbb511682e4346ed94d62f092a27d58a, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:58.124636 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e26d0d5-fe28-4ed2-a1da-a8915bbd943d admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:58.124733 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a220d-4c77-4608-a5a8-8c09d2b4d1ea admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:58.124827 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f01446a-4317-4555-a328-7aaa66103db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:58.124827 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01446a-4317-4555-a328-7aaa66103db0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:58.124827 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01446a-4317-4555-a328-7aaa66103db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:58.124827 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f01446a-4317-4555-a328-7aaa66103db0 admin admin] PATH_INFO: `/v3/projects/f7d082d54fb444aaa42f416d56cbae69/users/669150dced17422493b102f43a309f1c/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:58.125141 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f01446a-4317-4555-a328-7aaa66103db0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f7d082d54fb444aaa42f416d56cbae69, user_id=669150dced17422493b102f43a309f1c, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:58.127870 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f01446a-4317-4555-a328-7aaa66103db0 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:58.135027 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 977/1964] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:21:58 2022] PUT /identity/v3/projects/72234dc79eb84cbdb45436a6448c6a49/users/bbb511682e4346ed94d62f092a27d58a/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:21:58.138829 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 988/1965] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:21:58 2022] PUT /identity/v3/projects/f7d082d54fb444aaa42f416d56cbae69/users/669150dced17422493b102f43a309f1c/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:21:58.145980 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf7e8c-b01c-419b-ad85-69dcbeb1a176 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:58.146252 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf7e8c-b01c-419b-ad85-69dcbeb1a176 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:58.146528 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2faf7e8c-b01c-419b-ad85-69dcbeb1a176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:58.149771 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2858c-a9b9-4e53-ac7d-515a1177984a None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:58.150063 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2858c-a9b9-4e53-ac7d-515a1177984a None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:58.150345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f2858c-a9b9-4e53-ac7d-515a1177984a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:58.185749 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-42f2858c-a9b9-4e53-ac7d-515a1177984a None None] MFA Rules not processed for user `669150dced17422493b102f43a309f1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:21:58.186535 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-2faf7e8c-b01c-419b-ad85-69dcbeb1a176 None None] MFA Rules not processed for user `bbb511682e4346ed94d62f092a27d58a`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:21:58.187063 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-42f2858c-a9b9-4e53-ac7d-515a1177984a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:58.188114 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-2faf7e8c-b01c-419b-ad85-69dcbeb1a176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:58.278128 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 978/1966] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:21:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:21:58.281845 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 989/1967] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:21:58 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:21:58.289028 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf7e8c-b01c-419b-ad85-69dcbeb1a176 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:58.290444 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-2faf7e8c-b01c-419b-ad85-69dcbeb1a176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:58.293355 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f2858c-a9b9-4e53-ac7d-515a1177984a None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:58.294914 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-42f2858c-a9b9-4e53-ac7d-515a1177984a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:58.355596 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f2858c-a9b9-4e53-ac7d-515a1177984a None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:58.357947 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:58.359363 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8cc17-5813-4a85-9846-59722ffc979d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:58.360045 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8cc17-5813-4a85-9846-59722ffc979d service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:58.360351 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8cc17-5813-4a85-9846-59722ffc979d service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:58.360637 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad8cc17-5813-4a85-9846-59722ffc979d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:58.361006 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2faf7e8c-b01c-419b-ad85-69dcbeb1a176 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:58.365372 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fb3935-d98e-45b1-a50e-ed36d57bd7ae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:58.366404 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb3935-d98e-45b1-a50e-ed36d57bd7ae service cinder] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:58.366900 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb3935-d98e-45b1-a50e-ed36d57bd7ae service cinder] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:58.367403 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fb3935-d98e-45b1-a50e-ed36d57bd7ae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:58.372170 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8cc17-5813-4a85-9846-59722ffc979d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:58.373852 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad8cc17-5813-4a85-9846-59722ffc979d service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:58.378013 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fb3935-d98e-45b1-a50e-ed36d57bd7ae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:58.379582 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fb3935-d98e-45b1-a50e-ed36d57bd7ae service cinder] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:58.385588 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 990/1968] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:21:58 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:21:58.391460 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 979/1969] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:21:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:21:59.018938 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8cc17-5813-4a85-9846-59722ffc979d service cinder] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:59.084493 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad8cc17-5813-4a85-9846-59722ffc979d service cinder] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:59.089014 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ce3c5-734d-4372-807c-1f89bd1a2750 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:59.090282 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ce3c5-734d-4372-807c-1f89bd1a2750 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:59.090563 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ce3c5-734d-4372-807c-1f89bd1a2750 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:59.090833 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66ce3c5-734d-4372-807c-1f89bd1a2750 admin admin] PATH_INFO: `/v3/users/d9c684af7a0f439e918f20962cb41889` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:59.092003 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ce3c5-734d-4372-807c-1f89bd1a2750 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9c684af7a0f439e918f20962cb41889)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:59.093968 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66ce3c5-734d-4372-807c-1f89bd1a2750 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:59.104205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:59.163316 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-b66ce3c5-734d-4372-807c-1f89bd1a2750 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9c684af7a0f439e918f20962cb41889'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:59.175391 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-b66ce3c5-734d-4372-807c-1f89bd1a2750 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9c684af7a0f439e918f20962cb41889'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:59.176069 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-b66ce3c5-734d-4372-807c-1f89bd1a2750 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9c684af7a0f439e918f20962cb41889'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:59.176717 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-b66ce3c5-734d-4372-807c-1f89bd1a2750 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9c684af7a0f439e918f20962cb41889'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:59.185948 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-b66ce3c5-734d-4372-807c-1f89bd1a2750 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9c684af7a0f439e918f20962cb41889'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:59.200193 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 991/1970] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:21:59 2022] DELETE /identity/v3/users/d9c684af7a0f439e918f20962cb41889 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:21:59.204845 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa35a61-c642-471d-aa4e-33a5ceb67ff1 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:59.205364 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa35a61-c642-471d-aa4e-33a5ceb67ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:59.205688 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa35a61-c642-471d-aa4e-33a5ceb67ff1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:59.229546 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-ffa35a61-c642-471d-aa4e-33a5ceb67ff1 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:21:59.231781 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-ffa35a61-c642-471d-aa4e-33a5ceb67ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:59.299701 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 980/1971] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:21:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:21:59.309470 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ce3c5-734d-4372-807c-1f89bd1a2750 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:59.311014 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-b66ce3c5-734d-4372-807c-1f89bd1a2750 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:59.393082 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66ce3c5-734d-4372-807c-1f89bd1a2750 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:59.396639 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4f914-296b-41dc-ab56-83b9a15ba03e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:59.397267 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4f914-296b-41dc-ab56-83b9a15ba03e service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:59.397545 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4f914-296b-41dc-ab56-83b9a15ba03e service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:59.397816 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea4f914-296b-41dc-ab56-83b9a15ba03e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:59.408047 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea4f914-296b-41dc-ab56-83b9a15ba03e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:59.409499 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea4f914-296b-41dc-ab56-83b9a15ba03e service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:59.418887 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 992/1972] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:21:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:21:59.712124 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa35a61-c642-471d-aa4e-33a5ceb67ff1 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:59.713586 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-ffa35a61-c642-471d-aa4e-33a5ceb67ff1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:21:59.728555 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa35a61-c642-471d-aa4e-33a5ceb67ff1 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:59.735097 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3b9b5-cdbc-45a8-a640-123155636085 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:59.735781 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3b9b5-cdbc-45a8-a640-123155636085 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:59.736064 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3b9b5-cdbc-45a8-a640-123155636085 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:59.736364 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba3b9b5-cdbc-45a8-a640-123155636085 admin admin] PATH_INFO: `/v3/projects/8eaab07df767462c94108e0651587970` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:59.737670 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3b9b5-cdbc-45a8-a640-123155636085 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8eaab07df767462c94108e0651587970)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:59.739642 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba3b9b5-cdbc-45a8-a640-123155636085 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:59.790367 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-2ba3b9b5-cdbc-45a8-a640-123155636085 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8eaab07df767462c94108e0651587970', 'request_id': 'req-2ba3b9b5-cdbc-45a8-a640-123155636085'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:59.798093 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-2ba3b9b5-cdbc-45a8-a640-123155636085 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8eaab07df767462c94108e0651587970', 'request_id': 'req-2ba3b9b5-cdbc-45a8-a640-123155636085'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:59.821081 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-2ba3b9b5-cdbc-45a8-a640-123155636085 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8eaab07df767462c94108e0651587970', 'request_id': 'req-2ba3b9b5-cdbc-45a8-a640-123155636085'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:59.835308 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-2ba3b9b5-cdbc-45a8-a640-123155636085 admin admin] The token cache is being invalidate because project 8eaab07df767462c94108e0651587970 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:21:59.835803 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-2ba3b9b5-cdbc-45a8-a640-123155636085 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:59.836659 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-2ba3b9b5-cdbc-45a8-a640-123155636085 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:59.838446 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 981/1973] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:21:59 2022] DELETE /identity/v3/projects/8eaab07df767462c94108e0651587970 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:21:59.842506 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4f914-296b-41dc-ab56-83b9a15ba03e service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:21:59.852600 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea4f914-296b-41dc-ab56-83b9a15ba03e service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:21:59.913889 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91e36b03-7a57-49d2-91e6-1190d7fb339a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:21:59.914461 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e36b03-7a57-49d2-91e6-1190d7fb339a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:21:59.914774 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e36b03-7a57-49d2-91e6-1190d7fb339a admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:21:59.915019 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e36b03-7a57-49d2-91e6-1190d7fb339a admin admin] PATH_INFO: `/v3/users/669150dced17422493b102f43a309f1c` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:21:59.916212 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e36b03-7a57-49d2-91e6-1190d7fb339a admin admin] RBAC: Authorizing `identity:delete_user(user_id=669150dced17422493b102f43a309f1c)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:21:59.919058 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91e36b03-7a57-49d2-91e6-1190d7fb339a admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:21:59.956573 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:DELETE=15,keystone:SELECT=84,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:21:59.971484 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-91e36b03-7a57-49d2-91e6-1190d7fb339a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '669150dced17422493b102f43a309f1c'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:59.985166 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-91e36b03-7a57-49d2-91e6-1190d7fb339a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '669150dced17422493b102f43a309f1c'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:59.985936 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-91e36b03-7a57-49d2-91e6-1190d7fb339a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '669150dced17422493b102f43a309f1c'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:59.986544 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-91e36b03-7a57-49d2-91e6-1190d7fb339a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '669150dced17422493b102f43a309f1c'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:21:59.994775 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-91e36b03-7a57-49d2-91e6-1190d7fb339a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '669150dced17422493b102f43a309f1c'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:00.010373 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 993/1974] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:21:59 2022] DELETE /identity/v3/users/669150dced17422493b102f43a309f1c => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:22:00.315220 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3b9b5-cdbc-45a8-a640-123155636085 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:00.317742 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-2ba3b9b5-cdbc-45a8-a640-123155636085 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:00.332944 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba3b9b5-cdbc-45a8-a640-123155636085 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:00.412219 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb3fc427-4e99-4dba-b719-3a81bfeb6b11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:00.413140 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fc427-4e99-4dba-b719-3a81bfeb6b11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:00.413425 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fc427-4e99-4dba-b719-3a81bfeb6b11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:00.413701 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb3fc427-4e99-4dba-b719-3a81bfeb6b11 admin admin] PATH_INFO: `/v3/projects/f7d082d54fb444aaa42f416d56cbae69` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:00.415026 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3fc427-4e99-4dba-b719-3a81bfeb6b11 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f7d082d54fb444aaa42f416d56cbae69)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:00.428706 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb3fc427-4e99-4dba-b719-3a81bfeb6b11 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:00.443996 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:00.494051 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-bb3fc427-4e99-4dba-b719-3a81bfeb6b11 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f7d082d54fb444aaa42f416d56cbae69', 'request_id': 'req-bb3fc427-4e99-4dba-b719-3a81bfeb6b11'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:00.499763 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-bb3fc427-4e99-4dba-b719-3a81bfeb6b11 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f7d082d54fb444aaa42f416d56cbae69', 'request_id': 'req-bb3fc427-4e99-4dba-b719-3a81bfeb6b11'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:00.507552 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-bb3fc427-4e99-4dba-b719-3a81bfeb6b11 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f7d082d54fb444aaa42f416d56cbae69', 'request_id': 'req-bb3fc427-4e99-4dba-b719-3a81bfeb6b11'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:00.520983 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-bb3fc427-4e99-4dba-b719-3a81bfeb6b11 admin admin] The token cache is being invalidate because project f7d082d54fb444aaa42f416d56cbae69 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:22:00.521320 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-bb3fc427-4e99-4dba-b719-3a81bfeb6b11 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:00.522089 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-bb3fc427-4e99-4dba-b719-3a81bfeb6b11 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:00.523640 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 982/1975] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:22:00 2022] DELETE /identity/v3/projects/f7d082d54fb444aaa42f416d56cbae69 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:22:00.530102 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec55be-6506-402b-a3b8-4928c106dd6b None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:00.530671 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec55be-6506-402b-a3b8-4928c106dd6b None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:00.530671 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcec55be-6506-402b-a3b8-4928c106dd6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:00.570213 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-dcec55be-6506-402b-a3b8-4928c106dd6b None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:22:00.571770 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-dcec55be-6506-402b-a3b8-4928c106dd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:00.635026 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 994/1976] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:22:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:22:00.642972 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f48afb-2012-44f2-9d9a-f7ede71fa613 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:00.643262 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f48afb-2012-44f2-9d9a-f7ede71fa613 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:00.643564 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f48afb-2012-44f2-9d9a-f7ede71fa613 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:00.666007 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-a1f48afb-2012-44f2-9d9a-f7ede71fa613 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:22:00.667223 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-a1f48afb-2012-44f2-9d9a-f7ede71fa613 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:00.676509 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 983/1977] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:22:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:22:00.680774 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec55be-6506-402b-a3b8-4928c106dd6b None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:00.690733 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcec55be-6506-402b-a3b8-4928c106dd6b None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:00.695617 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca56d2-dd13-484d-bb3f-60bde008ddef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:00.696241 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca56d2-dd13-484d-bb3f-60bde008ddef admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:00.696572 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca56d2-dd13-484d-bb3f-60bde008ddef admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:00.696859 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92ca56d2-dd13-484d-bb3f-60bde008ddef admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:00.697597 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca56d2-dd13-484d-bb3f-60bde008ddef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:22:00.697900 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca56d2-dd13-484d-bb3f-60bde008ddef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:00.699692 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92ca56d2-dd13-484d-bb3f-60bde008ddef admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:00.712461 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 995/1978] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:22:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:22:00.717722 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f48afb-2012-44f2-9d9a-f7ede71fa613 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:00.727959 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f48afb-2012-44f2-9d9a-f7ede71fa613 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:00.734635 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2343e-698e-4bd0-a4c0-77078921aa1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:00.735241 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2343e-698e-4bd0-a4c0-77078921aa1d admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:00.735523 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2343e-698e-4bd0-a4c0-77078921aa1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:00.735802 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86e2343e-698e-4bd0-a4c0-77078921aa1d admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:00.736509 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e2343e-698e-4bd0-a4c0-77078921aa1d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:00.738402 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86e2343e-698e-4bd0-a4c0-77078921aa1d admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:00.767189 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 984/1979] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:22:00 2022] POST /identity/v3/projects => generated 365 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:22:00.773425 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca56d2-dd13-484d-bb3f-60bde008ddef admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:00.785945 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92ca56d2-dd13-484d-bb3f-60bde008ddef admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:00.847282 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e940ef-1f58-40df-9967-9c870b78e96e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:00.847918 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e940ef-1f58-40df-9967-9c870b78e96e admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:00.848179 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e940ef-1f58-40df-9967-9c870b78e96e admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:00.848487 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e940ef-1f58-40df-9967-9c870b78e96e admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:00.849151 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e940ef-1f58-40df-9967-9c870b78e96e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:00.851037 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e940ef-1f58-40df-9967-9c870b78e96e admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:00.873334 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 996/1980] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:22:00 2022] POST /identity/v3/users => generated 283 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:22:00.882057 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2343e-698e-4bd0-a4c0-77078921aa1d admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:00.903381 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86e2343e-698e-4bd0-a4c0-77078921aa1d admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:00.919324 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05684e60-5d54-4e3d-8ac7-7fc409b17d77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:00.920163 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05684e60-5d54-4e3d-8ac7-7fc409b17d77 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:00.920519 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05684e60-5d54-4e3d-8ac7-7fc409b17d77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:00.920767 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05684e60-5d54-4e3d-8ac7-7fc409b17d77 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:00.921463 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05684e60-5d54-4e3d-8ac7-7fc409b17d77 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:00.923065 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05684e60-5d54-4e3d-8ac7-7fc409b17d77 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:00.933795 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 985/1981] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:22:00.937920 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e940ef-1f58-40df-9967-9c870b78e96e admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:00.950575 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e940ef-1f58-40df-9967-9c870b78e96e admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:00.955623 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bc1668e-5d00-487d-bfcd-b4d0aeee1306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:00.956310 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1668e-5d00-487d-bfcd-b4d0aeee1306 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:00.956626 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1668e-5d00-487d-bfcd-b4d0aeee1306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:00.956899 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bc1668e-5d00-487d-bfcd-b4d0aeee1306 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:00.957595 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc1668e-5d00-487d-bfcd-b4d0aeee1306 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:00.959167 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bc1668e-5d00-487d-bfcd-b4d0aeee1306 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:00.971371 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 997/1982] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:22:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:22:00.975887 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05684e60-5d54-4e3d-8ac7-7fc409b17d77 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:00.992112 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05684e60-5d54-4e3d-8ac7-7fc409b17d77 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:00.997101 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb40a72-68df-4efa-a4fc-e570eba3877a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:00.997901 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb40a72-68df-4efa-a4fc-e570eba3877a admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:00.998181 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb40a72-68df-4efa-a4fc-e570eba3877a admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:00.998486 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb40a72-68df-4efa-a4fc-e570eba3877a admin admin] PATH_INFO: `/v3/projects/b12ffbf6ed754e3990411ac240d356b6/users/24aa5963dab2409cb608de16890eb4c6/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:01.018228 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb40a72-68df-4efa-a4fc-e570eba3877a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b12ffbf6ed754e3990411ac240d356b6, user_id=24aa5963dab2409cb608de16890eb4c6, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:01.034102 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb40a72-68df-4efa-a4fc-e570eba3877a admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:01.052876 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 986/1983] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:22:00 2022] PUT /identity/v3/projects/b12ffbf6ed754e3990411ac240d356b6/users/24aa5963dab2409cb608de16890eb4c6/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:22:01.064668 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ec5eb-dd3b-4d18-ad83-751cb3489ba8 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:01.065069 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ec5eb-dd3b-4d18-ad83-751cb3489ba8 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:01.065410 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183ec5eb-dd3b-4d18-ad83-751cb3489ba8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:01.097553 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-183ec5eb-dd3b-4d18-ad83-751cb3489ba8 None None] MFA Rules not processed for user `24aa5963dab2409cb608de16890eb4c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:22:01.098913 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-183ec5eb-dd3b-4d18-ad83-751cb3489ba8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:01.102929 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:01.173579 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 998/1984] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:22:01 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:22:01.177808 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb40a72-68df-4efa-a4fc-e570eba3877a admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:01.273621 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb40a72-68df-4efa-a4fc-e570eba3877a admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:01.282039 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50cc9b-7434-42e8-9359-5520cfb8c7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:01.282945 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50cc9b-7434-42e8-9359-5520cfb8c7da admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:01.283395 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50cc9b-7434-42e8-9359-5520cfb8c7da admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:01.283684 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e50cc9b-7434-42e8-9359-5520cfb8c7da admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:01.284406 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e50cc9b-7434-42e8-9359-5520cfb8c7da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:01.286323 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e50cc9b-7434-42e8-9359-5520cfb8c7da admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:01.324929 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 987/1985] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:22:01 2022] POST /identity/v3/projects => generated 365 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:22:01.329356 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ec5eb-dd3b-4d18-ad83-751cb3489ba8 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:01.340851 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183ec5eb-dd3b-4d18-ad83-751cb3489ba8 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:01.449147 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057da63-d786-4f39-968e-ca3ac41f9e0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:01.449872 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057da63-d786-4f39-968e-ca3ac41f9e0b admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:01.450233 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057da63-d786-4f39-968e-ca3ac41f9e0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:01.450578 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c057da63-d786-4f39-968e-ca3ac41f9e0b admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:01.451331 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c057da63-d786-4f39-968e-ca3ac41f9e0b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:01.453444 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c057da63-d786-4f39-968e-ca3ac41f9e0b admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:01.490807 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 999/1986] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:22:01 2022] POST /identity/v3/users => generated 289 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:22:01.492050 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50cc9b-7434-42e8-9359-5520cfb8c7da admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:01.516247 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e50cc9b-7434-42e8-9359-5520cfb8c7da admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:01.518798 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4481c-36f4-428a-9750-1bd920159541 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:01.519441 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4481c-36f4-428a-9750-1bd920159541 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:01.519720 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4481c-36f4-428a-9750-1bd920159541 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:01.519993 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4481c-36f4-428a-9750-1bd920159541 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:01.520787 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e4481c-36f4-428a-9750-1bd920159541 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:01.522499 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e4481c-36f4-428a-9750-1bd920159541 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:01.535387 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 988/1987] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:22:01.539592 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057da63-d786-4f39-968e-ca3ac41f9e0b admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:01.552458 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c057da63-d786-4f39-968e-ca3ac41f9e0b admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:01.558161 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b0bc3-9234-400b-a7ef-d5321401db53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:01.559089 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b0bc3-9234-400b-a7ef-d5321401db53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:01.559089 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b0bc3-9234-400b-a7ef-d5321401db53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:01.559476 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05b0bc3-9234-400b-a7ef-d5321401db53 admin admin] PATH_INFO: `/v3/projects/d46725464e574d969ba09684dbc122a0/users/90ad2de1dcb74ea090150ecd4ce10b1e/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:01.578018 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b0bc3-9234-400b-a7ef-d5321401db53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d46725464e574d969ba09684dbc122a0, user_id=90ad2de1dcb74ea090150ecd4ce10b1e, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:01.581014 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05b0bc3-9234-400b-a7ef-d5321401db53 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:01.608951 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1000/1988] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:22:01 2022] PUT /identity/v3/projects/d46725464e574d969ba09684dbc122a0/users/90ad2de1dcb74ea090150ecd4ce10b1e/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:22:01.612816 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4481c-36f4-428a-9750-1bd920159541 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:01.639822 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e4481c-36f4-428a-9750-1bd920159541 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:01.667002 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:01.763379 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ab758d-3747-4d80-8627-c50e787f3c8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:01.764008 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab758d-3747-4d80-8627-c50e787f3c8c admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:01.764287 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab758d-3747-4d80-8627-c50e787f3c8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:01.764604 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ab758d-3747-4d80-8627-c50e787f3c8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:01.765460 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab758d-3747-4d80-8627-c50e787f3c8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:01.767897 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ab758d-3747-4d80-8627-c50e787f3c8c admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:01.783080 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 989/1989] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:22:01.803923 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b0bc3-9234-400b-a7ef-d5321401db53 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:01.816418 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05b0bc3-9234-400b-a7ef-d5321401db53 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:01.821418 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0edc7-5a00-42be-86d4-a7138ea40d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:01.822102 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0edc7-5a00-42be-86d4-a7138ea40d2a admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:01.822438 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0edc7-5a00-42be-86d4-a7138ea40d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:01.822746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de0edc7-5a00-42be-86d4-a7138ea40d2a admin admin] PATH_INFO: `/v3/projects/d46725464e574d969ba09684dbc122a0/users/90ad2de1dcb74ea090150ecd4ce10b1e/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:01.825075 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de0edc7-5a00-42be-86d4-a7138ea40d2a admin admin] RBAC: Authorizing `identity:create_grant(project_id=d46725464e574d969ba09684dbc122a0, user_id=90ad2de1dcb74ea090150ecd4ce10b1e, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:01.827798 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de0edc7-5a00-42be-86d4-a7138ea40d2a admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:01.838842 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1001/1990] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:22:01 2022] PUT /identity/v3/projects/d46725464e574d969ba09684dbc122a0/users/90ad2de1dcb74ea090150ecd4ce10b1e/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:22:01.849373 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba22d46-387b-430f-831d-4e55d109cc38 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:01.849661 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba22d46-387b-430f-831d-4e55d109cc38 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:01.849938 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dba22d46-387b-430f-831d-4e55d109cc38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:01.880044 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-dba22d46-387b-430f-831d-4e55d109cc38 None None] MFA Rules not processed for user `90ad2de1dcb74ea090150ecd4ce10b1e`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:22:01.881313 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-dba22d46-387b-430f-831d-4e55d109cc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:01.962212 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 990/1991] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:22:01 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:22:01.974281 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0edc7-5a00-42be-86d4-a7138ea40d2a admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:01.975940 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-5de0edc7-5a00-42be-86d4-a7138ea40d2a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:02.043748 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de0edc7-5a00-42be-86d4-a7138ea40d2a admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:02.047341 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a63e7-6d2d-461c-a1b5-0384ffb2fd11 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:02.048058 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a63e7-6d2d-461c-a1b5-0384ffb2fd11 service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:02.048365 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a63e7-6d2d-461c-a1b5-0384ffb2fd11 service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:02.048641 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5a63e7-6d2d-461c-a1b5-0384ffb2fd11 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:02.057725 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a63e7-6d2d-461c-a1b5-0384ffb2fd11 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:02.059479 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b5a63e7-6d2d-461c-a1b5-0384ffb2fd11 service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:02.064361 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:02.069781 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1002/1992] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:22:01 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:22:02.154267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba22d46-387b-430f-831d-4e55d109cc38 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:02.164798 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dba22d46-387b-430f-831d-4e55d109cc38 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:02.169022 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a754de61-5ce4-4e10-b524-74beb87dedc8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:02.169813 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754de61-5ce4-4e10-b524-74beb87dedc8 service cinder] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:02.170121 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754de61-5ce4-4e10-b524-74beb87dedc8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:02.170456 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a754de61-5ce4-4e10-b524-74beb87dedc8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:02.238825 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a754de61-5ce4-4e10-b524-74beb87dedc8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:02.240394 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a754de61-5ce4-4e10-b524-74beb87dedc8 service cinder] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:02.251814 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 991/1993] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:22:02 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:22:02.843537 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a63e7-6d2d-461c-a1b5-0384ffb2fd11 service cinder] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:02.847480 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-2b5a63e7-6d2d-461c-a1b5-0384ffb2fd11 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:02.933951 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5a63e7-6d2d-461c-a1b5-0384ffb2fd11 service cinder] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:02.942385 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beda879-112c-45c9-b5c1-14a258f6cdc4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:02.943152 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beda879-112c-45c9-b5c1-14a258f6cdc4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:02.943502 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beda879-112c-45c9-b5c1-14a258f6cdc4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:02.943786 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beda879-112c-45c9-b5c1-14a258f6cdc4 admin admin] PATH_INFO: `/v3/users/bbb511682e4346ed94d62f092a27d58a` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:02.945355 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beda879-112c-45c9-b5c1-14a258f6cdc4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bbb511682e4346ed94d62f092a27d58a)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:02.947366 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3beda879-112c-45c9-b5c1-14a258f6cdc4 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:03.001133 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-3beda879-112c-45c9-b5c1-14a258f6cdc4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bbb511682e4346ed94d62f092a27d58a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:03.013343 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-3beda879-112c-45c9-b5c1-14a258f6cdc4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bbb511682e4346ed94d62f092a27d58a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:03.014250 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-3beda879-112c-45c9-b5c1-14a258f6cdc4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bbb511682e4346ed94d62f092a27d58a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:03.014945 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-3beda879-112c-45c9-b5c1-14a258f6cdc4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bbb511682e4346ed94d62f092a27d58a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:03.029033 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-3beda879-112c-45c9-b5c1-14a258f6cdc4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bbb511682e4346ed94d62f092a27d58a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:03.044874 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1003/1994] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:22:02 2022] DELETE /identity/v3/users/bbb511682e4346ed94d62f092a27d58a => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:22:03.049176 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6c493-fb26-458b-97ce-149451d27e61 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:03.050103 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6c493-fb26-458b-97ce-149451d27e61 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:03.050595 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59d6c493-fb26-458b-97ce-149451d27e61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:03.070838 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-59d6c493-fb26-458b-97ce-149451d27e61 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:22:03.071959 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-59d6c493-fb26-458b-97ce-149451d27e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:03.101626 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:03.142174 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 992/1995] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:22:03.151947 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beda879-112c-45c9-b5c1-14a258f6cdc4 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:03.153372 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-3beda879-112c-45c9-b5c1-14a258f6cdc4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:03.211791 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beda879-112c-45c9-b5c1-14a258f6cdc4 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:03.215569 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bfea28-5f31-4f93-9775-bef4fc3e1f11 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:03.216214 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfea28-5f31-4f93-9775-bef4fc3e1f11 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:03.216514 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfea28-5f31-4f93-9775-bef4fc3e1f11 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:03.216788 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bfea28-5f31-4f93-9775-bef4fc3e1f11 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:03.228051 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bfea28-5f31-4f93-9775-bef4fc3e1f11 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:03.229672 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80bfea28-5f31-4f93-9775-bef4fc3e1f11 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:03.240581 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1004/1996] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:22:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:22:03.563232 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6c493-fb26-458b-97ce-149451d27e61 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:03.565128 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-59d6c493-fb26-458b-97ce-149451d27e61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:03.577690 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59d6c493-fb26-458b-97ce-149451d27e61 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:03.582475 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c2e2b1-84a2-4e2e-9bd4-e92aa190038b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:03.583157 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2e2b1-84a2-4e2e-9bd4-e92aa190038b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:03.583444 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2e2b1-84a2-4e2e-9bd4-e92aa190038b admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:03.583881 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c2e2b1-84a2-4e2e-9bd4-e92aa190038b admin admin] PATH_INFO: `/v3/projects/72234dc79eb84cbdb45436a6448c6a49` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:03.584961 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c2e2b1-84a2-4e2e-9bd4-e92aa190038b admin admin] RBAC: Authorizing `identity:delete_project(project_id=72234dc79eb84cbdb45436a6448c6a49)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:03.591173 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c2e2b1-84a2-4e2e-9bd4-e92aa190038b admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:03.755171 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-50c2e2b1-84a2-4e2e-9bd4-e92aa190038b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '72234dc79eb84cbdb45436a6448c6a49', 'request_id': 'req-50c2e2b1-84a2-4e2e-9bd4-e92aa190038b'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:03.763920 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-50c2e2b1-84a2-4e2e-9bd4-e92aa190038b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '72234dc79eb84cbdb45436a6448c6a49', 'request_id': 'req-50c2e2b1-84a2-4e2e-9bd4-e92aa190038b'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:03.774394 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-50c2e2b1-84a2-4e2e-9bd4-e92aa190038b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '72234dc79eb84cbdb45436a6448c6a49', 'request_id': 'req-50c2e2b1-84a2-4e2e-9bd4-e92aa190038b'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:03.796880 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-50c2e2b1-84a2-4e2e-9bd4-e92aa190038b admin admin] The token cache is being invalidate because project 72234dc79eb84cbdb45436a6448c6a49 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:22:03.797178 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-50c2e2b1-84a2-4e2e-9bd4-e92aa190038b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:03.797857 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-50c2e2b1-84a2-4e2e-9bd4-e92aa190038b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:03.799619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 993/1997] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:22:03 2022] DELETE /identity/v3/projects/72234dc79eb84cbdb45436a6448c6a49 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:22:03.805068 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc8672-6f8f-4876-a02d-d5d187352125 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:03.805429 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc8672-6f8f-4876-a02d-d5d187352125 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:03.805844 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32dc8672-6f8f-4876-a02d-d5d187352125 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:03.846644 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-32dc8672-6f8f-4876-a02d-d5d187352125 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:22:03.849729 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-32dc8672-6f8f-4876-a02d-d5d187352125 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:03.878999 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:03.941457 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1005/1998] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:22:03.950134 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179b5ac-ced4-41ae-95c0-ddb888d9566c None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:03.950430 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179b5ac-ced4-41ae-95c0-ddb888d9566c None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:03.950715 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8179b5ac-ced4-41ae-95c0-ddb888d9566c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:03.971299 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-8179b5ac-ced4-41ae-95c0-ddb888d9566c None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:22:03.972594 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-8179b5ac-ced4-41ae-95c0-ddb888d9566c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:03.981115 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 994/1999] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:22:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:22:03.985262 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc8672-6f8f-4876-a02d-d5d187352125 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:03.994930 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32dc8672-6f8f-4876-a02d-d5d187352125 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:04.000931 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d1a3e-1268-4ee8-b288-56f02eb28ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:04.001562 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d1a3e-1268-4ee8-b288-56f02eb28ca6 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:04.001985 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d1a3e-1268-4ee8-b288-56f02eb28ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:04.002799 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd8d1a3e-1268-4ee8-b288-56f02eb28ca6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:04.003136 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8d1a3e-1268-4ee8-b288-56f02eb28ca6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:22:04.006721 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8d1a3e-1268-4ee8-b288-56f02eb28ca6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:04.014404 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd8d1a3e-1268-4ee8-b288-56f02eb28ca6 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:04.033496 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1006/2000] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:22:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:22:04.038494 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179b5ac-ced4-41ae-95c0-ddb888d9566c None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:04.051652 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8179b5ac-ced4-41ae-95c0-ddb888d9566c None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:04.061585 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a8150-8565-44af-95a6-1c6541c3193d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:04.062766 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a8150-8565-44af-95a6-1c6541c3193d admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:04.063234 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a8150-8565-44af-95a6-1c6541c3193d admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:04.063699 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191a8150-8565-44af-95a6-1c6541c3193d admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:04.064795 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a8150-8565-44af-95a6-1c6541c3193d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:04.067378 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-191a8150-8565-44af-95a6-1c6541c3193d admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:04.099226 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 995/2001] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:22:04 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:22:04.103301 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d1a3e-1268-4ee8-b288-56f02eb28ca6 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:04.116963 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd8d1a3e-1268-4ee8-b288-56f02eb28ca6 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:04.203558 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34664c96-22e3-4e81-9391-ec311b4d08c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:04.204212 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34664c96-22e3-4e81-9391-ec311b4d08c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:04.204526 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34664c96-22e3-4e81-9391-ec311b4d08c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:04.204803 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34664c96-22e3-4e81-9391-ec311b4d08c4 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:04.205479 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34664c96-22e3-4e81-9391-ec311b4d08c4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:04.207374 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34664c96-22e3-4e81-9391-ec311b4d08c4 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:04.241114 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1007/2002] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:22:04 2022] POST /identity/v3/users => generated 287 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:22:04.243484 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a8150-8565-44af-95a6-1c6541c3193d admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:04.256880 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191a8150-8565-44af-95a6-1c6541c3193d admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:04.261525 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107278e-15ca-4c59-bfa1-7da1f5e389be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:04.262300 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107278e-15ca-4c59-bfa1-7da1f5e389be admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:04.262586 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107278e-15ca-4c59-bfa1-7da1f5e389be admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:04.262867 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4107278e-15ca-4c59-bfa1-7da1f5e389be admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:04.263567 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4107278e-15ca-4c59-bfa1-7da1f5e389be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:04.265235 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4107278e-15ca-4c59-bfa1-7da1f5e389be admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:04.275157 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 996/2003] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:22:04.279351 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34664c96-22e3-4e81-9391-ec311b4d08c4 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:04.289084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34664c96-22e3-4e81-9391-ec311b4d08c4 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:04.294676 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d78d600-95df-4f3f-b504-cf4e130d7d17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:04.295283 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78d600-95df-4f3f-b504-cf4e130d7d17 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:04.295560 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78d600-95df-4f3f-b504-cf4e130d7d17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:04.295832 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d78d600-95df-4f3f-b504-cf4e130d7d17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:04.296605 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d78d600-95df-4f3f-b504-cf4e130d7d17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:04.298170 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d78d600-95df-4f3f-b504-cf4e130d7d17 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:04.309602 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1008/2004] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:22:04.313813 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107278e-15ca-4c59-bfa1-7da1f5e389be admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:04.324275 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4107278e-15ca-4c59-bfa1-7da1f5e389be admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:04.328834 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dddbe01-2c8c-4c41-8ea2-d6075b345daf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:04.329482 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddbe01-2c8c-4c41-8ea2-d6075b345daf admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:04.329761 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddbe01-2c8c-4c41-8ea2-d6075b345daf admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:04.330039 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dddbe01-2c8c-4c41-8ea2-d6075b345daf admin admin] PATH_INFO: `/v3/projects/14962cc915f647cc916994ec724de454/users/47d90567551e4cfb9bcc974e11d4e42c/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:04.349218 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dddbe01-2c8c-4c41-8ea2-d6075b345daf admin admin] RBAC: Authorizing `identity:create_grant(project_id=14962cc915f647cc916994ec724de454, user_id=47d90567551e4cfb9bcc974e11d4e42c, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:04.354500 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dddbe01-2c8c-4c41-8ea2-d6075b345daf admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:04.378993 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 997/2005] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:22:04 2022] PUT /identity/v3/projects/14962cc915f647cc916994ec724de454/users/47d90567551e4cfb9bcc974e11d4e42c/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:22:04.386405 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf595bf-b612-4793-9ad7-05d87ec6f796 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:04.386842 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf595bf-b612-4793-9ad7-05d87ec6f796 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:04.387317 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf595bf-b612-4793-9ad7-05d87ec6f796 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:04.407346 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-abf595bf-b612-4793-9ad7-05d87ec6f796 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:22:04.408573 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-abf595bf-b612-4793-9ad7-05d87ec6f796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:04.470617 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1009/2006] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:22:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:22:04.481810 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dddbe01-2c8c-4c41-8ea2-d6075b345daf admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:04.485748 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-3dddbe01-2c8c-4c41-8ea2-d6075b345daf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:04.546683 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dddbe01-2c8c-4c41-8ea2-d6075b345daf admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:04.550767 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b7d2ed-8b13-4f67-94a3-a02dff89da53 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:04.551398 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7d2ed-8b13-4f67-94a3-a02dff89da53 service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:04.551737 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7d2ed-8b13-4f67-94a3-a02dff89da53 service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:04.552076 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b7d2ed-8b13-4f67-94a3-a02dff89da53 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:04.560907 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:04.564127 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b7d2ed-8b13-4f67-94a3-a02dff89da53 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:04.565901 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b7d2ed-8b13-4f67-94a3-a02dff89da53 service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:04.577957 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 998/2007] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:22:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:22:05.262973 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf595bf-b612-4793-9ad7-05d87ec6f796 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:05.264550 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-abf595bf-b612-4793-9ad7-05d87ec6f796 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:05.289411 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abf595bf-b612-4793-9ad7-05d87ec6f796 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:05.303909 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1640d2c1-4bc9-4a46-9e65-48d7e82445c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:05.304800 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640d2c1-4bc9-4a46-9e65-48d7e82445c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:05.305086 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640d2c1-4bc9-4a46-9e65-48d7e82445c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:05.309393 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640d2c1-4bc9-4a46-9e65-48d7e82445c4 admin admin] PATH_INFO: `/v3/users/24aa5963dab2409cb608de16890eb4c6` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:05.313352 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1640d2c1-4bc9-4a46-9e65-48d7e82445c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24aa5963dab2409cb608de16890eb4c6)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:05.315408 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1640d2c1-4bc9-4a46-9e65-48d7e82445c4 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:05.350326 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:05.385622 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1640d2c1-4bc9-4a46-9e65-48d7e82445c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24aa5963dab2409cb608de16890eb4c6'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:05.410324 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1640d2c1-4bc9-4a46-9e65-48d7e82445c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24aa5963dab2409cb608de16890eb4c6'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:05.411152 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1640d2c1-4bc9-4a46-9e65-48d7e82445c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24aa5963dab2409cb608de16890eb4c6'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:05.411976 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1640d2c1-4bc9-4a46-9e65-48d7e82445c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24aa5963dab2409cb608de16890eb4c6'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:05.423439 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1640d2c1-4bc9-4a46-9e65-48d7e82445c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24aa5963dab2409cb608de16890eb4c6'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:05.452861 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1010/2008] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:22:05 2022] DELETE /identity/v3/users/24aa5963dab2409cb608de16890eb4c6 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:22:05.457224 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ccdcc-7361-44c9-a9f0-7e8fde5e1961 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:05.458421 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ccdcc-7361-44c9-a9f0-7e8fde5e1961 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:05.458774 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023ccdcc-7361-44c9-a9f0-7e8fde5e1961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:05.478331 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db37a1-9a5a-4df1-a503-e3401d29f6b1 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:05.478621 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db37a1-9a5a-4df1-a503-e3401d29f6b1 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:05.478900 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94db37a1-9a5a-4df1-a503-e3401d29f6b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:05.494437 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-023ccdcc-7361-44c9-a9f0-7e8fde5e1961 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:22:05.497378 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-023ccdcc-7361-44c9-a9f0-7e8fde5e1961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:05.512033 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-94db37a1-9a5a-4df1-a503-e3401d29f6b1 None None] MFA Rules not processed for user `47d90567551e4cfb9bcc974e11d4e42c`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:22:05.513446 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-94db37a1-9a5a-4df1-a503-e3401d29f6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:05.589112 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 999/2009] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:22:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:22:05.600005 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ccdcc-7361-44c9-a9f0-7e8fde5e1961 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:05.602316 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-023ccdcc-7361-44c9-a9f0-7e8fde5e1961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:05.636531 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1011/2010] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:22:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:22:05.652945 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db37a1-9a5a-4df1-a503-e3401d29f6b1 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:05.652945 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-94db37a1-9a5a-4df1-a503-e3401d29f6b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:05.699809 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023ccdcc-7361-44c9-a9f0-7e8fde5e1961 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:05.704026 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de76b04-757a-4270-ba9b-b444b1da3035 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:05.704772 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de76b04-757a-4270-ba9b-b444b1da3035 service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:05.705118 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de76b04-757a-4270-ba9b-b444b1da3035 service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:05.705492 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de76b04-757a-4270-ba9b-b444b1da3035 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:05.717059 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de76b04-757a-4270-ba9b-b444b1da3035 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:05.718743 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7de76b04-757a-4270-ba9b-b444b1da3035 service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:05.722302 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94db37a1-9a5a-4df1-a503-e3401d29f6b1 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:05.730954 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1000/2011] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:22:05 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:22:05.732184 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d157b-98b0-4aef-95c5-4b572044cb35 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:05.733028 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d157b-98b0-4aef-95c5-4b572044cb35 service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:05.733324 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d157b-98b0-4aef-95c5-4b572044cb35 service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:05.733624 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239d157b-98b0-4aef-95c5-4b572044cb35 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:05.742771 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d157b-98b0-4aef-95c5-4b572044cb35 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:05.744233 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239d157b-98b0-4aef-95c5-4b572044cb35 service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:05.754443 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1012/2012] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:22:05 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:22:06.085473 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de76b04-757a-4270-ba9b-b444b1da3035 service neutron] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:06.087762 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-7de76b04-757a-4270-ba9b-b444b1da3035 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:06.130377 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de76b04-757a-4270-ba9b-b444b1da3035 service neutron] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:06.151239 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c4473-5c6a-46f8-a3da-5c27d214fad6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:06.151239 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c4473-5c6a-46f8-a3da-5c27d214fad6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:06.151239 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c4473-5c6a-46f8-a3da-5c27d214fad6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:06.151239 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea9c4473-5c6a-46f8-a3da-5c27d214fad6 admin admin] PATH_INFO: `/v3/projects/b12ffbf6ed754e3990411ac240d356b6` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:06.152146 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c4473-5c6a-46f8-a3da-5c27d214fad6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b12ffbf6ed754e3990411ac240d356b6)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:06.153114 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea9c4473-5c6a-46f8-a3da-5c27d214fad6 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:06.228791 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-ea9c4473-5c6a-46f8-a3da-5c27d214fad6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b12ffbf6ed754e3990411ac240d356b6', 'request_id': 'req-ea9c4473-5c6a-46f8-a3da-5c27d214fad6'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:06.237333 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-ea9c4473-5c6a-46f8-a3da-5c27d214fad6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b12ffbf6ed754e3990411ac240d356b6', 'request_id': 'req-ea9c4473-5c6a-46f8-a3da-5c27d214fad6'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:06.247802 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-ea9c4473-5c6a-46f8-a3da-5c27d214fad6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b12ffbf6ed754e3990411ac240d356b6', 'request_id': 'req-ea9c4473-5c6a-46f8-a3da-5c27d214fad6'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:06.271100 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-ea9c4473-5c6a-46f8-a3da-5c27d214fad6 admin admin] The token cache is being invalidate because project b12ffbf6ed754e3990411ac240d356b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:22:06.271416 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-ea9c4473-5c6a-46f8-a3da-5c27d214fad6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:06.272344 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-ea9c4473-5c6a-46f8-a3da-5c27d214fad6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:06.274553 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1001/2013] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:22:06 2022] DELETE /identity/v3/projects/b12ffbf6ed754e3990411ac240d356b6 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:22:06.278440 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d157b-98b0-4aef-95c5-4b572044cb35 service cinder] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:06.290163 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239d157b-98b0-4aef-95c5-4b572044cb35 service cinder] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:06.342229 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:06.376499 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88849120-895d-493f-a761-506b6323d65b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:06.377325 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88849120-895d-493f-a761-506b6323d65b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:06.377708 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88849120-895d-493f-a761-506b6323d65b admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:06.378114 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88849120-895d-493f-a761-506b6323d65b admin admin] PATH_INFO: `/v3/users/90ad2de1dcb74ea090150ecd4ce10b1e` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:06.379381 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88849120-895d-493f-a761-506b6323d65b admin admin] RBAC: Authorizing `identity:delete_user(user_id=90ad2de1dcb74ea090150ecd4ce10b1e)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:06.381384 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88849120-895d-493f-a761-506b6323d65b admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:06.429592 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-88849120-895d-493f-a761-506b6323d65b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90ad2de1dcb74ea090150ecd4ce10b1e'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:06.446085 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-88849120-895d-493f-a761-506b6323d65b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90ad2de1dcb74ea090150ecd4ce10b1e'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:06.447134 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-88849120-895d-493f-a761-506b6323d65b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90ad2de1dcb74ea090150ecd4ce10b1e'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:06.447915 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-88849120-895d-493f-a761-506b6323d65b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90ad2de1dcb74ea090150ecd4ce10b1e'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:06.461156 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-88849120-895d-493f-a761-506b6323d65b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90ad2de1dcb74ea090150ecd4ce10b1e'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:06.477755 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1013/2014] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:22:06 2022] DELETE /identity/v3/users/90ad2de1dcb74ea090150ecd4ce10b1e => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:22:06.792237 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c4473-5c6a-46f8-a3da-5c27d214fad6 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:06.793776 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-ea9c4473-5c6a-46f8-a3da-5c27d214fad6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:06.809399 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea9c4473-5c6a-46f8-a3da-5c27d214fad6 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:06.831609 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:06.887293 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59519817-953c-4acb-91f2-13e1da428ecc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:06.887943 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59519817-953c-4acb-91f2-13e1da428ecc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:06.888219 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59519817-953c-4acb-91f2-13e1da428ecc admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:06.888515 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59519817-953c-4acb-91f2-13e1da428ecc admin admin] PATH_INFO: `/v3/projects/d46725464e574d969ba09684dbc122a0` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:06.889662 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59519817-953c-4acb-91f2-13e1da428ecc admin admin] RBAC: Authorizing `identity:delete_project(project_id=d46725464e574d969ba09684dbc122a0)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:06.891613 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59519817-953c-4acb-91f2-13e1da428ecc admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:06.938571 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-59519817-953c-4acb-91f2-13e1da428ecc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd46725464e574d969ba09684dbc122a0', 'request_id': 'req-59519817-953c-4acb-91f2-13e1da428ecc'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:06.944078 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-59519817-953c-4acb-91f2-13e1da428ecc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd46725464e574d969ba09684dbc122a0', 'request_id': 'req-59519817-953c-4acb-91f2-13e1da428ecc'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:06.951337 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-59519817-953c-4acb-91f2-13e1da428ecc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd46725464e574d969ba09684dbc122a0', 'request_id': 'req-59519817-953c-4acb-91f2-13e1da428ecc'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:06.962225 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-59519817-953c-4acb-91f2-13e1da428ecc admin admin] The token cache is being invalidate because project d46725464e574d969ba09684dbc122a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:22:06.962446 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-59519817-953c-4acb-91f2-13e1da428ecc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:06.963063 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-59519817-953c-4acb-91f2-13e1da428ecc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:06.965252 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1002/2015] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:22:06 2022] DELETE /identity/v3/projects/d46725464e574d969ba09684dbc122a0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:22:06.970627 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de069eb-8eee-498f-96cd-de78909012fc None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:06.970915 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de069eb-8eee-498f-96cd-de78909012fc None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:06.971191 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de069eb-8eee-498f-96cd-de78909012fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:06.993941 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-5de069eb-8eee-498f-96cd-de78909012fc None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:22:06.995168 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-5de069eb-8eee-498f-96cd-de78909012fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:07.054593 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1014/2016] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:22:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:22:07.062834 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9c0e2-44c1-4136-86f8-70ded80db9ad None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:07.063118 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9c0e2-44c1-4136-86f8-70ded80db9ad None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:07.063399 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a9c0e2-44c1-4136-86f8-70ded80db9ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:07.083971 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-76a9c0e2-44c1-4136-86f8-70ded80db9ad None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:22:07.085217 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-76a9c0e2-44c1-4136-86f8-70ded80db9ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:07.093816 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1003/2017] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:22:07 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:22:07.098295 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de069eb-8eee-498f-96cd-de78909012fc None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:07.107850 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de069eb-8eee-498f-96cd-de78909012fc None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:07.112570 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada9df6-3201-47e4-beed-76c477204c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:07.113189 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada9df6-3201-47e4-beed-76c477204c08 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:07.113468 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada9df6-3201-47e4-beed-76c477204c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:07.113744 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ada9df6-3201-47e4-beed-76c477204c08 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:07.114446 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada9df6-3201-47e4-beed-76c477204c08 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:22:07.114867 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada9df6-3201-47e4-beed-76c477204c08 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:07.116497 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ada9df6-3201-47e4-beed-76c477204c08 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:07.128663 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1015/2018] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:22:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:22:07.133173 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9c0e2-44c1-4136-86f8-70ded80db9ad None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:07.142953 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a9c0e2-44c1-4136-86f8-70ded80db9ad None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:07.147828 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5978e7de-77be-4bed-a4cd-84ede09ad1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:07.148457 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978e7de-77be-4bed-a4cd-84ede09ad1bf admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:07.148736 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978e7de-77be-4bed-a4cd-84ede09ad1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:07.149008 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5978e7de-77be-4bed-a4cd-84ede09ad1bf admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:07.149679 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5978e7de-77be-4bed-a4cd-84ede09ad1bf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:07.152505 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5978e7de-77be-4bed-a4cd-84ede09ad1bf admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:07.181891 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1004/2019] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:22:07 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:22:07.186217 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada9df6-3201-47e4-beed-76c477204c08 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:07.197089 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ada9df6-3201-47e4-beed-76c477204c08 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:07.236883 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:07.257357 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b332c-b6b1-4ab3-b6e7-58ef3e2da6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:07.257979 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b332c-b6b1-4ab3-b6e7-58ef3e2da6f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:07.258263 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b332c-b6b1-4ab3-b6e7-58ef3e2da6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:07.258542 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72b332c-b6b1-4ab3-b6e7-58ef3e2da6f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:07.259221 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b332c-b6b1-4ab3-b6e7-58ef3e2da6f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:07.261729 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72b332c-b6b1-4ab3-b6e7-58ef3e2da6f8 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:07.283983 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1016/2020] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:22:07 2022] POST /identity/v3/users => generated 288 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:22:07.288183 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5978e7de-77be-4bed-a4cd-84ede09ad1bf admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:07.299150 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5978e7de-77be-4bed-a4cd-84ede09ad1bf admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:07.303764 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53930589-30e8-42fd-8718-2ba751f5a105 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:07.304400 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53930589-30e8-42fd-8718-2ba751f5a105 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:07.304688 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53930589-30e8-42fd-8718-2ba751f5a105 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:07.304969 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53930589-30e8-42fd-8718-2ba751f5a105 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:07.305717 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53930589-30e8-42fd-8718-2ba751f5a105 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:07.307308 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53930589-30e8-42fd-8718-2ba751f5a105 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:07.317843 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1005/2021] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:22:07.321658 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b332c-b6b1-4ab3-b6e7-58ef3e2da6f8 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:07.331360 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72b332c-b6b1-4ab3-b6e7-58ef3e2da6f8 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:07.335795 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8701b-1634-4786-ba71-b75332af844a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:07.336647 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8701b-1634-4786-ba71-b75332af844a admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:07.337086 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8701b-1634-4786-ba71-b75332af844a admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:07.337086 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8701b-1634-4786-ba71-b75332af844a admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:07.337717 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8701b-1634-4786-ba71-b75332af844a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:07.339344 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8701b-1634-4786-ba71-b75332af844a admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:07.349593 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1017/2022] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:22:07.353707 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53930589-30e8-42fd-8718-2ba751f5a105 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:07.364491 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53930589-30e8-42fd-8718-2ba751f5a105 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:07.369233 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93018b0-ad78-4c43-a871-1965a3fed494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:07.369877 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93018b0-ad78-4c43-a871-1965a3fed494 admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:07.370905 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93018b0-ad78-4c43-a871-1965a3fed494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:07.371441 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93018b0-ad78-4c43-a871-1965a3fed494 admin admin] PATH_INFO: `/v3/projects/90b336ea190343d8afee2c01192cf7ad/users/a2ed068956c1430aba92ba42e16d0828/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:07.386022 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93018b0-ad78-4c43-a871-1965a3fed494 admin admin] RBAC: Authorizing `identity:create_grant(project_id=90b336ea190343d8afee2c01192cf7ad, user_id=a2ed068956c1430aba92ba42e16d0828, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:07.388847 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d93018b0-ad78-4c43-a871-1965a3fed494 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:07.402114 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1006/2023] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:22:07 2022] PUT /identity/v3/projects/90b336ea190343d8afee2c01192cf7ad/users/a2ed068956c1430aba92ba42e16d0828/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:22:07.413242 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3cdb6-fac0-4302-b098-17ff9310ac01 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:07.413528 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3cdb6-fac0-4302-b098-17ff9310ac01 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:07.413803 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d3cdb6-fac0-4302-b098-17ff9310ac01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:07.443083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-e5d3cdb6-fac0-4302-b098-17ff9310ac01 None None] MFA Rules not processed for user `a2ed068956c1430aba92ba42e16d0828`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:22:07.444389 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-e5d3cdb6-fac0-4302-b098-17ff9310ac01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:07.514816 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1018/2024] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:22:07 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:22:07.519741 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93018b0-ad78-4c43-a871-1965a3fed494 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:07.571708 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:07.587982 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d93018b0-ad78-4c43-a871-1965a3fed494 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:07.594572 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8122bf-7092-4bab-a970-d570b99f2873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:07.595444 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8122bf-7092-4bab-a970-d570b99f2873 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:07.595725 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8122bf-7092-4bab-a970-d570b99f2873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:07.595999 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8122bf-7092-4bab-a970-d570b99f2873 admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:07.596699 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8122bf-7092-4bab-a970-d570b99f2873 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:07.598615 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8122bf-7092-4bab-a970-d570b99f2873 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:07.626988 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1007/2025] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:22:07 2022] POST /identity/v3/projects => generated 375 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:22:07.630471 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3cdb6-fac0-4302-b098-17ff9310ac01 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:07.641584 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d3cdb6-fac0-4302-b098-17ff9310ac01 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:07.701485 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1214f27-32f2-4035-a7a0-d9a020f642dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:07.702130 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1214f27-32f2-4035-a7a0-d9a020f642dd admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:07.702412 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1214f27-32f2-4035-a7a0-d9a020f642dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:07.702691 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1214f27-32f2-4035-a7a0-d9a020f642dd admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:07.703369 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1214f27-32f2-4035-a7a0-d9a020f642dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:07.705333 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1214f27-32f2-4035-a7a0-d9a020f642dd admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:07.731160 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1019/2026] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:22:07 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:22:07.732535 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8122bf-7092-4bab-a970-d570b99f2873 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:07.743334 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8122bf-7092-4bab-a970-d570b99f2873 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:07.748927 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26323214-1dd1-4c15-8c5e-2fba6e79530c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:07.749542 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26323214-1dd1-4c15-8c5e-2fba6e79530c admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:07.749823 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26323214-1dd1-4c15-8c5e-2fba6e79530c admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:07.750097 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26323214-1dd1-4c15-8c5e-2fba6e79530c admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:07.750788 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26323214-1dd1-4c15-8c5e-2fba6e79530c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:07.752490 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26323214-1dd1-4c15-8c5e-2fba6e79530c admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:07.764347 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1008/2027] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:22:07.768541 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1214f27-32f2-4035-a7a0-d9a020f642dd admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:07.778238 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1214f27-32f2-4035-a7a0-d9a020f642dd admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:07.782827 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066da98-190f-47e4-93ac-a59b2b7129c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:07.783487 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066da98-190f-47e4-93ac-a59b2b7129c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:07.783770 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066da98-190f-47e4-93ac-a59b2b7129c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:07.784134 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6066da98-190f-47e4-93ac-a59b2b7129c3 admin admin] PATH_INFO: `/v3/projects/0102763764914568bb6a527f75f1eb1b/users/2e0a2b35e46f43b7819fefbd16a7ae36/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:07.803732 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6066da98-190f-47e4-93ac-a59b2b7129c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0102763764914568bb6a527f75f1eb1b, user_id=2e0a2b35e46f43b7819fefbd16a7ae36, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:07.806394 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6066da98-190f-47e4-93ac-a59b2b7129c3 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:07.820166 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1020/2028] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:22:07 2022] PUT /identity/v3/projects/0102763764914568bb6a527f75f1eb1b/users/2e0a2b35e46f43b7819fefbd16a7ae36/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:22:07.824221 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26323214-1dd1-4c15-8c5e-2fba6e79530c admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:07.834454 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26323214-1dd1-4c15-8c5e-2fba6e79530c admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:07.890730 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b70c7f-d5ba-4f4f-babf-11e42ed0c11c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:07.891347 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b70c7f-d5ba-4f4f-babf-11e42ed0c11c admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:07.891626 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b70c7f-d5ba-4f4f-babf-11e42ed0c11c admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:07.891897 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b70c7f-d5ba-4f4f-babf-11e42ed0c11c admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:07.892609 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b70c7f-d5ba-4f4f-babf-11e42ed0c11c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:07.894192 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b70c7f-d5ba-4f4f-babf-11e42ed0c11c admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:07.903723 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1009/2029] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:22:07.907816 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066da98-190f-47e4-93ac-a59b2b7129c3 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:07.919127 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6066da98-190f-47e4-93ac-a59b2b7129c3 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:07.923760 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f2f44-fa87-4dd9-a9fd-0c2fdd4dce2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:07.924484 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f2f44-fa87-4dd9-a9fd-0c2fdd4dce2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:07.924771 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f2f44-fa87-4dd9-a9fd-0c2fdd4dce2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:07.925046 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4f2f44-fa87-4dd9-a9fd-0c2fdd4dce2f admin admin] PATH_INFO: `/v3/projects/0102763764914568bb6a527f75f1eb1b/users/2e0a2b35e46f43b7819fefbd16a7ae36/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:07.927002 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f2f44-fa87-4dd9-a9fd-0c2fdd4dce2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=0102763764914568bb6a527f75f1eb1b, user_id=2e0a2b35e46f43b7819fefbd16a7ae36, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:07.929664 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4f2f44-fa87-4dd9-a9fd-0c2fdd4dce2f admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:07.937165 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:07.942155 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1021/2030] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:22:07 2022] PUT /identity/v3/projects/0102763764914568bb6a527f75f1eb1b/users/2e0a2b35e46f43b7819fefbd16a7ae36/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:22:07.952693 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a396b-dada-4e3b-bf42-dfe7d074817d None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:07.953093 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a396b-dada-4e3b-bf42-dfe7d074817d None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:07.953494 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49a396b-dada-4e3b-bf42-dfe7d074817d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:07.983310 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-e49a396b-dada-4e3b-bf42-dfe7d074817d None None] MFA Rules not processed for user `2e0a2b35e46f43b7819fefbd16a7ae36`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:22:07.984600 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-e49a396b-dada-4e3b-bf42-dfe7d074817d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:08.050793 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1010/2031] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:22:07 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:22:08.062454 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f2f44-fa87-4dd9-a9fd-0c2fdd4dce2f admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:08.064206 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-0f4f2f44-fa87-4dd9-a9fd-0c2fdd4dce2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:08.125383 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4f2f44-fa87-4dd9-a9fd-0c2fdd4dce2f admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:08.129015 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363dbf9-2b4c-40d5-890e-025579fdc963 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:08.129630 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363dbf9-2b4c-40d5-890e-025579fdc963 service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:08.129914 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363dbf9-2b4c-40d5-890e-025579fdc963 service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:08.130190 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f363dbf9-2b4c-40d5-890e-025579fdc963 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:08.185190 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363dbf9-2b4c-40d5-890e-025579fdc963 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:08.186882 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f363dbf9-2b4c-40d5-890e-025579fdc963 service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:08.195494 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1022/2032] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:22:08 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:22:08.263805 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd174d-78cd-4ab9-bde2-34166dc1bd86 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:08.264004 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd174d-78cd-4ab9-bde2-34166dc1bd86 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:08.264283 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcd174d-78cd-4ab9-bde2-34166dc1bd86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:08.283341 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-3fcd174d-78cd-4ab9-bde2-34166dc1bd86 None None] MFA Rules not processed for user `47d90567551e4cfb9bcc974e11d4e42c`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:22:08.284567 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-3fcd174d-78cd-4ab9-bde2-34166dc1bd86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:08.326128 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:08.346770 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1011/2033] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:22:08 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:22:15.930721 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363dbf9-2b4c-40d5-890e-025579fdc963 service cinder] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:15.939188 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f363dbf9-2b4c-40d5-890e-025579fdc963 service cinder] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:15.943292 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c12180-bef9-41c5-9159-061030f7fba1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:15.943906 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c12180-bef9-41c5-9159-061030f7fba1 service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:15.944183 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c12180-bef9-41c5-9159-061030f7fba1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:15.944492 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c12180-bef9-41c5-9159-061030f7fba1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:15.954908 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c12180-bef9-41c5-9159-061030f7fba1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:15.956711 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c12180-bef9-41c5-9159-061030f7fba1 service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:15.968904 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1023/2034] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:22:15 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:22:18.337538 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=5 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:25.964257 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=54 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:49.217001 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd174d-78cd-4ab9-bde2-34166dc1bd86 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:49.287899 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fcd174d-78cd-4ab9-bde2-34166dc1bd86 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:49.293397 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6991e36-6ec2-4ef7-aef6-29390a8e5a1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:49.294102 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6991e36-6ec2-4ef7-aef6-29390a8e5a1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:49.294387 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6991e36-6ec2-4ef7-aef6-29390a8e5a1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:49.294720 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6991e36-6ec2-4ef7-aef6-29390a8e5a1f admin admin] PATH_INFO: `/v3/users/a2ed068956c1430aba92ba42e16d0828` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:49.295855 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6991e36-6ec2-4ef7-aef6-29390a8e5a1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=a2ed068956c1430aba92ba42e16d0828)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:49.297860 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6991e36-6ec2-4ef7-aef6-29390a8e5a1f admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:49.356500 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-e6991e36-6ec2-4ef7-aef6-29390a8e5a1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a2ed068956c1430aba92ba42e16d0828'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:49.359063 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-e6991e36-6ec2-4ef7-aef6-29390a8e5a1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a2ed068956c1430aba92ba42e16d0828'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:49.359781 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-e6991e36-6ec2-4ef7-aef6-29390a8e5a1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a2ed068956c1430aba92ba42e16d0828'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:49.360409 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-e6991e36-6ec2-4ef7-aef6-29390a8e5a1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a2ed068956c1430aba92ba42e16d0828'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:49.367756 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-e6991e36-6ec2-4ef7-aef6-29390a8e5a1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a2ed068956c1430aba92ba42e16d0828'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:49.380264 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1012/2035] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:22:49 2022] DELETE /identity/v3/users/a2ed068956c1430aba92ba42e16d0828 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:22:49.385701 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b11f8-02c2-4811-af1a-37185b772cf6 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:49.386220 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b11f8-02c2-4811-af1a-37185b772cf6 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:49.386367 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38b11f8-02c2-4811-af1a-37185b772cf6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:49.406193 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-f38b11f8-02c2-4811-af1a-37185b772cf6 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:22:49.407403 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-f38b11f8-02c2-4811-af1a-37185b772cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:49.468564 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1024/2036] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:22:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:22:49.478657 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6991e36-6ec2-4ef7-aef6-29390a8e5a1f admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:49.480445 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-e6991e36-6ec2-4ef7-aef6-29390a8e5a1f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:49.551917 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6991e36-6ec2-4ef7-aef6-29390a8e5a1f admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:49.559889 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ec56c-aa3d-4d63-ba70-7d7583f1c8ca service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:49.560685 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ec56c-aa3d-4d63-ba70-7d7583f1c8ca service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:49.561038 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ec56c-aa3d-4d63-ba70-7d7583f1c8ca service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:49.561377 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67ec56c-aa3d-4d63-ba70-7d7583f1c8ca service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:49.571306 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ec56c-aa3d-4d63-ba70-7d7583f1c8ca service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:49.573573 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67ec56c-aa3d-4d63-ba70-7d7583f1c8ca service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:49.584382 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1013/2037] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:22:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:22:49.874294 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b11f8-02c2-4811-af1a-37185b772cf6 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:49.875731 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-f38b11f8-02c2-4811-af1a-37185b772cf6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:49.889034 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38b11f8-02c2-4811-af1a-37185b772cf6 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:49.893556 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e3733-ec94-4f8b-b8b0-1a216fe51b98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:49.894206 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e3733-ec94-4f8b-b8b0-1a216fe51b98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:49.894485 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e3733-ec94-4f8b-b8b0-1a216fe51b98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:49.894759 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799e3733-ec94-4f8b-b8b0-1a216fe51b98 admin admin] PATH_INFO: `/v3/projects/90b336ea190343d8afee2c01192cf7ad` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:49.895918 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e3733-ec94-4f8b-b8b0-1a216fe51b98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=90b336ea190343d8afee2c01192cf7ad)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:49.897937 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799e3733-ec94-4f8b-b8b0-1a216fe51b98 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:49.949660 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-799e3733-ec94-4f8b-b8b0-1a216fe51b98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '90b336ea190343d8afee2c01192cf7ad', 'request_id': 'req-799e3733-ec94-4f8b-b8b0-1a216fe51b98'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:49.955180 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-799e3733-ec94-4f8b-b8b0-1a216fe51b98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '90b336ea190343d8afee2c01192cf7ad', 'request_id': 'req-799e3733-ec94-4f8b-b8b0-1a216fe51b98'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:49.963090 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-799e3733-ec94-4f8b-b8b0-1a216fe51b98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '90b336ea190343d8afee2c01192cf7ad', 'request_id': 'req-799e3733-ec94-4f8b-b8b0-1a216fe51b98'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:49.975484 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-799e3733-ec94-4f8b-b8b0-1a216fe51b98 admin admin] The token cache is being invalidate because project 90b336ea190343d8afee2c01192cf7ad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:22:49.975770 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-799e3733-ec94-4f8b-b8b0-1a216fe51b98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:49.976460 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-799e3733-ec94-4f8b-b8b0-1a216fe51b98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:49.978267 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1025/2038] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:22:49 2022] DELETE /identity/v3/projects/90b336ea190343d8afee2c01192cf7ad => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:22:49.983665 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ec56c-aa3d-4d63-ba70-7d7583f1c8ca service neutron] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:49.997337 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67ec56c-aa3d-4d63-ba70-7d7583f1c8ca service neutron] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:50.020631 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:50.064901 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae1d5bc-837d-4840-9ba5-a2c7831c4dde admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:50.065796 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1d5bc-837d-4840-9ba5-a2c7831c4dde admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:50.066459 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1d5bc-837d-4840-9ba5-a2c7831c4dde admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:50.066459 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae1d5bc-837d-4840-9ba5-a2c7831c4dde admin admin] PATH_INFO: `/v3/users/2e0a2b35e46f43b7819fefbd16a7ae36` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:50.067499 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae1d5bc-837d-4840-9ba5-a2c7831c4dde admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e0a2b35e46f43b7819fefbd16a7ae36)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:50.069471 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae1d5bc-837d-4840-9ba5-a2c7831c4dde admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:50.125170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-3ae1d5bc-837d-4840-9ba5-a2c7831c4dde admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e0a2b35e46f43b7819fefbd16a7ae36'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:50.139972 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-3ae1d5bc-837d-4840-9ba5-a2c7831c4dde admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e0a2b35e46f43b7819fefbd16a7ae36'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:50.140749 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-3ae1d5bc-837d-4840-9ba5-a2c7831c4dde admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e0a2b35e46f43b7819fefbd16a7ae36'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:50.141349 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-3ae1d5bc-837d-4840-9ba5-a2c7831c4dde admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e0a2b35e46f43b7819fefbd16a7ae36'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:50.152103 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-3ae1d5bc-837d-4840-9ba5-a2c7831c4dde admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e0a2b35e46f43b7819fefbd16a7ae36'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:50.170081 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1014/2039] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:22:49 2022] DELETE /identity/v3/users/2e0a2b35e46f43b7819fefbd16a7ae36 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:22:50.809015 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e3733-ec94-4f8b-b8b0-1a216fe51b98 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:50.810778 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-799e3733-ec94-4f8b-b8b0-1a216fe51b98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:50.824413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799e3733-ec94-4f8b-b8b0-1a216fe51b98 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:50.886351 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b57dee7-8f5a-47e4-842b-3fa558dc5312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:50.887034 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57dee7-8f5a-47e4-842b-3fa558dc5312 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:50.887315 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57dee7-8f5a-47e4-842b-3fa558dc5312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:50.887588 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b57dee7-8f5a-47e4-842b-3fa558dc5312 admin admin] PATH_INFO: `/v3/projects/0102763764914568bb6a527f75f1eb1b` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:50.888889 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b57dee7-8f5a-47e4-842b-3fa558dc5312 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0102763764914568bb6a527f75f1eb1b)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:50.890896 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b57dee7-8f5a-47e4-842b-3fa558dc5312 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:50.920775 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:50.937820 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-8b57dee7-8f5a-47e4-842b-3fa558dc5312 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0102763764914568bb6a527f75f1eb1b', 'request_id': 'req-8b57dee7-8f5a-47e4-842b-3fa558dc5312'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:50.943257 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-8b57dee7-8f5a-47e4-842b-3fa558dc5312 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0102763764914568bb6a527f75f1eb1b', 'request_id': 'req-8b57dee7-8f5a-47e4-842b-3fa558dc5312'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:50.951111 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-8b57dee7-8f5a-47e4-842b-3fa558dc5312 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0102763764914568bb6a527f75f1eb1b', 'request_id': 'req-8b57dee7-8f5a-47e4-842b-3fa558dc5312'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:50.962240 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-8b57dee7-8f5a-47e4-842b-3fa558dc5312 admin admin] The token cache is being invalidate because project 0102763764914568bb6a527f75f1eb1b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:22:50.962528 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-8b57dee7-8f5a-47e4-842b-3fa558dc5312 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:50.964293 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-8b57dee7-8f5a-47e4-842b-3fa558dc5312 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:50.965851 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1026/2040] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:22:50 2022] DELETE /identity/v3/projects/0102763764914568bb6a527f75f1eb1b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:22:50.970951 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d815bbd-1b2e-4e7f-b933-c4457df854b4 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:50.971471 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d815bbd-1b2e-4e7f-b933-c4457df854b4 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:50.971567 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d815bbd-1b2e-4e7f-b933-c4457df854b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:50.991255 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-6d815bbd-1b2e-4e7f-b933-c4457df854b4 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:22:50.992478 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-6d815bbd-1b2e-4e7f-b933-c4457df854b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:51.052980 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1015/2041] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:22:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:22:51.062034 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c23540-1306-4d82-9b02-edc8f04acd6b None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:51.062455 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c23540-1306-4d82-9b02-edc8f04acd6b None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:51.063094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c23540-1306-4d82-9b02-edc8f04acd6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:51.083408 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-39c23540-1306-4d82-9b02-edc8f04acd6b None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:22:51.084557 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-39c23540-1306-4d82-9b02-edc8f04acd6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:51.093922 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1027/2042] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:22:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:22:51.098304 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d815bbd-1b2e-4e7f-b933-c4457df854b4 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:51.109868 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d815bbd-1b2e-4e7f-b933-c4457df854b4 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:51.114772 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a3eae4-c1b4-4e6b-b91b-f8d74b76d291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:51.115385 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3eae4-c1b4-4e6b-b91b-f8d74b76d291 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:51.115670 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3eae4-c1b4-4e6b-b91b-f8d74b76d291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:51.115944 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a3eae4-c1b4-4e6b-b91b-f8d74b76d291 admin admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:51.116676 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a3eae4-c1b4-4e6b-b91b-f8d74b76d291 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:22:51.116981 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a3eae4-c1b4-4e6b-b91b-f8d74b76d291 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:51.118794 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a3eae4-c1b4-4e6b-b91b-f8d74b76d291 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:51.130972 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1016/2043] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:22:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:22:51.136133 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c23540-1306-4d82-9b02-edc8f04acd6b None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:51.145815 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c23540-1306-4d82-9b02-edc8f04acd6b None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:51.151174 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00980f4-9933-4ecf-b8fa-215a225fc181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:51.152041 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00980f4-9933-4ecf-b8fa-215a225fc181 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:51.152428 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00980f4-9933-4ecf-b8fa-215a225fc181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:51.152773 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00980f4-9933-4ecf-b8fa-215a225fc181 admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:51.153542 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00980f4-9933-4ecf-b8fa-215a225fc181 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:51.155522 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00980f4-9933-4ecf-b8fa-215a225fc181 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:51.183767 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1028/2044] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:22:51 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:22:51.187643 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a3eae4-c1b4-4e6b-b91b-f8d74b76d291 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:51.198417 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a3eae4-c1b4-4e6b-b91b-f8d74b76d291 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:51.227618 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:51.267574 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe90b2a-9ae9-449d-a292-c141a3c8a146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:51.268276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe90b2a-9ae9-449d-a292-c141a3c8a146 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:51.268592 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe90b2a-9ae9-449d-a292-c141a3c8a146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:51.268868 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fe90b2a-9ae9-449d-a292-c141a3c8a146 admin admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:51.269549 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe90b2a-9ae9-449d-a292-c141a3c8a146 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:51.271560 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fe90b2a-9ae9-449d-a292-c141a3c8a146 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:51.293757 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1017/2045] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:22:51 2022] POST /identity/v3/users => generated 294 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:22:51.298079 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00980f4-9933-4ecf-b8fa-215a225fc181 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:51.308946 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00980f4-9933-4ecf-b8fa-215a225fc181 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:51.313518 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20ec24-7b03-4573-b3c6-d4999ff9fb03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:51.314126 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20ec24-7b03-4573-b3c6-d4999ff9fb03 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:51.314407 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20ec24-7b03-4573-b3c6-d4999ff9fb03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:51.314683 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e20ec24-7b03-4573-b3c6-d4999ff9fb03 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:51.315427 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20ec24-7b03-4573-b3c6-d4999ff9fb03 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:51.317076 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e20ec24-7b03-4573-b3c6-d4999ff9fb03 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:51.327713 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1029/2046] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:22:51.331542 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe90b2a-9ae9-449d-a292-c141a3c8a146 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:51.342094 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fe90b2a-9ae9-449d-a292-c141a3c8a146 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:51.347027 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23aeae6-9a10-43ea-9e29-094718b78a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:51.347651 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23aeae6-9a10-43ea-9e29-094718b78a43 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:51.347931 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23aeae6-9a10-43ea-9e29-094718b78a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:51.348286 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23aeae6-9a10-43ea-9e29-094718b78a43 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:51.348921 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23aeae6-9a10-43ea-9e29-094718b78a43 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:51.350497 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23aeae6-9a10-43ea-9e29-094718b78a43 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:51.362123 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1018/2047] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:22:51.366145 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20ec24-7b03-4573-b3c6-d4999ff9fb03 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:51.377301 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e20ec24-7b03-4573-b3c6-d4999ff9fb03 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:51.382184 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cdd2a9-ac27-43c2-88ed-30de886ca78b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:51.382845 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdd2a9-ac27-43c2-88ed-30de886ca78b admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:51.383121 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdd2a9-ac27-43c2-88ed-30de886ca78b admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:51.383397 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3cdd2a9-ac27-43c2-88ed-30de886ca78b admin admin] PATH_INFO: `/v3/projects/b52ed752b8c44eb2a7a36beedaf18661/users/79bbb4517c38442e84193b95d41de1d3/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:51.400184 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cdd2a9-ac27-43c2-88ed-30de886ca78b admin admin] RBAC: Authorizing `identity:create_grant(project_id=b52ed752b8c44eb2a7a36beedaf18661, user_id=79bbb4517c38442e84193b95d41de1d3, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:51.403061 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3cdd2a9-ac27-43c2-88ed-30de886ca78b admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:51.424505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1030/2048] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:22:51 2022] PUT /identity/v3/projects/b52ed752b8c44eb2a7a36beedaf18661/users/79bbb4517c38442e84193b95d41de1d3/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:22:51.427823 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececb9f2-64dd-4ae2-b792-a3b5738877f9 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:51.428111 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececb9f2-64dd-4ae2-b792-a3b5738877f9 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:51.428408 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ececb9f2-64dd-4ae2-b792-a3b5738877f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:51.457356 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-ececb9f2-64dd-4ae2-b792-a3b5738877f9 None None] MFA Rules not processed for user `79bbb4517c38442e84193b95d41de1d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:22:51.458589 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-ececb9f2-64dd-4ae2-b792-a3b5738877f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:51.529365 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1019/2049] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:22:51 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:22:51.533679 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cdd2a9-ac27-43c2-88ed-30de886ca78b admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:51.622740 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3cdd2a9-ac27-43c2-88ed-30de886ca78b admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:51.630668 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b68756-2c63-4f70-bce8-371ea2e17029 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:51.631465 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b68756-2c63-4f70-bce8-371ea2e17029 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:51.631674 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b68756-2c63-4f70-bce8-371ea2e17029 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:51.632098 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b68756-2c63-4f70-bce8-371ea2e17029 admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:51.632727 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b68756-2c63-4f70-bce8-371ea2e17029 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:51.634735 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b68756-2c63-4f70-bce8-371ea2e17029 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:51.672094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1031/2050] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:22:51 2022] POST /identity/v3/projects => generated 387 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:22:51.673272 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ececb9f2-64dd-4ae2-b792-a3b5738877f9 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:51.685078 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ececb9f2-64dd-4ae2-b792-a3b5738877f9 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:51.761038 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d3a9a-4d5e-4287-8794-5d64b56c1a99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:51.761667 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d3a9a-4d5e-4287-8794-5d64b56c1a99 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:51.761942 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d3a9a-4d5e-4287-8794-5d64b56c1a99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:51.762271 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935d3a9a-4d5e-4287-8794-5d64b56c1a99 admin admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:51.762958 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d3a9a-4d5e-4287-8794-5d64b56c1a99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:51.764956 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935d3a9a-4d5e-4287-8794-5d64b56c1a99 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:51.792422 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1020/2051] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:22:51 2022] POST /identity/v3/users => generated 300 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:22:51.796788 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b68756-2c63-4f70-bce8-371ea2e17029 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:51.810631 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b68756-2c63-4f70-bce8-371ea2e17029 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:51.822813 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50cbaf-b015-41ba-b7da-40f1c683c01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:51.823768 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50cbaf-b015-41ba-b7da-40f1c683c01f admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:51.825223 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50cbaf-b015-41ba-b7da-40f1c683c01f admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:51.826562 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e50cbaf-b015-41ba-b7da-40f1c683c01f admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:51.827641 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e50cbaf-b015-41ba-b7da-40f1c683c01f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:51.833126 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e50cbaf-b015-41ba-b7da-40f1c683c01f admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:51.871571 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1032/2052] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 78 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:22:51.872059 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d3a9a-4d5e-4287-8794-5d64b56c1a99 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:51.899944 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935d3a9a-4d5e-4287-8794-5d64b56c1a99 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:51.905398 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c30cfc-add9-4944-81b4-4c44be445a38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:51.906080 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c30cfc-add9-4944-81b4-4c44be445a38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:51.906367 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c30cfc-add9-4944-81b4-4c44be445a38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:51.906653 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c30cfc-add9-4944-81b4-4c44be445a38 admin admin] PATH_INFO: `/v3/projects/a5b89f14b29745649aa89636d66768d5/users/e6b3e96a63d2467fbe4baea17445f936/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:51.925076 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c30cfc-add9-4944-81b4-4c44be445a38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5b89f14b29745649aa89636d66768d5, user_id=e6b3e96a63d2467fbe4baea17445f936, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:51.927482 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c30cfc-add9-4944-81b4-4c44be445a38 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:51.948378 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1021/2053] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:22:51 2022] PUT /identity/v3/projects/a5b89f14b29745649aa89636d66768d5/users/e6b3e96a63d2467fbe4baea17445f936/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:22:51.952288 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50cbaf-b015-41ba-b7da-40f1c683c01f admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:51.962820 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e50cbaf-b015-41ba-b7da-40f1c683c01f admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:51.987541 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:DELETE=6,keystone:SELECT=90,keystone:INSERT=4 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:52.036617 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9e7fa2-de88-4928-bb21-c69a0e26d660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:52.037364 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e7fa2-de88-4928-bb21-c69a0e26d660 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:52.037750 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e7fa2-de88-4928-bb21-c69a0e26d660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:52.038139 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9e7fa2-de88-4928-bb21-c69a0e26d660 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:52.038934 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9e7fa2-de88-4928-bb21-c69a0e26d660 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:52.040710 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9e7fa2-de88-4928-bb21-c69a0e26d660 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:52.056371 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1033/2054] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:22:52.062286 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c30cfc-add9-4944-81b4-4c44be445a38 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:52.069081 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:52.087358 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c30cfc-add9-4944-81b4-4c44be445a38 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:52.087358 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da865727-0f4d-4ab9-83ec-e098ea0c1724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:52.087358 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da865727-0f4d-4ab9-83ec-e098ea0c1724 admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:52.087358 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da865727-0f4d-4ab9-83ec-e098ea0c1724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:52.087747 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da865727-0f4d-4ab9-83ec-e098ea0c1724 admin admin] PATH_INFO: `/v3/projects/a5b89f14b29745649aa89636d66768d5/users/e6b3e96a63d2467fbe4baea17445f936/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:52.087747 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da865727-0f4d-4ab9-83ec-e098ea0c1724 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a5b89f14b29745649aa89636d66768d5, user_id=e6b3e96a63d2467fbe4baea17445f936, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:52.090611 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da865727-0f4d-4ab9-83ec-e098ea0c1724 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:52.108143 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1022/2055] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:22:52 2022] PUT /identity/v3/projects/a5b89f14b29745649aa89636d66768d5/users/e6b3e96a63d2467fbe4baea17445f936/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:22:52.112422 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40433b7b-a978-4e57-ba5c-6ea0095b1760 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:52.112791 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40433b7b-a978-4e57-ba5c-6ea0095b1760 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:52.112986 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40433b7b-a978-4e57-ba5c-6ea0095b1760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:52.145318 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-40433b7b-a978-4e57-ba5c-6ea0095b1760 None None] MFA Rules not processed for user `e6b3e96a63d2467fbe4baea17445f936`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:22:52.146709 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-40433b7b-a978-4e57-ba5c-6ea0095b1760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:52.261822 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1034/2056] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:22:52 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:22:52.273040 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da865727-0f4d-4ab9-83ec-e098ea0c1724 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:52.274792 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-da865727-0f4d-4ab9-83ec-e098ea0c1724 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:52.336262 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da865727-0f4d-4ab9-83ec-e098ea0c1724 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:52.339995 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca021f4-e91c-48d1-9f8f-3d5d49449b16 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:52.340623 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca021f4-e91c-48d1-9f8f-3d5d49449b16 service cinder] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:52.340901 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca021f4-e91c-48d1-9f8f-3d5d49449b16 service cinder] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:52.341177 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca021f4-e91c-48d1-9f8f-3d5d49449b16 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:52.350894 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca021f4-e91c-48d1-9f8f-3d5d49449b16 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:52.352307 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fca021f4-e91c-48d1-9f8f-3d5d49449b16 service cinder] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:52.366714 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1023/2057] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:22:52 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:22:52.434614 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40433b7b-a978-4e57-ba5c-6ea0095b1760 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:52.496001 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40433b7b-a978-4e57-ba5c-6ea0095b1760 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:52.500583 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb2744-df8e-4dca-84f9-7c72eadbba1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:52.501221 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb2744-df8e-4dca-84f9-7c72eadbba1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:52.501501 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb2744-df8e-4dca-84f9-7c72eadbba1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:52.501777 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcb2744-df8e-4dca-84f9-7c72eadbba1e admin admin] PATH_INFO: `/v3/users/79bbb4517c38442e84193b95d41de1d3` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:52.502948 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb2744-df8e-4dca-84f9-7c72eadbba1e admin admin] RBAC: Authorizing `identity:delete_user(user_id=79bbb4517c38442e84193b95d41de1d3)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:52.504894 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcb2744-df8e-4dca-84f9-7c72eadbba1e admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:52.549603 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9bcb2744-df8e-4dca-84f9-7c72eadbba1e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '79bbb4517c38442e84193b95d41de1d3'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:52.550701 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:52.562321 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9bcb2744-df8e-4dca-84f9-7c72eadbba1e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '79bbb4517c38442e84193b95d41de1d3'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:52.562990 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9bcb2744-df8e-4dca-84f9-7c72eadbba1e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '79bbb4517c38442e84193b95d41de1d3'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:52.563583 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9bcb2744-df8e-4dca-84f9-7c72eadbba1e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '79bbb4517c38442e84193b95d41de1d3'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:52.570533 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9bcb2744-df8e-4dca-84f9-7c72eadbba1e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '79bbb4517c38442e84193b95d41de1d3'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:52.583401 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1035/2058] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:22:52 2022] DELETE /identity/v3/users/79bbb4517c38442e84193b95d41de1d3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:22:52.589440 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15f8f5-2682-4143-9a2c-cc207717f8cb None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:52.589843 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15f8f5-2682-4143-9a2c-cc207717f8cb None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:52.590226 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e15f8f5-2682-4143-9a2c-cc207717f8cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:52.609411 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-5e15f8f5-2682-4143-9a2c-cc207717f8cb None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:22:52.610594 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-5e15f8f5-2682-4143-9a2c-cc207717f8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:52.668543 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1024/2059] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:22:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:22:52.678008 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb2744-df8e-4dca-84f9-7c72eadbba1e admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:52.679494 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9bcb2744-df8e-4dca-84f9-7c72eadbba1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:52.740691 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcb2744-df8e-4dca-84f9-7c72eadbba1e admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:52.741373 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c84d8-76ca-41bc-a25e-f116c1e71e2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:52.742000 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c84d8-76ca-41bc-a25e-f116c1e71e2f service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:52.742279 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c84d8-76ca-41bc-a25e-f116c1e71e2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:52.742553 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-027c84d8-76ca-41bc-a25e-f116c1e71e2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:52.752979 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c84d8-76ca-41bc-a25e-f116c1e71e2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:52.754428 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-027c84d8-76ca-41bc-a25e-f116c1e71e2f service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:52.764486 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1036/2060] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:22:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:22:53.060487 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15f8f5-2682-4143-9a2c-cc207717f8cb None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:53.065980 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-5e15f8f5-2682-4143-9a2c-cc207717f8cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:53.090506 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e15f8f5-2682-4143-9a2c-cc207717f8cb None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:53.100830 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3894d-23ba-43bf-bd1d-5c6fce04032b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:53.101503 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3894d-23ba-43bf-bd1d-5c6fce04032b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:53.110759 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3894d-23ba-43bf-bd1d-5c6fce04032b admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:53.111284 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed3894d-23ba-43bf-bd1d-5c6fce04032b admin admin] PATH_INFO: `/v3/projects/b52ed752b8c44eb2a7a36beedaf18661` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:53.113111 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed3894d-23ba-43bf-bd1d-5c6fce04032b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b52ed752b8c44eb2a7a36beedaf18661)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:53.115509 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed3894d-23ba-43bf-bd1d-5c6fce04032b admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:53.185677 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-2ed3894d-23ba-43bf-bd1d-5c6fce04032b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b52ed752b8c44eb2a7a36beedaf18661', 'request_id': 'req-2ed3894d-23ba-43bf-bd1d-5c6fce04032b'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:53.193369 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-2ed3894d-23ba-43bf-bd1d-5c6fce04032b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b52ed752b8c44eb2a7a36beedaf18661', 'request_id': 'req-2ed3894d-23ba-43bf-bd1d-5c6fce04032b'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:53.204718 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-2ed3894d-23ba-43bf-bd1d-5c6fce04032b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b52ed752b8c44eb2a7a36beedaf18661', 'request_id': 'req-2ed3894d-23ba-43bf-bd1d-5c6fce04032b'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:53.225086 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-2ed3894d-23ba-43bf-bd1d-5c6fce04032b admin admin] The token cache is being invalidate because project b52ed752b8c44eb2a7a36beedaf18661 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:22:53.225798 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-2ed3894d-23ba-43bf-bd1d-5c6fce04032b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:53.226606 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-2ed3894d-23ba-43bf-bd1d-5c6fce04032b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:53.229006 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1025/2061] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:22:53 2022] DELETE /identity/v3/projects/b52ed752b8c44eb2a7a36beedaf18661 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:22:53.232860 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c84d8-76ca-41bc-a25e-f116c1e71e2f service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:53.243836 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-027c84d8-76ca-41bc-a25e-f116c1e71e2f service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:53.307488 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c81c3d-a66a-49da-95e0-f39333eb7aad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:53.307709 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c81c3d-a66a-49da-95e0-f39333eb7aad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:53.307986 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c81c3d-a66a-49da-95e0-f39333eb7aad admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:53.308254 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c81c3d-a66a-49da-95e0-f39333eb7aad admin admin] PATH_INFO: `/v3/users/e6b3e96a63d2467fbe4baea17445f936` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:53.309684 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c81c3d-a66a-49da-95e0-f39333eb7aad admin admin] RBAC: Authorizing `identity:delete_user(user_id=e6b3e96a63d2467fbe4baea17445f936)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:53.311873 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4c81c3d-a66a-49da-95e0-f39333eb7aad admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:53.371768 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c4c81c3d-a66a-49da-95e0-f39333eb7aad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e6b3e96a63d2467fbe4baea17445f936'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:53.387351 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c4c81c3d-a66a-49da-95e0-f39333eb7aad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e6b3e96a63d2467fbe4baea17445f936'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:53.388557 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c4c81c3d-a66a-49da-95e0-f39333eb7aad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e6b3e96a63d2467fbe4baea17445f936'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:53.389475 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c4c81c3d-a66a-49da-95e0-f39333eb7aad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e6b3e96a63d2467fbe4baea17445f936'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:53.393856 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:53.402287 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c4c81c3d-a66a-49da-95e0-f39333eb7aad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e6b3e96a63d2467fbe4baea17445f936'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:53.421158 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1037/2062] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:22:53 2022] DELETE /identity/v3/users/e6b3e96a63d2467fbe4baea17445f936 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:22:53.886780 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3894d-23ba-43bf-bd1d-5c6fce04032b admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:53.889908 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-2ed3894d-23ba-43bf-bd1d-5c6fce04032b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:53.923698 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed3894d-23ba-43bf-bd1d-5c6fce04032b admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:53.940511 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:54.022158 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2b502-ed6f-4988-8d03-bf602c39c0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:54.023598 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2b502-ed6f-4988-8d03-bf602c39c0ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:54.024153 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2b502-ed6f-4988-8d03-bf602c39c0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:54.026180 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2b502-ed6f-4988-8d03-bf602c39c0ee admin admin] PATH_INFO: `/v3/projects/a5b89f14b29745649aa89636d66768d5` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:54.028053 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb2b502-ed6f-4988-8d03-bf602c39c0ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5b89f14b29745649aa89636d66768d5)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:54.032066 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb2b502-ed6f-4988-8d03-bf602c39c0ee admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:54.103503 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-0cb2b502-ed6f-4988-8d03-bf602c39c0ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5b89f14b29745649aa89636d66768d5', 'request_id': 'req-0cb2b502-ed6f-4988-8d03-bf602c39c0ee'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:54.111550 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-0cb2b502-ed6f-4988-8d03-bf602c39c0ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5b89f14b29745649aa89636d66768d5', 'request_id': 'req-0cb2b502-ed6f-4988-8d03-bf602c39c0ee'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:54.121116 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-0cb2b502-ed6f-4988-8d03-bf602c39c0ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5b89f14b29745649aa89636d66768d5', 'request_id': 'req-0cb2b502-ed6f-4988-8d03-bf602c39c0ee'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:54.135581 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-0cb2b502-ed6f-4988-8d03-bf602c39c0ee admin admin] The token cache is being invalidate because project a5b89f14b29745649aa89636d66768d5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:22:54.135869 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-0cb2b502-ed6f-4988-8d03-bf602c39c0ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:54.137061 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-0cb2b502-ed6f-4988-8d03-bf602c39c0ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:54.138487 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1026/2063] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:22:53 2022] DELETE /identity/v3/projects/a5b89f14b29745649aa89636d66768d5 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:22:54.144886 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de89fad-1029-41d1-84ab-aac14cc47e5c None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:54.145363 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de89fad-1029-41d1-84ab-aac14cc47e5c None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:54.145937 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de89fad-1029-41d1-84ab-aac14cc47e5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:54.177814 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-3de89fad-1029-41d1-84ab-aac14cc47e5c None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:22:54.179416 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-3de89fad-1029-41d1-84ab-aac14cc47e5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:54.288367 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1038/2064] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:22:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:22:54.298911 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a70d3-142a-4684-a87e-4b6a3011c139 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:54.299353 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a70d3-142a-4684-a87e-4b6a3011c139 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:54.299634 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141a70d3-142a-4684-a87e-4b6a3011c139 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:54.324734 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-141a70d3-142a-4684-a87e-4b6a3011c139 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:22:54.326256 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-141a70d3-142a-4684-a87e-4b6a3011c139 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:54.341671 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1027/2065] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:22:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:22:54.347837 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de89fad-1029-41d1-84ab-aac14cc47e5c None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:54.362272 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de89fad-1029-41d1-84ab-aac14cc47e5c None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:54.370222 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00b22a-abdd-4881-812b-fca54a55c3c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:54.370890 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00b22a-abdd-4881-812b-fca54a55c3c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:54.371199 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00b22a-abdd-4881-812b-fca54a55c3c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:54.371477 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00b22a-abdd-4881-812b-fca54a55c3c5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:54.372288 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00b22a-abdd-4881-812b-fca54a55c3c5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:22:54.372672 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00b22a-abdd-4881-812b-fca54a55c3c5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:54.374722 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00b22a-abdd-4881-812b-fca54a55c3c5 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:54.394514 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1039/2066] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:22:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:22:54.395436 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a70d3-142a-4684-a87e-4b6a3011c139 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:54.413569 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141a70d3-142a-4684-a87e-4b6a3011c139 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:54.441125 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32047705-dceb-4a80-b471-476ea4523455 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:54.441632 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32047705-dceb-4a80-b471-476ea4523455 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:54.441983 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32047705-dceb-4a80-b471-476ea4523455 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:54.442328 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32047705-dceb-4a80-b471-476ea4523455 admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:54.443071 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32047705-dceb-4a80-b471-476ea4523455 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:54.449054 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32047705-dceb-4a80-b471-476ea4523455 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:54.517822 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1028/2067] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:22:54 2022] POST /identity/v3/projects => generated 379 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:22:54.522063 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00b22a-abdd-4881-812b-fca54a55c3c5 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:54.532802 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00b22a-abdd-4881-812b-fca54a55c3c5 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:54.614141 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff840b00-6ca0-460f-810c-7fc67814c182 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:54.614937 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff840b00-6ca0-460f-810c-7fc67814c182 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:54.615323 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff840b00-6ca0-460f-810c-7fc67814c182 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:54.615732 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff840b00-6ca0-460f-810c-7fc67814c182 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:54.616597 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff840b00-6ca0-460f-810c-7fc67814c182 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:54.618810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff840b00-6ca0-460f-810c-7fc67814c182 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:54.652919 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1040/2068] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:22:54 2022] POST /identity/v3/users => generated 290 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:22:54.656975 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32047705-dceb-4a80-b471-476ea4523455 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:54.668802 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32047705-dceb-4a80-b471-476ea4523455 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:54.676767 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e9edf-1bf3-483d-9eba-48bf578d3a0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:54.677393 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e9edf-1bf3-483d-9eba-48bf578d3a0b admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:54.677673 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e9edf-1bf3-483d-9eba-48bf578d3a0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:54.677949 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6e9edf-1bf3-483d-9eba-48bf578d3a0b admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:54.678653 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e9edf-1bf3-483d-9eba-48bf578d3a0b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:54.680290 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6e9edf-1bf3-483d-9eba-48bf578d3a0b admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:54.692301 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1029/2069] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:22:54.696582 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff840b00-6ca0-460f-810c-7fc67814c182 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:54.707595 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff840b00-6ca0-460f-810c-7fc67814c182 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:54.713607 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e8d32d-0591-4992-aa54-06434a5413a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:54.714425 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8d32d-0591-4992-aa54-06434a5413a4 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:54.714774 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8d32d-0591-4992-aa54-06434a5413a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:54.715111 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e8d32d-0591-4992-aa54-06434a5413a4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:54.715823 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e8d32d-0591-4992-aa54-06434a5413a4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:54.717439 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e8d32d-0591-4992-aa54-06434a5413a4 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:54.728686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1041/2070] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:22:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:22:54.733559 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e9edf-1bf3-483d-9eba-48bf578d3a0b admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:54.744353 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6e9edf-1bf3-483d-9eba-48bf578d3a0b admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:54.749107 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e6d62-9d6f-468d-92e5-a44e8c34ee74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:54.749780 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e6d62-9d6f-468d-92e5-a44e8c34ee74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:54.750062 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e6d62-9d6f-468d-92e5-a44e8c34ee74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:54.750340 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0e6d62-9d6f-468d-92e5-a44e8c34ee74 admin admin] PATH_INFO: `/v3/projects/0760f379b42b49939ab505dd54990fae/users/7653c6b3d6494798a1171338dd124075/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:54.765731 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e6d62-9d6f-468d-92e5-a44e8c34ee74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0760f379b42b49939ab505dd54990fae, user_id=7653c6b3d6494798a1171338dd124075, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:54.768427 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0e6d62-9d6f-468d-92e5-a44e8c34ee74 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:54.782028 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1030/2071] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:22:54 2022] PUT /identity/v3/projects/0760f379b42b49939ab505dd54990fae/users/7653c6b3d6494798a1171338dd124075/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:22:54.793167 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1853d0-a84e-4b43-9de0-f2f024aed4d2 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:54.793380 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1853d0-a84e-4b43-9de0-f2f024aed4d2 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:54.793655 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1853d0-a84e-4b43-9de0-f2f024aed4d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:54.825083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-2d1853d0-a84e-4b43-9de0-f2f024aed4d2 None None] MFA Rules not processed for user `7653c6b3d6494798a1171338dd124075`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:22:54.826218 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-2d1853d0-a84e-4b43-9de0-f2f024aed4d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:54.920867 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:54.955005 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1042/2072] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:22:54 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:22:54.959678 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e6d62-9d6f-468d-92e5-a44e8c34ee74 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:55.022017 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:55.036402 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0e6d62-9d6f-468d-92e5-a44e8c34ee74 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:55.042164 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac3f23-af29-490b-844e-680b2cf1e2af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:55.042789 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac3f23-af29-490b-844e-680b2cf1e2af admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:55.043072 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac3f23-af29-490b-844e-680b2cf1e2af admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:55.043426 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ac3f23-af29-490b-844e-680b2cf1e2af admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:55.044043 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac3f23-af29-490b-844e-680b2cf1e2af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:55.045986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83ac3f23-af29-490b-844e-680b2cf1e2af admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:55.078422 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1031/2073] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:22:54 2022] POST /identity/v3/projects => generated 379 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:22:55.083331 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1853d0-a84e-4b43-9de0-f2f024aed4d2 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:55.096429 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1853d0-a84e-4b43-9de0-f2f024aed4d2 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:55.169009 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741cc331-46ca-4fc5-b245-896279147e8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:55.169722 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741cc331-46ca-4fc5-b245-896279147e8e admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:55.170081 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741cc331-46ca-4fc5-b245-896279147e8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:55.170426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741cc331-46ca-4fc5-b245-896279147e8e admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:55.171183 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741cc331-46ca-4fc5-b245-896279147e8e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:55.173214 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741cc331-46ca-4fc5-b245-896279147e8e admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:55.204680 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1043/2074] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:22:55 2022] POST /identity/v3/users => generated 296 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:22:55.205696 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac3f23-af29-490b-844e-680b2cf1e2af admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:55.219974 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83ac3f23-af29-490b-844e-680b2cf1e2af admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:55.225359 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3dc81c-b375-4ddf-9374-e654e26433db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:55.225993 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3dc81c-b375-4ddf-9374-e654e26433db admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:55.226273 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3dc81c-b375-4ddf-9374-e654e26433db admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:55.226549 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3dc81c-b375-4ddf-9374-e654e26433db admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:55.227349 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3dc81c-b375-4ddf-9374-e654e26433db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:55.230100 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3dc81c-b375-4ddf-9374-e654e26433db admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:55.242970 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1032/2075] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:22:55.247223 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741cc331-46ca-4fc5-b245-896279147e8e admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:55.257997 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741cc331-46ca-4fc5-b245-896279147e8e admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:55.263407 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b205be-b066-4fe1-bd22-ad84678b35cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:55.264088 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b205be-b066-4fe1-bd22-ad84678b35cf admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:55.264390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b205be-b066-4fe1-bd22-ad84678b35cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:55.264666 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b205be-b066-4fe1-bd22-ad84678b35cf admin admin] PATH_INFO: `/v3/projects/942768662ca64448928f634070990c64/users/003f9b24d9dc4f36bfbfc6fe91b35422/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:55.280738 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b205be-b066-4fe1-bd22-ad84678b35cf admin admin] RBAC: Authorizing `identity:create_grant(project_id=942768662ca64448928f634070990c64, user_id=003f9b24d9dc4f36bfbfc6fe91b35422, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:55.283402 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b205be-b066-4fe1-bd22-ad84678b35cf admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:55.301686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1044/2076] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:22:55 2022] PUT /identity/v3/projects/942768662ca64448928f634070990c64/users/003f9b24d9dc4f36bfbfc6fe91b35422/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:22:55.303753 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3dc81c-b375-4ddf-9374-e654e26433db admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:55.316537 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3dc81c-b375-4ddf-9374-e654e26433db admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:55.391871 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c4e051-269f-4ae5-b1a3-f16ac0d75bbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:55.392683 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4e051-269f-4ae5-b1a3-f16ac0d75bbd admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:55.392969 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4e051-269f-4ae5-b1a3-f16ac0d75bbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:55.393243 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c4e051-269f-4ae5-b1a3-f16ac0d75bbd admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:55.394011 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4e051-269f-4ae5-b1a3-f16ac0d75bbd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:55.395862 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c4e051-269f-4ae5-b1a3-f16ac0d75bbd admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:55.408594 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1033/2077] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:22:55 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:22:55.413055 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b205be-b066-4fe1-bd22-ad84678b35cf admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:55.440367 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b205be-b066-4fe1-bd22-ad84678b35cf admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:55.450176 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f2eb1-16aa-4bf0-a662-f3cb40688e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:55.450855 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f2eb1-16aa-4bf0-a662-f3cb40688e49 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:55.451129 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f2eb1-16aa-4bf0-a662-f3cb40688e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:55.451404 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5f2eb1-16aa-4bf0-a662-f3cb40688e49 admin admin] PATH_INFO: `/v3/projects/942768662ca64448928f634070990c64/users/003f9b24d9dc4f36bfbfc6fe91b35422/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:55.454021 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f2eb1-16aa-4bf0-a662-f3cb40688e49 admin admin] RBAC: Authorizing `identity:create_grant(project_id=942768662ca64448928f634070990c64, user_id=003f9b24d9dc4f36bfbfc6fe91b35422, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:55.456689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5f2eb1-16aa-4bf0-a662-f3cb40688e49 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:55.476614 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1045/2078] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:22:55 2022] PUT /identity/v3/projects/942768662ca64448928f634070990c64/users/003f9b24d9dc4f36bfbfc6fe91b35422/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:22:55.480982 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba69ce5-69fe-45b9-baa4-7d42b11b516d None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:55.481929 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba69ce5-69fe-45b9-baa4-7d42b11b516d None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:55.482213 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba69ce5-69fe-45b9-baa4-7d42b11b516d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:55.518057 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-2ba69ce5-69fe-45b9-baa4-7d42b11b516d None None] MFA Rules not processed for user `003f9b24d9dc4f36bfbfc6fe91b35422`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:22:55.519343 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-2ba69ce5-69fe-45b9-baa4-7d42b11b516d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:55.636605 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1034/2079] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:22:55 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:22:55.730547 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f2eb1-16aa-4bf0-a662-f3cb40688e49 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:55.734295 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-ca5f2eb1-16aa-4bf0-a662-f3cb40688e49 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:55.808616 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5f2eb1-16aa-4bf0-a662-f3cb40688e49 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:55.819192 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a86fd2-ab93-4124-b2db-a143215979c0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:55.820773 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a86fd2-ab93-4124-b2db-a143215979c0 service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:55.821727 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a86fd2-ab93-4124-b2db-a143215979c0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:55.831942 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a86fd2-ab93-4124-b2db-a143215979c0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:55.866882 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a86fd2-ab93-4124-b2db-a143215979c0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:55.868698 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a86fd2-ab93-4124-b2db-a143215979c0 service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:55.891602 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1046/2080] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:22:55 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:22:56.383359 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba69ce5-69fe-45b9-baa4-7d42b11b516d None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:56.407959 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba69ce5-69fe-45b9-baa4-7d42b11b516d None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:56.431518 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518bd99-e34a-4144-b199-a840ed2d4243 tempest-VolumeQuotaClassesTest-470839145 tempest-VolumeQuotaClassesTest-470839145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '003f9b24d9dc4f36bfbfc6fe91b35422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942768662ca64448928f634070990c64', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:56.433087 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518bd99-e34a-4144-b199-a840ed2d4243 tempest-VolumeQuotaClassesTest-470839145 tempest-VolumeQuotaClassesTest-470839145-project-admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:56.433336 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518bd99-e34a-4144-b199-a840ed2d4243 tempest-VolumeQuotaClassesTest-470839145 tempest-VolumeQuotaClassesTest-470839145-project-admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:56.433696 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a518bd99-e34a-4144-b199-a840ed2d4243 tempest-VolumeQuotaClassesTest-470839145 tempest-VolumeQuotaClassesTest-470839145-project-admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:56.439246 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518bd99-e34a-4144-b199-a840ed2d4243 tempest-VolumeQuotaClassesTest-470839145 tempest-VolumeQuotaClassesTest-470839145-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:22:56.440026 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518bd99-e34a-4144-b199-a840ed2d4243 tempest-VolumeQuotaClassesTest-470839145 tempest-VolumeQuotaClassesTest-470839145-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:56.441869 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a518bd99-e34a-4144-b199-a840ed2d4243 tempest-VolumeQuotaClassesTest-470839145 tempest-VolumeQuotaClassesTest-470839145-project-admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:56.474731 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1035/2081] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:22:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:22:56.485925 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a86fd2-ab93-4124-b2db-a143215979c0 service cinder] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:56.501574 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a86fd2-ab93-4124-b2db-a143215979c0 service cinder] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:56.509388 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc85d7d-e907-4124-9876-dfd7509c4e86 tempest-VolumeQuotaClassesTest-470839145 tempest-VolumeQuotaClassesTest-470839145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '003f9b24d9dc4f36bfbfc6fe91b35422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942768662ca64448928f634070990c64', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:56.511137 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc85d7d-e907-4124-9876-dfd7509c4e86 tempest-VolumeQuotaClassesTest-470839145 tempest-VolumeQuotaClassesTest-470839145-project-admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:56.511749 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc85d7d-e907-4124-9876-dfd7509c4e86 tempest-VolumeQuotaClassesTest-470839145 tempest-VolumeQuotaClassesTest-470839145-project-admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:56.512097 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edc85d7d-e907-4124-9876-dfd7509c4e86 tempest-VolumeQuotaClassesTest-470839145 tempest-VolumeQuotaClassesTest-470839145-project-admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:56.512914 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc85d7d-e907-4124-9876-dfd7509c4e86 tempest-VolumeQuotaClassesTest-470839145 tempest-VolumeQuotaClassesTest-470839145-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:56.515142 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edc85d7d-e907-4124-9876-dfd7509c4e86 tempest-VolumeQuotaClassesTest-470839145 tempest-VolumeQuotaClassesTest-470839145-project-admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:56.557813 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1047/2082] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:22:56 2022] POST /identity/v3/projects => generated 355 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:22:56.562328 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518bd99-e34a-4144-b199-a840ed2d4243 tempest-VolumeQuotaClassesTest-470839145 tempest-VolumeQuotaClassesTest-470839145-project-admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:56.574616 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a518bd99-e34a-4144-b199-a840ed2d4243 tempest-VolumeQuotaClassesTest-470839145 tempest-VolumeQuotaClassesTest-470839145-project-admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:56.600988 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:56.641818 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566b712-844e-48b6-a90d-daf9ac8f8476 tempest-VolumeQuotaClassesTest-470839145 tempest-VolumeQuotaClassesTest-470839145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '003f9b24d9dc4f36bfbfc6fe91b35422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942768662ca64448928f634070990c64', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:56.642433 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566b712-844e-48b6-a90d-daf9ac8f8476 tempest-VolumeQuotaClassesTest-470839145 tempest-VolumeQuotaClassesTest-470839145-project-admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:56.642885 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566b712-844e-48b6-a90d-daf9ac8f8476 tempest-VolumeQuotaClassesTest-470839145 tempest-VolumeQuotaClassesTest-470839145-project-admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:56.643179 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566b712-844e-48b6-a90d-daf9ac8f8476 tempest-VolumeQuotaClassesTest-470839145 tempest-VolumeQuotaClassesTest-470839145-project-admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:56.643889 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8566b712-844e-48b6-a90d-daf9ac8f8476 tempest-VolumeQuotaClassesTest-470839145 tempest-VolumeQuotaClassesTest-470839145-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:22:56.644193 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8566b712-844e-48b6-a90d-daf9ac8f8476 tempest-VolumeQuotaClassesTest-470839145 tempest-VolumeQuotaClassesTest-470839145-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:56.645892 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8566b712-844e-48b6-a90d-daf9ac8f8476 tempest-VolumeQuotaClassesTest-470839145 tempest-VolumeQuotaClassesTest-470839145-project-admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:56.659874 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1036/2083] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:22:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:22:56.702626 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc85d7d-e907-4124-9876-dfd7509c4e86 tempest-VolumeQuotaClassesTest-470839145 tempest-VolumeQuotaClassesTest-470839145-project-admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:56.715323 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edc85d7d-e907-4124-9876-dfd7509c4e86 tempest-VolumeQuotaClassesTest-470839145 tempest-VolumeQuotaClassesTest-470839145-project-admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:56.720626 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d729fb-eea1-448d-869a-6432442ccfee tempest-VolumeQuotaClassesTest-470839145 tempest-VolumeQuotaClassesTest-470839145-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '003f9b24d9dc4f36bfbfc6fe91b35422', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '942768662ca64448928f634070990c64', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:56.721302 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d729fb-eea1-448d-869a-6432442ccfee tempest-VolumeQuotaClassesTest-470839145 tempest-VolumeQuotaClassesTest-470839145-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:56.721576 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d729fb-eea1-448d-869a-6432442ccfee tempest-VolumeQuotaClassesTest-470839145 tempest-VolumeQuotaClassesTest-470839145-project-admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:56.722054 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d729fb-eea1-448d-869a-6432442ccfee tempest-VolumeQuotaClassesTest-470839145 tempest-VolumeQuotaClassesTest-470839145-project-admin] PATH_INFO: `/v3/projects/da25990bff29447c8e46eb8d1c5a9615` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:56.723252 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d729fb-eea1-448d-869a-6432442ccfee tempest-VolumeQuotaClassesTest-470839145 tempest-VolumeQuotaClassesTest-470839145-project-admin] RBAC: Authorizing `identity:delete_project(project_id=da25990bff29447c8e46eb8d1c5a9615)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:56.725409 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d729fb-eea1-448d-869a-6432442ccfee tempest-VolumeQuotaClassesTest-470839145 tempest-VolumeQuotaClassesTest-470839145-project-admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:56.739729 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:56.788362 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-41d729fb-eea1-448d-869a-6432442ccfee tempest-VolumeQuotaClassesTest-470839145 tempest-VolumeQuotaClassesTest-470839145-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da25990bff29447c8e46eb8d1c5a9615', 'request_id': 'req-41d729fb-eea1-448d-869a-6432442ccfee'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:56.802394 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-41d729fb-eea1-448d-869a-6432442ccfee tempest-VolumeQuotaClassesTest-470839145 tempest-VolumeQuotaClassesTest-470839145-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da25990bff29447c8e46eb8d1c5a9615', 'request_id': 'req-41d729fb-eea1-448d-869a-6432442ccfee'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:56.817958 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-41d729fb-eea1-448d-869a-6432442ccfee tempest-VolumeQuotaClassesTest-470839145 tempest-VolumeQuotaClassesTest-470839145-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da25990bff29447c8e46eb8d1c5a9615', 'request_id': 'req-41d729fb-eea1-448d-869a-6432442ccfee'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:56.833282 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-41d729fb-eea1-448d-869a-6432442ccfee tempest-VolumeQuotaClassesTest-470839145 tempest-VolumeQuotaClassesTest-470839145-project-admin] The token cache is being invalidate because project da25990bff29447c8e46eb8d1c5a9615 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:22:56.833861 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-41d729fb-eea1-448d-869a-6432442ccfee tempest-VolumeQuotaClassesTest-470839145 tempest-VolumeQuotaClassesTest-470839145-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:56.834868 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-41d729fb-eea1-448d-869a-6432442ccfee tempest-VolumeQuotaClassesTest-470839145 tempest-VolumeQuotaClassesTest-470839145-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:56.840823 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1048/2084] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:22:56 2022] DELETE /identity/v3/projects/da25990bff29447c8e46eb8d1c5a9615 => generated 0 bytes in 134 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:22:57.117126 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566b712-844e-48b6-a90d-daf9ac8f8476 tempest-VolumeQuotaClassesTest-470839145 tempest-VolumeQuotaClassesTest-470839145-project-admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:57.125144 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-8566b712-844e-48b6-a90d-daf9ac8f8476 tempest-VolumeQuotaClassesTest-470839145 tempest-VolumeQuotaClassesTest-470839145-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:57.228508 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566b712-844e-48b6-a90d-daf9ac8f8476 tempest-VolumeQuotaClassesTest-470839145 tempest-VolumeQuotaClassesTest-470839145-project-admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:57.313138 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c98d5953-b0af-4d27-a784-476ef3aa2140 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:57.314055 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d5953-b0af-4d27-a784-476ef3aa2140 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:57.314342 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d5953-b0af-4d27-a784-476ef3aa2140 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:57.314625 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c98d5953-b0af-4d27-a784-476ef3aa2140 admin admin] PATH_INFO: `/v3/users/7653c6b3d6494798a1171338dd124075` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:57.315885 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98d5953-b0af-4d27-a784-476ef3aa2140 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7653c6b3d6494798a1171338dd124075)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:57.318077 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c98d5953-b0af-4d27-a784-476ef3aa2140 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:57.372980 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d729fb-eea1-448d-869a-6432442ccfee tempest-VolumeQuotaClassesTest-470839145 tempest-VolumeQuotaClassesTest-470839145-project-admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:57.374383 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-41d729fb-eea1-448d-869a-6432442ccfee tempest-VolumeQuotaClassesTest-470839145 tempest-VolumeQuotaClassesTest-470839145-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:57.391675 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-c98d5953-b0af-4d27-a784-476ef3aa2140 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7653c6b3d6494798a1171338dd124075'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:57.405406 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d729fb-eea1-448d-869a-6432442ccfee tempest-VolumeQuotaClassesTest-470839145 tempest-VolumeQuotaClassesTest-470839145-project-admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:57.406528 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-c98d5953-b0af-4d27-a784-476ef3aa2140 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7653c6b3d6494798a1171338dd124075'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:57.407367 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-c98d5953-b0af-4d27-a784-476ef3aa2140 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7653c6b3d6494798a1171338dd124075'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:57.408048 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-c98d5953-b0af-4d27-a784-476ef3aa2140 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7653c6b3d6494798a1171338dd124075'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:57.411567 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:57.414601 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cda935-51b6-4083-b8e1-491934b01c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:57.415484 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cda935-51b6-4083-b8e1-491934b01c58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:57.415724 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cda935-51b6-4083-b8e1-491934b01c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:57.416099 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57cda935-51b6-4083-b8e1-491934b01c58 admin admin] PATH_INFO: `/v3/users/4e39a7be17b94c9c9dfb9ac1599a0052` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:57.417602 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cda935-51b6-4083-b8e1-491934b01c58 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e39a7be17b94c9c9dfb9ac1599a0052)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:57.419919 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57cda935-51b6-4083-b8e1-491934b01c58 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:57.420603 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-c98d5953-b0af-4d27-a784-476ef3aa2140 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7653c6b3d6494798a1171338dd124075'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:57.439595 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1037/2085] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:22:57 2022] DELETE /identity/v3/users/7653c6b3d6494798a1171338dd124075 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:22:57.444180 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b6a46-bc7a-4e65-a336-205079203148 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:57.444564 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b6a46-bc7a-4e65-a336-205079203148 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:57.444798 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b6a46-bc7a-4e65-a336-205079203148 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:57.468789 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-c89b6a46-bc7a-4e65-a336-205079203148 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:22:57.470325 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-c89b6a46-bc7a-4e65-a336-205079203148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:57.482237 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-57cda935-51b6-4083-b8e1-491934b01c58 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e39a7be17b94c9c9dfb9ac1599a0052'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:57.497021 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-57cda935-51b6-4083-b8e1-491934b01c58 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e39a7be17b94c9c9dfb9ac1599a0052'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:57.498158 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-57cda935-51b6-4083-b8e1-491934b01c58 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e39a7be17b94c9c9dfb9ac1599a0052'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:57.498782 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-57cda935-51b6-4083-b8e1-491934b01c58 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e39a7be17b94c9c9dfb9ac1599a0052'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:57.507715 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-57cda935-51b6-4083-b8e1-491934b01c58 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e39a7be17b94c9c9dfb9ac1599a0052'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:57.526620 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1049/2086] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:22:57 2022] DELETE /identity/v3/users/4e39a7be17b94c9c9dfb9ac1599a0052 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:22:57.551612 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1038/2087] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:22:57.565244 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cda935-51b6-4083-b8e1-491934b01c58 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:57.566867 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-57cda935-51b6-4083-b8e1-491934b01c58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:57.651214 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57cda935-51b6-4083-b8e1-491934b01c58 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:57.658341 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9431dfd-d841-49e5-866c-9609f2855b56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:57.659177 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9431dfd-d841-49e5-866c-9609f2855b56 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:57.659601 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9431dfd-d841-49e5-866c-9609f2855b56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:57.660009 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9431dfd-d841-49e5-866c-9609f2855b56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:57.690768 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:57.739907 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9431dfd-d841-49e5-866c-9609f2855b56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:57.741664 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9431dfd-d841-49e5-866c-9609f2855b56 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:57.755909 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1050/2088] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:22:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:22:57.761464 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b6a46-bc7a-4e65-a336-205079203148 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:57.763058 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-c89b6a46-bc7a-4e65-a336-205079203148 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:57.779694 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b6a46-bc7a-4e65-a336-205079203148 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:57.785965 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef763cbd-4670-4d8d-8b16-fcad4cdfb265 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:57.786892 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef763cbd-4670-4d8d-8b16-fcad4cdfb265 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:57.787449 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef763cbd-4670-4d8d-8b16-fcad4cdfb265 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:57.787828 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef763cbd-4670-4d8d-8b16-fcad4cdfb265 admin admin] PATH_INFO: `/v3/projects/5550d9709b98404290936885c7bbb16d` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:57.789682 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef763cbd-4670-4d8d-8b16-fcad4cdfb265 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5550d9709b98404290936885c7bbb16d)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:57.793118 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef763cbd-4670-4d8d-8b16-fcad4cdfb265 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:57.885954 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-ef763cbd-4670-4d8d-8b16-fcad4cdfb265 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5550d9709b98404290936885c7bbb16d', 'request_id': 'req-ef763cbd-4670-4d8d-8b16-fcad4cdfb265'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:57.895315 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-ef763cbd-4670-4d8d-8b16-fcad4cdfb265 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5550d9709b98404290936885c7bbb16d', 'request_id': 'req-ef763cbd-4670-4d8d-8b16-fcad4cdfb265'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:57.907031 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-ef763cbd-4670-4d8d-8b16-fcad4cdfb265 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5550d9709b98404290936885c7bbb16d', 'request_id': 'req-ef763cbd-4670-4d8d-8b16-fcad4cdfb265'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:57.919813 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-ef763cbd-4670-4d8d-8b16-fcad4cdfb265 admin admin] The token cache is being invalidate because project 5550d9709b98404290936885c7bbb16d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:22:57.920100 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-ef763cbd-4670-4d8d-8b16-fcad4cdfb265 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:57.920752 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-ef763cbd-4670-4d8d-8b16-fcad4cdfb265 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:57.922295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1039/2089] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:22:57 2022] DELETE /identity/v3/projects/5550d9709b98404290936885c7bbb16d => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:22:57.927287 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6cd49-57fe-44da-b711-85f9404c1c8f None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:57.927570 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6cd49-57fe-44da-b711-85f9404c1c8f None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:57.927843 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d6cd49-57fe-44da-b711-85f9404c1c8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:57.949439 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-58d6cd49-57fe-44da-b711-85f9404c1c8f None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:22:57.950702 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-58d6cd49-57fe-44da-b711-85f9404c1c8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:58.029107 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1051/2090] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:22:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:22:58.037321 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be2173-d138-47e8-92ab-69f8d6961a66 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:58.037611 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be2173-d138-47e8-92ab-69f8d6961a66 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:58.037893 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04be2173-d138-47e8-92ab-69f8d6961a66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:58.059930 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-04be2173-d138-47e8-92ab-69f8d6961a66 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:22:58.061188 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-04be2173-d138-47e8-92ab-69f8d6961a66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:58.081728 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1040/2091] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:22:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:22:58.086120 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6cd49-57fe-44da-b711-85f9404c1c8f None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:58.101730 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d6cd49-57fe-44da-b711-85f9404c1c8f None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:58.109354 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63f54a-63b4-490c-8da9-22faba4f62d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:58.109942 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63f54a-63b4-490c-8da9-22faba4f62d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:58.110233 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63f54a-63b4-490c-8da9-22faba4f62d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:58.111324 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d63f54a-63b4-490c-8da9-22faba4f62d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:58.111324 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d63f54a-63b4-490c-8da9-22faba4f62d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:22:58.111536 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d63f54a-63b4-490c-8da9-22faba4f62d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:58.113346 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d63f54a-63b4-490c-8da9-22faba4f62d6 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:58.129593 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1052/2092] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:22:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:22:58.135534 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be2173-d138-47e8-92ab-69f8d6961a66 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:58.146153 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04be2173-d138-47e8-92ab-69f8d6961a66 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:58.151658 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63f54a-63b4-490c-8da9-22faba4f62d6 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:58.153689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-5d63f54a-63b4-490c-8da9-22faba4f62d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:58.156738 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1393b-c9e0-44b6-a003-1de9ee7b3ccd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:58.157486 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1393b-c9e0-44b6-a003-1de9ee7b3ccd admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:58.158001 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1393b-c9e0-44b6-a003-1de9ee7b3ccd admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:58.158344 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc1393b-c9e0-44b6-a003-1de9ee7b3ccd admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:58.159245 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc1393b-c9e0-44b6-a003-1de9ee7b3ccd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:58.167713 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc1393b-c9e0-44b6-a003-1de9ee7b3ccd admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:58.169475 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d63f54a-63b4-490c-8da9-22faba4f62d6 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:58.174867 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6e60e-4fd2-4355-8782-e0db48a0ef58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:58.175584 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6e60e-4fd2-4355-8782-e0db48a0ef58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:58.175928 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6e60e-4fd2-4355-8782-e0db48a0ef58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:58.176262 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e6e60e-4fd2-4355-8782-e0db48a0ef58 admin admin] PATH_INFO: `/v3/projects/0760f379b42b49939ab505dd54990fae` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:58.177571 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6e60e-4fd2-4355-8782-e0db48a0ef58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0760f379b42b49939ab505dd54990fae)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:58.180134 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21e6e60e-4fd2-4355-8782-e0db48a0ef58 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:58.206784 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1041/2093] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:22:58 2022] POST /identity/v3/projects => generated 355 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:22:58.211039 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1393b-c9e0-44b6-a003-1de9ee7b3ccd admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:58.237935 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-21e6e60e-4fd2-4355-8782-e0db48a0ef58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0760f379b42b49939ab505dd54990fae', 'request_id': 'req-21e6e60e-4fd2-4355-8782-e0db48a0ef58'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:58.243622 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-21e6e60e-4fd2-4355-8782-e0db48a0ef58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0760f379b42b49939ab505dd54990fae', 'request_id': 'req-21e6e60e-4fd2-4355-8782-e0db48a0ef58'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:58.251706 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-21e6e60e-4fd2-4355-8782-e0db48a0ef58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0760f379b42b49939ab505dd54990fae', 'request_id': 'req-21e6e60e-4fd2-4355-8782-e0db48a0ef58'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:58.256112 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:DELETE=8,keystone:SELECT=90,keystone:INSERT=2 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:58.268512 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-21e6e60e-4fd2-4355-8782-e0db48a0ef58 admin admin] The token cache is being invalidate because project 0760f379b42b49939ab505dd54990fae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:22:58.268878 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-21e6e60e-4fd2-4355-8782-e0db48a0ef58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:58.269779 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-21e6e60e-4fd2-4355-8782-e0db48a0ef58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:58.274801 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1053/2094] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:22:58 2022] DELETE /identity/v3/projects/0760f379b42b49939ab505dd54990fae => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:22:58.277895 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6e60e-4fd2-4355-8782-e0db48a0ef58 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:58.279317 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-21e6e60e-4fd2-4355-8782-e0db48a0ef58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:58.288946 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc1393b-c9e0-44b6-a003-1de9ee7b3ccd admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:58.323851 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:58.361369 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e6e60e-4fd2-4355-8782-e0db48a0ef58 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:58.363843 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4ec3b-70f7-41d4-88b6-6e1dd9213b7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:58.364499 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4ec3b-70f7-41d4-88b6-6e1dd9213b7c admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:58.364785 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4ec3b-70f7-41d4-88b6-6e1dd9213b7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:58.365062 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c4ec3b-70f7-41d4-88b6-6e1dd9213b7c admin admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:58.365724 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c4ec3b-70f7-41d4-88b6-6e1dd9213b7c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:58.366091 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b58772-e8fd-4a1c-bc40-d82300bbba1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:58.366727 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b58772-e8fd-4a1c-bc40-d82300bbba1f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:58.367005 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b58772-e8fd-4a1c-bc40-d82300bbba1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:58.367275 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b58772-e8fd-4a1c-bc40-d82300bbba1f admin admin] PATH_INFO: `/v3/users/003f9b24d9dc4f36bfbfc6fe91b35422` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:58.367822 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c4ec3b-70f7-41d4-88b6-6e1dd9213b7c admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:58.368482 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b58772-e8fd-4a1c-bc40-d82300bbba1f admin admin] RBAC: Authorizing `identity:delete_user(user_id=003f9b24d9dc4f36bfbfc6fe91b35422)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:58.371157 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b58772-e8fd-4a1c-bc40-d82300bbba1f admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:58.396040 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1042/2095] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:22:58 2022] POST /identity/v3/users => generated 278 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:22:58.400731 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4ec3b-70f7-41d4-88b6-6e1dd9213b7c admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:58.402771 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-d2c4ec3b-70f7-41d4-88b6-6e1dd9213b7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:58.418515 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c4ec3b-70f7-41d4-88b6-6e1dd9213b7c admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:58.424776 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b3113-b3bc-40f1-8dcc-284cf53f1f09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:58.425321 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b3113-b3bc-40f1-8dcc-284cf53f1f09 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:58.425604 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b3113-b3bc-40f1-8dcc-284cf53f1f09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:58.425875 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b3113-b3bc-40f1-8dcc-284cf53f1f09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:58.426000 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-84b58772-e8fd-4a1c-bc40-d82300bbba1f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '003f9b24d9dc4f36bfbfc6fe91b35422'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:58.426575 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b3113-b3bc-40f1-8dcc-284cf53f1f09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:58.428440 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c77b3113-b3bc-40f1-8dcc-284cf53f1f09 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:58.440771 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-84b58772-e8fd-4a1c-bc40-d82300bbba1f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '003f9b24d9dc4f36bfbfc6fe91b35422'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:58.441412 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-84b58772-e8fd-4a1c-bc40-d82300bbba1f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '003f9b24d9dc4f36bfbfc6fe91b35422'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:58.442029 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-84b58772-e8fd-4a1c-bc40-d82300bbba1f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '003f9b24d9dc4f36bfbfc6fe91b35422'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:58.444745 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1043/2096] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:22:58.445645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b3113-b3bc-40f1-8dcc-284cf53f1f09 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:58.447798 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-c77b3113-b3bc-40f1-8dcc-284cf53f1f09 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:58.452113 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-84b58772-e8fd-4a1c-bc40-d82300bbba1f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '003f9b24d9dc4f36bfbfc6fe91b35422'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:58.462257 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b3113-b3bc-40f1-8dcc-284cf53f1f09 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:58.467192 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8295ddc-e482-4674-ab5b-42daa625b710 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:58.467735 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8295ddc-e482-4674-ab5b-42daa625b710 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:58.468018 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8295ddc-e482-4674-ab5b-42daa625b710 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:58.468292 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8295ddc-e482-4674-ab5b-42daa625b710 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:58.469277 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8295ddc-e482-4674-ab5b-42daa625b710 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:58.470857 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8295ddc-e482-4674-ab5b-42daa625b710 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:58.471198 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1054/2097] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:22:58 2022] DELETE /identity/v3/users/003f9b24d9dc4f36bfbfc6fe91b35422 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:22:58.483877 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1044/2098] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:22:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:22:58.488017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b58772-e8fd-4a1c-bc40-d82300bbba1f admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:58.572583 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b58772-e8fd-4a1c-bc40-d82300bbba1f admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:58.577744 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1c1cc-40e5-4fdc-919a-821bb72a8166 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:58.578424 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1c1cc-40e5-4fdc-919a-821bb72a8166 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:58.578700 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1c1cc-40e5-4fdc-919a-821bb72a8166 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:58.578973 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a1c1cc-40e5-4fdc-919a-821bb72a8166 admin admin] PATH_INFO: `/v3/projects/8c9af01ec7a14177881db5604741d808/users/2d9809a32cbc45609738e44e19546568/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:58.596603 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a1c1cc-40e5-4fdc-919a-821bb72a8166 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8c9af01ec7a14177881db5604741d808, user_id=2d9809a32cbc45609738e44e19546568, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:58.599697 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a1c1cc-40e5-4fdc-919a-821bb72a8166 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:58.615937 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1055/2099] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:22:58 2022] PUT /identity/v3/projects/8c9af01ec7a14177881db5604741d808/users/2d9809a32cbc45609738e44e19546568/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:22:58.627514 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f50a3b-6934-4d58-842c-e91bc12ecb95 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:58.627815 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f50a3b-6934-4d58-842c-e91bc12ecb95 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:58.628064 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f50a3b-6934-4d58-842c-e91bc12ecb95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:58.660440 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-04f50a3b-6934-4d58-842c-e91bc12ecb95 None None] MFA Rules not processed for user `2d9809a32cbc45609738e44e19546568`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:22:58.661903 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-04f50a3b-6934-4d58-842c-e91bc12ecb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:58.762096 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1045/2100] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:22:58 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:22:58.766399 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1c1cc-40e5-4fdc-919a-821bb72a8166 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:58.804180 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f50a3b-6934-4d58-842c-e91bc12ecb95 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:58.807930 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-04f50a3b-6934-4d58-842c-e91bc12ecb95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:58.811717 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:58.865845 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a1c1cc-40e5-4fdc-919a-821bb72a8166 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:58.872114 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f08cba-f0ba-46d2-857a-568924a12832 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:58.872784 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f08cba-f0ba-46d2-857a-568924a12832 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:58.873067 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f08cba-f0ba-46d2-857a-568924a12832 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:58.873341 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f08cba-f0ba-46d2-857a-568924a12832 admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:58.874009 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f08cba-f0ba-46d2-857a-568924a12832 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:58.877126 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f08cba-f0ba-46d2-857a-568924a12832 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:58.903155 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:58.915146 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1056/2101] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:22:58 2022] POST /identity/v3/projects => generated 357 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:22:58.917235 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f08cba-f0ba-46d2-857a-568924a12832 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:58.954453 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f50a3b-6934-4d58-842c-e91bc12ecb95 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:59.032680 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f08cba-f0ba-46d2-857a-568924a12832 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:59.038029 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25288950-ab71-415a-b7b2-d275c49a978f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:59.038752 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25288950-ab71-415a-b7b2-d275c49a978f admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:59.039109 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25288950-ab71-415a-b7b2-d275c49a978f admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:59.039544 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25288950-ab71-415a-b7b2-d275c49a978f admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:59.040308 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25288950-ab71-415a-b7b2-d275c49a978f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:59.045253 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25288950-ab71-415a-b7b2-d275c49a978f admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:59.076893 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1057/2102] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:22:58 2022] POST /identity/v3/users => generated 285 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:22:59.080964 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25288950-ab71-415a-b7b2-d275c49a978f admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:59.093950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25288950-ab71-415a-b7b2-d275c49a978f admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:59.106458 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b3ee1-a5ab-4055-ad1b-05475d0b60eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:59.107109 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b3ee1-a5ab-4055-ad1b-05475d0b60eb admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:59.107667 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b3ee1-a5ab-4055-ad1b-05475d0b60eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:59.107667 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec5b3ee1-a5ab-4055-ad1b-05475d0b60eb admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:59.115602 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b3ee1-a5ab-4055-ad1b-05475d0b60eb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:59.116530 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db76415-7312-4dc1-ba91-21a858f55ba7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:59.117254 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db76415-7312-4dc1-ba91-21a858f55ba7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:59.117551 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec5b3ee1-a5ab-4055-ad1b-05475d0b60eb admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:59.117656 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db76415-7312-4dc1-ba91-21a858f55ba7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:59.117990 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db76415-7312-4dc1-ba91-21a858f55ba7 admin admin] PATH_INFO: `/v3/projects/942768662ca64448928f634070990c64` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:59.119950 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db76415-7312-4dc1-ba91-21a858f55ba7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=942768662ca64448928f634070990c64)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:59.122058 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db76415-7312-4dc1-ba91-21a858f55ba7 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:59.130519 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1058/2103] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:22:59.135206 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b3ee1-a5ab-4055-ad1b-05475d0b60eb admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:59.144959 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec5b3ee1-a5ab-4055-ad1b-05475d0b60eb admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:59.149651 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3550f11-9f9f-4ae0-8971-055e1dff3222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:59.150585 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3550f11-9f9f-4ae0-8971-055e1dff3222 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:59.150870 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3550f11-9f9f-4ae0-8971-055e1dff3222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:59.151141 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3550f11-9f9f-4ae0-8971-055e1dff3222 admin admin] PATH_INFO: `/v3/projects/3527b66090744025b139510393902e35/users/463c5e3bd4d04e368a0dda65fe8ca9a8/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:59.168265 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3550f11-9f9f-4ae0-8971-055e1dff3222 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3527b66090744025b139510393902e35, user_id=463c5e3bd4d04e368a0dda65fe8ca9a8, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:59.170875 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3550f11-9f9f-4ae0-8971-055e1dff3222 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:59.172258 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-7db76415-7312-4dc1-ba91-21a858f55ba7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '942768662ca64448928f634070990c64', 'request_id': 'req-7db76415-7312-4dc1-ba91-21a858f55ba7'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:59.178034 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-7db76415-7312-4dc1-ba91-21a858f55ba7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '942768662ca64448928f634070990c64', 'request_id': 'req-7db76415-7312-4dc1-ba91-21a858f55ba7'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:59.189324 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-7db76415-7312-4dc1-ba91-21a858f55ba7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '942768662ca64448928f634070990c64', 'request_id': 'req-7db76415-7312-4dc1-ba91-21a858f55ba7'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:59.189537 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1059/2104] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:22:59 2022] PUT /identity/v3/projects/3527b66090744025b139510393902e35/users/463c5e3bd4d04e368a0dda65fe8ca9a8/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:22:59.190400 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3550f11-9f9f-4ae0-8971-055e1dff3222 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:59.203622 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-7db76415-7312-4dc1-ba91-21a858f55ba7 admin admin] The token cache is being invalidate because project 942768662ca64448928f634070990c64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:22:59.204468 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-7db76415-7312-4dc1-ba91-21a858f55ba7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:59.205583 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-7db76415-7312-4dc1-ba91-21a858f55ba7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:22:59.207152 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1046/2105] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:22:58 2022] DELETE /identity/v3/projects/942768662ca64448928f634070990c64 => generated 0 bytes in 405 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:22:59.212240 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1706be-c091-47fe-b59c-3c00506e803b None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:59.212596 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1706be-c091-47fe-b59c-3c00506e803b None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:59.212877 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1706be-c091-47fe-b59c-3c00506e803b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:59.236191 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-8d1706be-c091-47fe-b59c-3c00506e803b None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:22:59.237448 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-8d1706be-c091-47fe-b59c-3c00506e803b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:59.261166 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3550f11-9f9f-4ae0-8971-055e1dff3222 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:59.265851 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694421f-7cba-49bd-9797-064ad4ff52bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:59.266470 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694421f-7cba-49bd-9797-064ad4ff52bf admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:59.266747 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694421f-7cba-49bd-9797-064ad4ff52bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:59.267022 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0694421f-7cba-49bd-9797-064ad4ff52bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:59.267870 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0694421f-7cba-49bd-9797-064ad4ff52bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:59.269357 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0694421f-7cba-49bd-9797-064ad4ff52bf admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:59.279229 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1060/2106] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:22:59.283374 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694421f-7cba-49bd-9797-064ad4ff52bf admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:59.285196 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-0694421f-7cba-49bd-9797-064ad4ff52bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:59.298727 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0694421f-7cba-49bd-9797-064ad4ff52bf admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:59.299140 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1047/2107] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:22:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:22:59.303446 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3b1d05-a092-4d8b-91ea-172772e8df10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:59.304185 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b1d05-a092-4d8b-91ea-172772e8df10 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:59.304551 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b1d05-a092-4d8b-91ea-172772e8df10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:59.305198 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3b1d05-a092-4d8b-91ea-172772e8df10 admin admin] PATH_INFO: `/v3/projects/3527b66090744025b139510393902e35/users/463c5e3bd4d04e368a0dda65fe8ca9a8/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:59.307267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0470d-a05a-4233-a27f-723229f810ed None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:59.307616 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0470d-a05a-4233-a27f-723229f810ed None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:59.307883 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b1d05-a092-4d8b-91ea-172772e8df10 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3527b66090744025b139510393902e35, user_id=463c5e3bd4d04e368a0dda65fe8ca9a8, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:59.307981 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da0470d-a05a-4233-a27f-723229f810ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:59.310560 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3b1d05-a092-4d8b-91ea-172772e8df10 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:59.313894 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:59.323134 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1061/2108] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:22:59 2022] PUT /identity/v3/projects/3527b66090744025b139510393902e35/users/463c5e3bd4d04e368a0dda65fe8ca9a8/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:22:59.328128 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-1da0470d-a05a-4233-a27f-723229f810ed None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:22:59.329359 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-1da0470d-a05a-4233-a27f-723229f810ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:59.333065 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b4ef4-f334-4bfc-bcbf-90dd57cf4cf2 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:59.333353 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b4ef4-f334-4bfc-bcbf-90dd57cf4cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:59.333627 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7b4ef4-f334-4bfc-bcbf-90dd57cf4cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:59.348291 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:59.363862 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-db7b4ef4-f334-4bfc-bcbf-90dd57cf4cf2 None None] MFA Rules not processed for user `463c5e3bd4d04e368a0dda65fe8ca9a8`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:22:59.364666 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-db7b4ef4-f334-4bfc-bcbf-90dd57cf4cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:59.394411 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1048/2109] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:22:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:22:59.399304 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0470d-a05a-4233-a27f-723229f810ed None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:59.408271 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da0470d-a05a-4233-a27f-723229f810ed None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:59.413050 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164110a-91ea-4c5b-8bd9-1336e872c753 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:59.413646 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164110a-91ea-4c5b-8bd9-1336e872c753 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:59.413929 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164110a-91ea-4c5b-8bd9-1336e872c753 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:59.414203 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6164110a-91ea-4c5b-8bd9-1336e872c753 admin admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:59.414897 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164110a-91ea-4c5b-8bd9-1336e872c753 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:22:59.415204 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164110a-91ea-4c5b-8bd9-1336e872c753 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:59.417458 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6164110a-91ea-4c5b-8bd9-1336e872c753 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:59.432428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1049/2110] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:22:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:22:59.433771 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164110a-91ea-4c5b-8bd9-1336e872c753 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:59.443072 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1062/2111] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:22:59 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:22:59.443377 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6164110a-91ea-4c5b-8bd9-1336e872c753 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:59.448164 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ee117-1c22-4075-a0a6-728aff9dc76b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:59.448806 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ee117-1c22-4075-a0a6-728aff9dc76b admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:59.449216 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ee117-1c22-4075-a0a6-728aff9dc76b admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:59.449345 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1ee117-1c22-4075-a0a6-728aff9dc76b admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:59.450000 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ee117-1c22-4075-a0a6-728aff9dc76b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:59.451876 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e1ee117-1c22-4075-a0a6-728aff9dc76b admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:59.454853 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b4ef4-f334-4bfc-bcbf-90dd57cf4cf2 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:59.456220 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-db7b4ef4-f334-4bfc-bcbf-90dd57cf4cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:59.483438 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1050/2112] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:22:59 2022] POST /identity/v3/projects => generated 389 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:22:59.485118 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ee117-1c22-4075-a0a6-728aff9dc76b admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:59.514529 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7b4ef4-f334-4bfc-bcbf-90dd57cf4cf2 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:59.546331 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e1ee117-1c22-4075-a0a6-728aff9dc76b admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:59.551001 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753048c-29c6-4f79-adc6-e9fc68ee64c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:59.551624 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753048c-29c6-4f79-adc6-e9fc68ee64c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:59.551902 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753048c-29c6-4f79-adc6-e9fc68ee64c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:59.552178 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b753048c-29c6-4f79-adc6-e9fc68ee64c9 admin admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:59.552874 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b753048c-29c6-4f79-adc6-e9fc68ee64c9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:59.554910 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b753048c-29c6-4f79-adc6-e9fc68ee64c9 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:59.563180 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b722fb-4de0-48c4-857b-531429e8affd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:59.563792 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b722fb-4de0-48c4-857b-531429e8affd service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:59.564065 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b722fb-4de0-48c4-857b-531429e8affd service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:59.564351 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b722fb-4de0-48c4-857b-531429e8affd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:59.581554 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1051/2113] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:22:59 2022] POST /identity/v3/users => generated 295 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:22:59.582533 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753048c-29c6-4f79-adc6-e9fc68ee64c9 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:59.595747 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b753048c-29c6-4f79-adc6-e9fc68ee64c9 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:59.600739 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c562ede-53dc-4855-b101-e918cbf7523c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:59.601482 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c562ede-53dc-4855-b101-e918cbf7523c admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:59.601862 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c562ede-53dc-4855-b101-e918cbf7523c admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:59.602116 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c562ede-53dc-4855-b101-e918cbf7523c admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:59.602849 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c562ede-53dc-4855-b101-e918cbf7523c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:59.605163 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c562ede-53dc-4855-b101-e918cbf7523c admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:59.617153 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1052/2114] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:22:59.620759 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:59.621559 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c562ede-53dc-4855-b101-e918cbf7523c admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:59.633313 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c562ede-53dc-4855-b101-e918cbf7523c admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:59.638536 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb902497-321d-46df-ac48-238a47864fa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:59.639216 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb902497-321d-46df-ac48-238a47864fa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:59.639347 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b722fb-4de0-48c4-857b-531429e8affd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:59.639500 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb902497-321d-46df-ac48-238a47864fa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:59.639783 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb902497-321d-46df-ac48-238a47864fa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:59.640511 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb902497-321d-46df-ac48-238a47864fa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:59.641093 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b722fb-4de0-48c4-857b-531429e8affd service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:59.642131 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb902497-321d-46df-ac48-238a47864fa4 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:59.653016 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1063/2115] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:22:59 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:22:59.655117 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1053/2116] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:22:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:22:59.658995 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b722fb-4de0-48c4-857b-531429e8affd service cinder] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:59.670243 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b722fb-4de0-48c4-857b-531429e8affd service cinder] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:59.676462 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab7295-7561-407a-851f-774dc94c57a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:59.677312 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab7295-7561-407a-851f-774dc94c57a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:59.677607 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab7295-7561-407a-851f-774dc94c57a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:59.677886 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ab7295-7561-407a-851f-774dc94c57a9 admin admin] PATH_INFO: `/v3/projects/10fdc2cb7fed46fabbc910f3b564afc1/users/f32a09343c184f28a6eee348178cd7f7/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:59.697504 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab7295-7561-407a-851f-774dc94c57a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10fdc2cb7fed46fabbc910f3b564afc1, user_id=f32a09343c184f28a6eee348178cd7f7, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:59.700800 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ab7295-7561-407a-851f-774dc94c57a9 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:59.716528 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1064/2117] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:22:59 2022] PUT /identity/v3/projects/10fdc2cb7fed46fabbc910f3b564afc1/users/f32a09343c184f28a6eee348178cd7f7/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:22:59.727244 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e20f7-7f75-458e-917a-94593c7fbf1d None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:59.727534 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e20f7-7f75-458e-917a-94593c7fbf1d None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:59.727813 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5e20f7-7f75-458e-917a-94593c7fbf1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:59.742995 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab7295-7561-407a-851f-774dc94c57a9 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:59.762934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-6f5e20f7-7f75-458e-917a-94593c7fbf1d None None] MFA Rules not processed for user `f32a09343c184f28a6eee348178cd7f7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:22:59.764191 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-6f5e20f7-7f75-458e-917a-94593c7fbf1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:59.801049 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ab7295-7561-407a-851f-774dc94c57a9 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:59.805036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f43ce-5214-4bc0-8bc6-fcbae1976b71 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:59.805661 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f43ce-5214-4bc0-8bc6-fcbae1976b71 service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:59.805945 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f43ce-5214-4bc0-8bc6-fcbae1976b71 service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:59.807007 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0f43ce-5214-4bc0-8bc6-fcbae1976b71 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:59.809016 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-0c0f43ce-5214-4bc0-8bc6-fcbae1976b71 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:22:59.809758 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:22:59.833220 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1054/2118] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:22:59 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:22:59.837698 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e20f7-7f75-458e-917a-94593c7fbf1d None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:59.880912 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0f43ce-5214-4bc0-8bc6-fcbae1976b71 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:59.882418 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0f43ce-5214-4bc0-8bc6-fcbae1976b71 service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:59.893135 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1065/2119] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:22:59 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 150 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:22:59.913973 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5e20f7-7f75-458e-917a-94593c7fbf1d None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:22:59.919476 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14acb1f8-5966-407c-8d20-5a7c89f767f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:22:59.920094 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acb1f8-5966-407c-8d20-5a7c89f767f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:22:59.920405 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acb1f8-5966-407c-8d20-5a7c89f767f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:22:59.920686 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14acb1f8-5966-407c-8d20-5a7c89f767f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:22:59.922287 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14acb1f8-5966-407c-8d20-5a7c89f767f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:22:59.924663 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14acb1f8-5966-407c-8d20-5a7c89f767f3 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:22:59.955180 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1055/2120] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:22:59 2022] POST /identity/v3/projects => generated 389 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:22:59.960214 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f43ce-5214-4bc0-8bc6-fcbae1976b71 service cinder] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:22:59.974384 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0f43ce-5214-4bc0-8bc6-fcbae1976b71 service cinder] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:00.066368 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71837497-7c0e-414e-b37c-4a46bb82e7b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:00.067119 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71837497-7c0e-414e-b37c-4a46bb82e7b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:00.067518 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71837497-7c0e-414e-b37c-4a46bb82e7b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:00.067942 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71837497-7c0e-414e-b37c-4a46bb82e7b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:00.068734 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71837497-7c0e-414e-b37c-4a46bb82e7b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:00.070714 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71837497-7c0e-414e-b37c-4a46bb82e7b2 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:00.100986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5cd92-87be-487d-be6b-4440d447936c None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:00.100986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5cd92-87be-487d-be6b-4440d447936c None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:00.101299 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c5cd92-87be-487d-be6b-4440d447936c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:00.113977 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1066/2121] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:22:59 2022] POST /identity/v3/users => generated 301 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:23:00.118003 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71837497-7c0e-414e-b37c-4a46bb82e7b2 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:00.125583 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-91c5cd92-87be-487d-be6b-4440d447936c None None] MFA Rules not processed for user `47d90567551e4cfb9bcc974e11d4e42c`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:23:00.126790 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-91c5cd92-87be-487d-be6b-4440d447936c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:00.130501 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71837497-7c0e-414e-b37c-4a46bb82e7b2 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:00.136700 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0b32b-19d9-4589-8de4-65d00eff0a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:00.138705 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0b32b-19d9-4589-8de4-65d00eff0a7c admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:00.138923 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0b32b-19d9-4589-8de4-65d00eff0a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:00.139201 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd0b32b-19d9-4589-8de4-65d00eff0a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:00.139908 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0b32b-19d9-4589-8de4-65d00eff0a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:00.142463 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd0b32b-19d9-4589-8de4-65d00eff0a7c admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:00.143937 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:00.159121 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1067/2122] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:23:00.174307 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0b32b-19d9-4589-8de4-65d00eff0a7c admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:00.186614 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd0b32b-19d9-4589-8de4-65d00eff0a7c admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:00.191797 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7244c-e812-4b95-8994-6b62206d9edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:00.192508 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7244c-e812-4b95-8994-6b62206d9edf admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:00.192788 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7244c-e812-4b95-8994-6b62206d9edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:00.193168 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e7244c-e812-4b95-8994-6b62206d9edf admin admin] PATH_INFO: `/v3/projects/14c85c71ac3c40f6a7a636c34827d2c2/users/4adca667a9b54016bccd3e1ffa463860/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:00.196260 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1056/2123] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:23:00 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:23:00.217292 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e7244c-e812-4b95-8994-6b62206d9edf admin admin] RBAC: Authorizing `identity:create_grant(project_id=14c85c71ac3c40f6a7a636c34827d2c2, user_id=4adca667a9b54016bccd3e1ffa463860, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:00.220489 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e7244c-e812-4b95-8994-6b62206d9edf admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:00.234885 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1068/2124] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:23:00 2022] PUT /identity/v3/projects/14c85c71ac3c40f6a7a636c34827d2c2/users/4adca667a9b54016bccd3e1ffa463860/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:23:00.238691 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5cd92-87be-487d-be6b-4440d447936c None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:00.250160 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c5cd92-87be-487d-be6b-4440d447936c None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:00.310175 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3582d2f7-c015-43e5-af3e-a985fd26f23a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:00.310795 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582d2f7-c015-43e5-af3e-a985fd26f23a admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:00.311080 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582d2f7-c015-43e5-af3e-a985fd26f23a admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:00.311359 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3582d2f7-c015-43e5-af3e-a985fd26f23a admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:00.312059 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3582d2f7-c015-43e5-af3e-a985fd26f23a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:00.313714 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3582d2f7-c015-43e5-af3e-a985fd26f23a admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:00.324232 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1057/2125] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:23:00.328889 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7244c-e812-4b95-8994-6b62206d9edf admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:00.339996 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e7244c-e812-4b95-8994-6b62206d9edf admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:00.345123 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06a529-ffb7-4329-aab8-b6b613390bc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:00.345907 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06a529-ffb7-4329-aab8-b6b613390bc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:00.346195 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06a529-ffb7-4329-aab8-b6b613390bc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:00.346473 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c06a529-ffb7-4329-aab8-b6b613390bc5 admin admin] PATH_INFO: `/v3/projects/14c85c71ac3c40f6a7a636c34827d2c2/users/4adca667a9b54016bccd3e1ffa463860/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:00.348513 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c06a529-ffb7-4329-aab8-b6b613390bc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14c85c71ac3c40f6a7a636c34827d2c2, user_id=4adca667a9b54016bccd3e1ffa463860, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:00.351145 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c06a529-ffb7-4329-aab8-b6b613390bc5 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:00.362361 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1069/2126] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:23:00 2022] PUT /identity/v3/projects/14c85c71ac3c40f6a7a636c34827d2c2/users/4adca667a9b54016bccd3e1ffa463860/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:23:00.374875 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af7bd5-3352-460f-a7c9-182616b46631 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:00.375165 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af7bd5-3352-460f-a7c9-182616b46631 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:00.375441 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04af7bd5-3352-460f-a7c9-182616b46631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:00.397703 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:00.410343 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-04af7bd5-3352-460f-a7c9-182616b46631 None None] MFA Rules not processed for user `4adca667a9b54016bccd3e1ffa463860`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:23:00.412101 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-04af7bd5-3352-460f-a7c9-182616b46631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:00.489493 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1058/2127] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:23:00 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:23:00.500381 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06a529-ffb7-4329-aab8-b6b613390bc5 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:00.502186 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-3c06a529-ffb7-4329-aab8-b6b613390bc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:00.561931 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c06a529-ffb7-4329-aab8-b6b613390bc5 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:00.565565 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dce2d8-b0c1-4ee7-8541-46a4adba35ca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:00.566185 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dce2d8-b0c1-4ee7-8541-46a4adba35ca service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:00.566466 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dce2d8-b0c1-4ee7-8541-46a4adba35ca service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:00.566745 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dce2d8-b0c1-4ee7-8541-46a4adba35ca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:00.576396 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dce2d8-b0c1-4ee7-8541-46a4adba35ca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:00.577813 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dce2d8-b0c1-4ee7-8541-46a4adba35ca service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:00.588309 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1070/2128] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:23:00 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:23:00.732616 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af7bd5-3352-460f-a7c9-182616b46631 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:00.818902 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04af7bd5-3352-460f-a7c9-182616b46631 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:00.824100 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34a542-f1d1-4788-b4d0-106b1b4c6aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:00.824788 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34a542-f1d1-4788-b4d0-106b1b4c6aec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:00.825071 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34a542-f1d1-4788-b4d0-106b1b4c6aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:00.825345 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f34a542-f1d1-4788-b4d0-106b1b4c6aec admin admin] PATH_INFO: `/v3/users/f32a09343c184f28a6eee348178cd7f7` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:00.826517 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f34a542-f1d1-4788-b4d0-106b1b4c6aec admin admin] RBAC: Authorizing `identity:delete_user(user_id=f32a09343c184f28a6eee348178cd7f7)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:00.828510 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f34a542-f1d1-4788-b4d0-106b1b4c6aec admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:00.879058 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-5f34a542-f1d1-4788-b4d0-106b1b4c6aec admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f32a09343c184f28a6eee348178cd7f7'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:00.893257 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-5f34a542-f1d1-4788-b4d0-106b1b4c6aec admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f32a09343c184f28a6eee348178cd7f7'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:00.894039 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-5f34a542-f1d1-4788-b4d0-106b1b4c6aec admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f32a09343c184f28a6eee348178cd7f7'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:00.894649 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-5f34a542-f1d1-4788-b4d0-106b1b4c6aec admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f32a09343c184f28a6eee348178cd7f7'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:00.904175 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-5f34a542-f1d1-4788-b4d0-106b1b4c6aec admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f32a09343c184f28a6eee348178cd7f7'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:00.917411 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1059/2129] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:23:00 2022] DELETE /identity/v3/users/f32a09343c184f28a6eee348178cd7f7 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:23:00.922052 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2faf939-09c9-4961-a5c1-59c93c82738b None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:00.922530 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2faf939-09c9-4961-a5c1-59c93c82738b None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:00.922628 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2faf939-09c9-4961-a5c1-59c93c82738b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:00.943143 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-f2faf939-09c9-4961-a5c1-59c93c82738b None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:23:00.944367 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-f2faf939-09c9-4961-a5c1-59c93c82738b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:01.006456 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1071/2130] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:23:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:23:01.016767 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34a542-f1d1-4788-b4d0-106b1b4c6aec admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:01.018612 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-5f34a542-f1d1-4788-b4d0-106b1b4c6aec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:01.039979 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:01.095743 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f34a542-f1d1-4788-b4d0-106b1b4c6aec admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:01.101350 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4ce08-1d04-44ce-8294-2920f57aecaf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:01.102368 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4ce08-1d04-44ce-8294-2920f57aecaf service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:01.102368 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4ce08-1d04-44ce-8294-2920f57aecaf service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:01.102627 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec4ce08-1d04-44ce-8294-2920f57aecaf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:01.114215 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec4ce08-1d04-44ce-8294-2920f57aecaf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:01.115667 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec4ce08-1d04-44ce-8294-2920f57aecaf service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:01.129290 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1060/2131] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:23:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:23:01.505956 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2faf939-09c9-4961-a5c1-59c93c82738b None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:01.507737 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-f2faf939-09c9-4961-a5c1-59c93c82738b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:01.521947 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2faf939-09c9-4961-a5c1-59c93c82738b None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:01.527209 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb321ef1-8ea8-4c92-8af5-c59226187c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:01.528308 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb321ef1-8ea8-4c92-8af5-c59226187c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:01.528308 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb321ef1-8ea8-4c92-8af5-c59226187c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:01.528529 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb321ef1-8ea8-4c92-8af5-c59226187c2d admin admin] PATH_INFO: `/v3/projects/10fdc2cb7fed46fabbc910f3b564afc1` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:01.529610 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb321ef1-8ea8-4c92-8af5-c59226187c2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=10fdc2cb7fed46fabbc910f3b564afc1)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:01.531510 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb321ef1-8ea8-4c92-8af5-c59226187c2d admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:01.583976 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-fb321ef1-8ea8-4c92-8af5-c59226187c2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10fdc2cb7fed46fabbc910f3b564afc1', 'request_id': 'req-fb321ef1-8ea8-4c92-8af5-c59226187c2d'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:01.589928 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:01.591812 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-fb321ef1-8ea8-4c92-8af5-c59226187c2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10fdc2cb7fed46fabbc910f3b564afc1', 'request_id': 'req-fb321ef1-8ea8-4c92-8af5-c59226187c2d'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:01.600393 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-fb321ef1-8ea8-4c92-8af5-c59226187c2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10fdc2cb7fed46fabbc910f3b564afc1', 'request_id': 'req-fb321ef1-8ea8-4c92-8af5-c59226187c2d'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:01.612113 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-fb321ef1-8ea8-4c92-8af5-c59226187c2d admin admin] The token cache is being invalidate because project 10fdc2cb7fed46fabbc910f3b564afc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:23:01.612441 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-fb321ef1-8ea8-4c92-8af5-c59226187c2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:01.613086 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-fb321ef1-8ea8-4c92-8af5-c59226187c2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:01.614611 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1072/2132] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:23:01 2022] DELETE /identity/v3/projects/10fdc2cb7fed46fabbc910f3b564afc1 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:23:01.618830 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4ce08-1d04-44ce-8294-2920f57aecaf service neutron] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:01.628732 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec4ce08-1d04-44ce-8294-2920f57aecaf service neutron] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:01.684401 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c89d9-354e-4822-80db-8e8c59d297ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:01.685024 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c89d9-354e-4822-80db-8e8c59d297ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:01.685305 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c89d9-354e-4822-80db-8e8c59d297ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:01.685577 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9c89d9-354e-4822-80db-8e8c59d297ad admin admin] PATH_INFO: `/v3/users/4adca667a9b54016bccd3e1ffa463860` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:01.686722 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c89d9-354e-4822-80db-8e8c59d297ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=4adca667a9b54016bccd3e1ffa463860)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:01.688684 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9c89d9-354e-4822-80db-8e8c59d297ad admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:01.736085 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-bc9c89d9-354e-4822-80db-8e8c59d297ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4adca667a9b54016bccd3e1ffa463860'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:01.748380 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-bc9c89d9-354e-4822-80db-8e8c59d297ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4adca667a9b54016bccd3e1ffa463860'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:01.749042 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-bc9c89d9-354e-4822-80db-8e8c59d297ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4adca667a9b54016bccd3e1ffa463860'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:01.749717 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-bc9c89d9-354e-4822-80db-8e8c59d297ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4adca667a9b54016bccd3e1ffa463860'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:01.756999 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-bc9c89d9-354e-4822-80db-8e8c59d297ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4adca667a9b54016bccd3e1ffa463860'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:01.769724 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1061/2133] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:23:01 2022] DELETE /identity/v3/users/4adca667a9b54016bccd3e1ffa463860 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:23:02.112603 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb321ef1-8ea8-4c92-8af5-c59226187c2d admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:02.114984 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-fb321ef1-8ea8-4c92-8af5-c59226187c2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:02.132454 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb321ef1-8ea8-4c92-8af5-c59226187c2d admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:02.197893 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d2e95-c0ba-46d0-a633-e386c109b269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:02.198544 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d2e95-c0ba-46d0-a633-e386c109b269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:02.198824 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d2e95-c0ba-46d0-a633-e386c109b269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:02.199098 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3d2e95-c0ba-46d0-a633-e386c109b269 admin admin] PATH_INFO: `/v3/projects/14c85c71ac3c40f6a7a636c34827d2c2` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:02.200286 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3d2e95-c0ba-46d0-a633-e386c109b269 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14c85c71ac3c40f6a7a636c34827d2c2)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:02.202356 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3d2e95-c0ba-46d0-a633-e386c109b269 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:02.255913 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-7e3d2e95-c0ba-46d0-a633-e386c109b269 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14c85c71ac3c40f6a7a636c34827d2c2', 'request_id': 'req-7e3d2e95-c0ba-46d0-a633-e386c109b269'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:02.263145 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-7e3d2e95-c0ba-46d0-a633-e386c109b269 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14c85c71ac3c40f6a7a636c34827d2c2', 'request_id': 'req-7e3d2e95-c0ba-46d0-a633-e386c109b269'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:02.272212 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-7e3d2e95-c0ba-46d0-a633-e386c109b269 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14c85c71ac3c40f6a7a636c34827d2c2', 'request_id': 'req-7e3d2e95-c0ba-46d0-a633-e386c109b269'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:02.284785 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-7e3d2e95-c0ba-46d0-a633-e386c109b269 admin admin] The token cache is being invalidate because project 14c85c71ac3c40f6a7a636c34827d2c2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:23:02.285143 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-7e3d2e95-c0ba-46d0-a633-e386c109b269 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:02.285818 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-7e3d2e95-c0ba-46d0-a633-e386c109b269 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:02.287797 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1073/2134] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:23:02 2022] DELETE /identity/v3/projects/14c85c71ac3c40f6a7a636c34827d2c2 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:23:11.227658 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c89d9-354e-4822-80db-8e8c59d297ad admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:11.229129 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-bc9c89d9-354e-4822-80db-8e8c59d297ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:11.270535 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:11.287482 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9c89d9-354e-4822-80db-8e8c59d297ad admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:11.337058 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29c69cd-8c89-40e4-b4ea-cb66058f647e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:11.337594 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c69cd-8c89-40e4-b4ea-cb66058f647e service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:11.337873 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c69cd-8c89-40e4-b4ea-cb66058f647e service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:11.338862 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29c69cd-8c89-40e4-b4ea-cb66058f647e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:11.340692 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-c29c69cd-8c89-40e4-b4ea-cb66058f647e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:11.404765 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c69cd-8c89-40e4-b4ea-cb66058f647e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:11.406469 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c29c69cd-8c89-40e4-b4ea-cb66058f647e service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:11.417022 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1062/2135] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:23:11 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:23:12.285309 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=56,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:15.303606 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d2e95-c0ba-46d0-a633-e386c109b269 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:15.305068 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-7e3d2e95-c0ba-46d0-a633-e386c109b269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:15.372649 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3d2e95-c0ba-46d0-a633-e386c109b269 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:15.377212 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff44b2f8-48cd-41b5-82d1-e09435fce43f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:15.377848 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44b2f8-48cd-41b5-82d1-e09435fce43f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:15.378124 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44b2f8-48cd-41b5-82d1-e09435fce43f admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:15.378492 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff44b2f8-48cd-41b5-82d1-e09435fce43f admin admin] PATH_INFO: `/v3/users/2d9809a32cbc45609738e44e19546568` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:15.379649 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff44b2f8-48cd-41b5-82d1-e09435fce43f admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d9809a32cbc45609738e44e19546568)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:15.381587 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff44b2f8-48cd-41b5-82d1-e09435fce43f admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:15.429230 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-ff44b2f8-48cd-41b5-82d1-e09435fce43f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d9809a32cbc45609738e44e19546568'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:15.441695 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-ff44b2f8-48cd-41b5-82d1-e09435fce43f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d9809a32cbc45609738e44e19546568'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:15.442458 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-ff44b2f8-48cd-41b5-82d1-e09435fce43f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d9809a32cbc45609738e44e19546568'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:15.443093 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-ff44b2f8-48cd-41b5-82d1-e09435fce43f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d9809a32cbc45609738e44e19546568'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:15.452558 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-ff44b2f8-48cd-41b5-82d1-e09435fce43f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d9809a32cbc45609738e44e19546568'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:15.465883 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1074/2136] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:23:15 2022] DELETE /identity/v3/users/2d9809a32cbc45609738e44e19546568 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:23:15.470529 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a0cca-cb13-42e9-959a-2d2fa90ace3e None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:15.471021 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a0cca-cb13-42e9-959a-2d2fa90ace3e None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:15.471116 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3a0cca-cb13-42e9-959a-2d2fa90ace3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:15.489968 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-4a3a0cca-cb13-42e9-959a-2d2fa90ace3e None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:23:15.491202 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-4a3a0cca-cb13-42e9-959a-2d2fa90ace3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:15.553199 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1063/2137] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:23:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:23:15.563666 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff44b2f8-48cd-41b5-82d1-e09435fce43f admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:15.565866 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-ff44b2f8-48cd-41b5-82d1-e09435fce43f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:15.638949 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff44b2f8-48cd-41b5-82d1-e09435fce43f admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:15.643089 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c0567-1394-4a89-9aa3-448b7fdb8a52 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:15.643839 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c0567-1394-4a89-9aa3-448b7fdb8a52 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:15.644241 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c0567-1394-4a89-9aa3-448b7fdb8a52 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:15.644671 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c0567-1394-4a89-9aa3-448b7fdb8a52 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:15.655828 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c0567-1394-4a89-9aa3-448b7fdb8a52 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:15.657514 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c0567-1394-4a89-9aa3-448b7fdb8a52 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:15.669938 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1075/2138] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:23:15 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:23:16.012862 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a0cca-cb13-42e9-959a-2d2fa90ace3e None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:16.015412 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-4a3a0cca-cb13-42e9-959a-2d2fa90ace3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:16.045575 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3a0cca-cb13-42e9-959a-2d2fa90ace3e None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:16.050815 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe4c83-826a-4298-92da-ef59f82996eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:16.051457 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe4c83-826a-4298-92da-ef59f82996eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:16.051740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe4c83-826a-4298-92da-ef59f82996eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:16.052112 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbe4c83-826a-4298-92da-ef59f82996eb admin admin] PATH_INFO: `/v3/projects/8c9af01ec7a14177881db5604741d808` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:16.053345 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe4c83-826a-4298-92da-ef59f82996eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=8c9af01ec7a14177881db5604741d808)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:16.055240 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbe4c83-826a-4298-92da-ef59f82996eb admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:16.100361 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:16.108987 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-dbbe4c83-826a-4298-92da-ef59f82996eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8c9af01ec7a14177881db5604741d808', 'request_id': 'req-dbbe4c83-826a-4298-92da-ef59f82996eb'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:16.115186 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-dbbe4c83-826a-4298-92da-ef59f82996eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8c9af01ec7a14177881db5604741d808', 'request_id': 'req-dbbe4c83-826a-4298-92da-ef59f82996eb'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:16.123347 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-dbbe4c83-826a-4298-92da-ef59f82996eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8c9af01ec7a14177881db5604741d808', 'request_id': 'req-dbbe4c83-826a-4298-92da-ef59f82996eb'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:16.134589 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-dbbe4c83-826a-4298-92da-ef59f82996eb admin admin] The token cache is being invalidate because project 8c9af01ec7a14177881db5604741d808 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:23:16.135799 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-dbbe4c83-826a-4298-92da-ef59f82996eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:16.136588 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-dbbe4c83-826a-4298-92da-ef59f82996eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:16.138210 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1064/2139] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:23:16 2022] DELETE /identity/v3/projects/8c9af01ec7a14177881db5604741d808 => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:23:16.142303 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c0567-1394-4a89-9aa3-448b7fdb8a52 service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:16.155139 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c0567-1394-4a89-9aa3-448b7fdb8a52 service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:16.187707 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:16.239776 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db4171f-bdf4-47e0-8d1d-779bfc1aa36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:16.240772 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4171f-bdf4-47e0-8d1d-779bfc1aa36e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:16.241270 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4171f-bdf4-47e0-8d1d-779bfc1aa36e admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:16.241725 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db4171f-bdf4-47e0-8d1d-779bfc1aa36e admin admin] PATH_INFO: `/v3/users/463c5e3bd4d04e368a0dda65fe8ca9a8` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:16.243404 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db4171f-bdf4-47e0-8d1d-779bfc1aa36e admin admin] RBAC: Authorizing `identity:delete_user(user_id=463c5e3bd4d04e368a0dda65fe8ca9a8)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:16.245900 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db4171f-bdf4-47e0-8d1d-779bfc1aa36e admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:16.307090 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-5db4171f-bdf4-47e0-8d1d-779bfc1aa36e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '463c5e3bd4d04e368a0dda65fe8ca9a8'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:16.319847 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-5db4171f-bdf4-47e0-8d1d-779bfc1aa36e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '463c5e3bd4d04e368a0dda65fe8ca9a8'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:16.320592 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-5db4171f-bdf4-47e0-8d1d-779bfc1aa36e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '463c5e3bd4d04e368a0dda65fe8ca9a8'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:16.321202 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-5db4171f-bdf4-47e0-8d1d-779bfc1aa36e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '463c5e3bd4d04e368a0dda65fe8ca9a8'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:16.331803 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-5db4171f-bdf4-47e0-8d1d-779bfc1aa36e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '463c5e3bd4d04e368a0dda65fe8ca9a8'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:16.348039 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1076/2140] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:23:16 2022] DELETE /identity/v3/users/463c5e3bd4d04e368a0dda65fe8ca9a8 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:23:16.632438 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe4c83-826a-4298-92da-ef59f82996eb admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:16.633940 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-dbbe4c83-826a-4298-92da-ef59f82996eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:16.647674 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbe4c83-826a-4298-92da-ef59f82996eb admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:16.705480 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9503fd92-f68c-4d9f-a051-9f9c125f1559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:16.706122 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503fd92-f68c-4d9f-a051-9f9c125f1559 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:16.706406 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503fd92-f68c-4d9f-a051-9f9c125f1559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:16.706683 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9503fd92-f68c-4d9f-a051-9f9c125f1559 admin admin] PATH_INFO: `/v3/projects/3527b66090744025b139510393902e35` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:16.707849 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9503fd92-f68c-4d9f-a051-9f9c125f1559 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3527b66090744025b139510393902e35)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:16.709783 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9503fd92-f68c-4d9f-a051-9f9c125f1559 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:16.757170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-9503fd92-f68c-4d9f-a051-9f9c125f1559 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3527b66090744025b139510393902e35', 'request_id': 'req-9503fd92-f68c-4d9f-a051-9f9c125f1559'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:16.762783 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-9503fd92-f68c-4d9f-a051-9f9c125f1559 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3527b66090744025b139510393902e35', 'request_id': 'req-9503fd92-f68c-4d9f-a051-9f9c125f1559'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:16.769625 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-9503fd92-f68c-4d9f-a051-9f9c125f1559 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3527b66090744025b139510393902e35', 'request_id': 'req-9503fd92-f68c-4d9f-a051-9f9c125f1559'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:16.781103 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-9503fd92-f68c-4d9f-a051-9f9c125f1559 admin admin] The token cache is being invalidate because project 3527b66090744025b139510393902e35 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:23:16.781378 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-9503fd92-f68c-4d9f-a051-9f9c125f1559 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:16.782017 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-9503fd92-f68c-4d9f-a051-9f9c125f1559 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:16.783525 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1065/2141] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:23:16 2022] DELETE /identity/v3/projects/3527b66090744025b139510393902e35 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:23:16.788424 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f85cb-f8ff-459a-87de-b17633c110a2 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:16.788717 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f85cb-f8ff-459a-87de-b17633c110a2 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:16.789014 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7f85cb-f8ff-459a-87de-b17633c110a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:16.810617 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-ec7f85cb-f8ff-459a-87de-b17633c110a2 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:23:16.811858 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-ec7f85cb-f8ff-459a-87de-b17633c110a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:16.874492 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1077/2142] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:23:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:23:16.882254 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9695b-7208-4c8d-972b-aab43c559be2 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:16.882617 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9695b-7208-4c8d-972b-aab43c559be2 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:16.882992 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9695b-7208-4c8d-972b-aab43c559be2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:16.904636 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-d5c9695b-7208-4c8d-972b-aab43c559be2 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:23:16.905952 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-d5c9695b-7208-4c8d-972b-aab43c559be2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:16.925566 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1066/2143] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:23:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:23:16.929809 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f85cb-f8ff-459a-87de-b17633c110a2 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:16.941865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7f85cb-f8ff-459a-87de-b17633c110a2 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:16.960172 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e83a7-73ee-4e55-a0a7-137a4047abd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:16.960172 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e83a7-73ee-4e55-a0a7-137a4047abd3 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:16.960172 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e83a7-73ee-4e55-a0a7-137a4047abd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:16.960172 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97e83a7-73ee-4e55-a0a7-137a4047abd3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:16.960616 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e83a7-73ee-4e55-a0a7-137a4047abd3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:23:16.960616 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e83a7-73ee-4e55-a0a7-137a4047abd3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:16.960616 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97e83a7-73ee-4e55-a0a7-137a4047abd3 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:16.967518 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1078/2144] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:23:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:23:16.972201 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9695b-7208-4c8d-972b-aab43c559be2 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:16.981839 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9695b-7208-4c8d-972b-aab43c559be2 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:16.986798 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2d318-806b-4644-81e1-e834804288a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:16.987408 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2d318-806b-4644-81e1-e834804288a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:16.987685 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2d318-806b-4644-81e1-e834804288a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:16.987953 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ac2d318-806b-4644-81e1-e834804288a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:16.988649 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac2d318-806b-4644-81e1-e834804288a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:16.990537 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ac2d318-806b-4644-81e1-e834804288a4 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:17.019687 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1067/2145] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:23:16 2022] POST /identity/v3/projects => generated 365 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:23:17.026324 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e83a7-73ee-4e55-a0a7-137a4047abd3 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:17.036384 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97e83a7-73ee-4e55-a0a7-137a4047abd3 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:17.065012 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:17.101777 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c47027-7da9-4983-adcd-e4151270d356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:17.102401 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c47027-7da9-4983-adcd-e4151270d356 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:17.102680 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c47027-7da9-4983-adcd-e4151270d356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:17.102955 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c47027-7da9-4983-adcd-e4151270d356 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:17.104768 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c47027-7da9-4983-adcd-e4151270d356 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:17.106697 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c47027-7da9-4983-adcd-e4151270d356 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:17.136494 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1079/2146] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:23:17 2022] POST /identity/v3/users => generated 283 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:23:17.137743 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2d318-806b-4644-81e1-e834804288a4 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:17.148006 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ac2d318-806b-4644-81e1-e834804288a4 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:17.153319 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989af1b-1865-4ed7-bf45-0af94854df91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:17.153929 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989af1b-1865-4ed7-bf45-0af94854df91 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:17.154211 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989af1b-1865-4ed7-bf45-0af94854df91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:17.154485 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5989af1b-1865-4ed7-bf45-0af94854df91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:17.155191 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5989af1b-1865-4ed7-bf45-0af94854df91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:17.156832 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5989af1b-1865-4ed7-bf45-0af94854df91 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:17.168543 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1068/2147] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:23:17.172150 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c47027-7da9-4983-adcd-e4151270d356 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:17.183934 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c47027-7da9-4983-adcd-e4151270d356 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:17.188746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f4fbf2-36fb-4f6c-b5ca-5ec3690e245d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:17.189466 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4fbf2-36fb-4f6c-b5ca-5ec3690e245d admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:17.189809 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4fbf2-36fb-4f6c-b5ca-5ec3690e245d admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:17.190182 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f4fbf2-36fb-4f6c-b5ca-5ec3690e245d admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:17.190946 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4fbf2-36fb-4f6c-b5ca-5ec3690e245d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:17.192616 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8f4fbf2-36fb-4f6c-b5ca-5ec3690e245d admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:17.204388 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1080/2148] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:23:17.208602 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989af1b-1865-4ed7-bf45-0af94854df91 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:17.219428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5989af1b-1865-4ed7-bf45-0af94854df91 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:17.224032 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed77cbb-3965-4a22-86d6-228db3dbe7cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:17.224804 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed77cbb-3965-4a22-86d6-228db3dbe7cd admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:17.225082 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed77cbb-3965-4a22-86d6-228db3dbe7cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:17.225359 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed77cbb-3965-4a22-86d6-228db3dbe7cd admin admin] PATH_INFO: `/v3/projects/e4823984c3f54419ba691f207fb34fcb/users/aa2be07f0b3a411b9c93d784e7d67242/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:17.241098 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed77cbb-3965-4a22-86d6-228db3dbe7cd admin admin] RBAC: Authorizing `identity:create_grant(project_id=e4823984c3f54419ba691f207fb34fcb, user_id=aa2be07f0b3a411b9c93d784e7d67242, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:17.245416 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed77cbb-3965-4a22-86d6-228db3dbe7cd admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:17.247666 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=86,keystone:DELETE=11,keystone:INSERT=3 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:17.260816 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1069/2149] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:23:17 2022] PUT /identity/v3/projects/e4823984c3f54419ba691f207fb34fcb/users/aa2be07f0b3a411b9c93d784e7d67242/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:23:17.270680 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe9d39-9723-4375-ad28-f8d8ad55dfe3 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:17.270906 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe9d39-9723-4375-ad28-f8d8ad55dfe3 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:17.271184 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fe9d39-9723-4375-ad28-f8d8ad55dfe3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:17.301120 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-14fe9d39-9723-4375-ad28-f8d8ad55dfe3 None None] MFA Rules not processed for user `aa2be07f0b3a411b9c93d784e7d67242`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:23:17.302353 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-14fe9d39-9723-4375-ad28-f8d8ad55dfe3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:17.373611 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1081/2150] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:23:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:23:17.378258 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed77cbb-3965-4a22-86d6-228db3dbe7cd admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:17.442494 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed77cbb-3965-4a22-86d6-228db3dbe7cd admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:17.448234 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835da74-3fd1-4ea5-8887-077f07af0c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:17.448914 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835da74-3fd1-4ea5-8887-077f07af0c34 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:17.449192 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835da74-3fd1-4ea5-8887-077f07af0c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:17.449472 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5835da74-3fd1-4ea5-8887-077f07af0c34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:17.450152 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5835da74-3fd1-4ea5-8887-077f07af0c34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:17.452056 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5835da74-3fd1-4ea5-8887-077f07af0c34 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:17.485224 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1070/2151] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:23:17 2022] POST /identity/v3/projects => generated 363 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:23:17.489090 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe9d39-9723-4375-ad28-f8d8ad55dfe3 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:17.505162 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fe9d39-9723-4375-ad28-f8d8ad55dfe3 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:17.576169 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6dd22b-7591-4f5d-b19a-643b8cf3d042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:17.576843 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6dd22b-7591-4f5d-b19a-643b8cf3d042 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:17.577124 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6dd22b-7591-4f5d-b19a-643b8cf3d042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:17.577399 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6dd22b-7591-4f5d-b19a-643b8cf3d042 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:17.578134 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6dd22b-7591-4f5d-b19a-643b8cf3d042 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:17.579946 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6dd22b-7591-4f5d-b19a-643b8cf3d042 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:17.608756 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1082/2152] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:23:17 2022] POST /identity/v3/users => generated 288 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:23:17.612733 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835da74-3fd1-4ea5-8887-077f07af0c34 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:17.624254 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5835da74-3fd1-4ea5-8887-077f07af0c34 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:17.638946 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9acd72c-3d87-4458-b0a7-7c42acc047ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:17.639626 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9acd72c-3d87-4458-b0a7-7c42acc047ae admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:17.640011 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9acd72c-3d87-4458-b0a7-7c42acc047ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:17.640288 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9acd72c-3d87-4458-b0a7-7c42acc047ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:17.641019 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9acd72c-3d87-4458-b0a7-7c42acc047ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:17.642641 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9acd72c-3d87-4458-b0a7-7c42acc047ae admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:17.654444 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1071/2153] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:23:17.658727 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6dd22b-7591-4f5d-b19a-643b8cf3d042 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:17.669540 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6dd22b-7591-4f5d-b19a-643b8cf3d042 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:17.674049 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2227d70-5069-4fa7-9021-cbf91316ef16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:17.674693 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2227d70-5069-4fa7-9021-cbf91316ef16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:17.674974 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2227d70-5069-4fa7-9021-cbf91316ef16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:17.675247 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2227d70-5069-4fa7-9021-cbf91316ef16 admin admin] PATH_INFO: `/v3/projects/f34e385f0aeb4746aad56e46830ae3fa/users/1a2fad4553294928aceae0d5327e8ce6/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:17.689833 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2227d70-5069-4fa7-9021-cbf91316ef16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f34e385f0aeb4746aad56e46830ae3fa, user_id=1a2fad4553294928aceae0d5327e8ce6, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:17.692488 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2227d70-5069-4fa7-9021-cbf91316ef16 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:17.706105 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1083/2154] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:23:17 2022] PUT /identity/v3/projects/f34e385f0aeb4746aad56e46830ae3fa/users/1a2fad4553294928aceae0d5327e8ce6/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:23:17.709985 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9acd72c-3d87-4458-b0a7-7c42acc047ae admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:17.720676 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9acd72c-3d87-4458-b0a7-7c42acc047ae admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:17.774833 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f1957d-b2be-4a69-a235-a617b90e2612 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:17.775852 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1957d-b2be-4a69-a235-a617b90e2612 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:17.776127 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1957d-b2be-4a69-a235-a617b90e2612 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:17.776431 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f1957d-b2be-4a69-a235-a617b90e2612 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:17.777126 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f1957d-b2be-4a69-a235-a617b90e2612 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:17.778705 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f1957d-b2be-4a69-a235-a617b90e2612 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:17.788494 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1072/2155] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:23:17.793069 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2227d70-5069-4fa7-9021-cbf91316ef16 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:17.798514 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:17.804581 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2227d70-5069-4fa7-9021-cbf91316ef16 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:17.810264 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38ef2c-32d9-4d10-a45b-facbe0c3218e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:17.810969 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38ef2c-32d9-4d10-a45b-facbe0c3218e admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:17.811254 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38ef2c-32d9-4d10-a45b-facbe0c3218e admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:17.811527 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c38ef2c-32d9-4d10-a45b-facbe0c3218e admin admin] PATH_INFO: `/v3/projects/f34e385f0aeb4746aad56e46830ae3fa/users/1a2fad4553294928aceae0d5327e8ce6/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:17.813528 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c38ef2c-32d9-4d10-a45b-facbe0c3218e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f34e385f0aeb4746aad56e46830ae3fa, user_id=1a2fad4553294928aceae0d5327e8ce6, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:17.816149 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c38ef2c-32d9-4d10-a45b-facbe0c3218e admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:17.826645 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1084/2156] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:23:17 2022] PUT /identity/v3/projects/f34e385f0aeb4746aad56e46830ae3fa/users/1a2fad4553294928aceae0d5327e8ce6/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:23:17.837285 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f5235-16a3-4524-9f6f-09fa1f5ebbbb None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:17.837582 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f5235-16a3-4524-9f6f-09fa1f5ebbbb None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:17.838357 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-064f5235-16a3-4524-9f6f-09fa1f5ebbbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:17.866765 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-064f5235-16a3-4524-9f6f-09fa1f5ebbbb None None] MFA Rules not processed for user `1a2fad4553294928aceae0d5327e8ce6`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:23:17.867959 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-064f5235-16a3-4524-9f6f-09fa1f5ebbbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:17.916681 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:17.936733 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1073/2157] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:23:17 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:23:17.948951 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38ef2c-32d9-4d10-a45b-facbe0c3218e admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:17.950685 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9c38ef2c-32d9-4d10-a45b-facbe0c3218e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:18.010414 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c38ef2c-32d9-4d10-a45b-facbe0c3218e admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:18.014330 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08775e3-fe8c-4a23-8c25-8129f9aeb84c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:18.014958 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08775e3-fe8c-4a23-8c25-8129f9aeb84c service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:18.015261 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08775e3-fe8c-4a23-8c25-8129f9aeb84c service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:18.015538 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08775e3-fe8c-4a23-8c25-8129f9aeb84c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:18.024958 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08775e3-fe8c-4a23-8c25-8129f9aeb84c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:18.026872 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08775e3-fe8c-4a23-8c25-8129f9aeb84c service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:18.037163 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1085/2158] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:23:17 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:23:18.115071 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f5235-16a3-4524-9f6f-09fa1f5ebbbb None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:18.124891 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-064f5235-16a3-4524-9f6f-09fa1f5ebbbb None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:18.128615 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116cbe70-920b-400d-9808-1236d487596b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:18.129230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116cbe70-920b-400d-9808-1236d487596b service cinder] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:18.129508 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116cbe70-920b-400d-9808-1236d487596b service cinder] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:18.129779 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116cbe70-920b-400d-9808-1236d487596b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:18.188009 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116cbe70-920b-400d-9808-1236d487596b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:18.189484 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-116cbe70-920b-400d-9808-1236d487596b service cinder] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:18.199223 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1074/2159] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:23:18 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:23:28.032436 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=30,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:28.194268 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=33 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:28.442012 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5d706-d77c-45d0-bd7f-a28cbb41525e None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:28.442299 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5d706-d77c-45d0-bd7f-a28cbb41525e None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:28.442572 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c5d706-d77c-45d0-bd7f-a28cbb41525e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:28.461765 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-68c5d706-d77c-45d0-bd7f-a28cbb41525e None None] MFA Rules not processed for user `5bf84408a3984972a5bb68a3117c0501`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:23:28.462979 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-68c5d706-d77c-45d0-bd7f-a28cbb41525e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:28.517017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1086/2160] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:23:28 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:23:30.992859 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116cbe70-920b-400d-9808-1236d487596b service cinder] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:30.994896 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-116cbe70-920b-400d-9808-1236d487596b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:31.074259 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116cbe70-920b-400d-9808-1236d487596b service cinder] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:31.079261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a43da-4eb2-4433-8dd2-a2fa38c521b9 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e84ea976b5914aea94c4d8f805139daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:31.079887 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a43da-4eb2-4433-8dd2-a2fa38c521b9 service placement] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:31.080170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a43da-4eb2-4433-8dd2-a2fa38c521b9 service placement] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:31.093067 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a43da-4eb2-4433-8dd2-a2fa38c521b9 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:31.093067 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-0c6a43da-4eb2-4433-8dd2-a2fa38c521b9 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:31.093646 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5d706-d77c-45d0-bd7f-a28cbb41525e None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:31.093646 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-68c5d706-d77c-45d0-bd7f-a28cbb41525e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:31.094637 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a43da-4eb2-4433-8dd2-a2fa38c521b9 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:31.096247 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a43da-4eb2-4433-8dd2-a2fa38c521b9 service placement] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:31.102364 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c5d706-d77c-45d0-bd7f-a28cbb41525e None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:31.106662 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1075/2161] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:23:30 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:23:31.108500 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496d1b4-404a-4c8f-8fd1-f80672b82020 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e84ea976b5914aea94c4d8f805139daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:31.109153 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496d1b4-404a-4c8f-8fd1-f80672b82020 service placement] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:31.109439 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496d1b4-404a-4c8f-8fd1-f80672b82020 service placement] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:31.109717 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9496d1b4-404a-4c8f-8fd1-f80672b82020 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:31.121403 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9496d1b4-404a-4c8f-8fd1-f80672b82020 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:31.123064 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9496d1b4-404a-4c8f-8fd1-f80672b82020 service placement] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:31.137134 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1087/2162] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:23:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:23:32.996445 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b062e-3f0b-4051-a9b6-9361853e2c9a None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:32.996938 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b062e-3f0b-4051-a9b6-9361853e2c9a None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:32.997190 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-184b062e-3f0b-4051-a9b6-9361853e2c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:33.017594 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-184b062e-3f0b-4051-a9b6-9361853e2c9a None None] MFA Rules not processed for user `36970f0778384576b599cd7217b5084d`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:23:33.018793 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-184b062e-3f0b-4051-a9b6-9361853e2c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:33.078721 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1076/2163] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Aug 5 02:23:32 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:23:33.125844 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496d1b4-404a-4c8f-8fd1-f80672b82020 service placement] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:33.127260 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9496d1b4-404a-4c8f-8fd1-f80672b82020 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:33.202452 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9496d1b4-404a-4c8f-8fd1-f80672b82020 service placement] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:33.210008 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5a0938-f130-4818-9429-506ecf3d5585 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f03233b0ee3540cdb5105f6603cfdff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:33.210652 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a0938-f130-4818-9429-506ecf3d5585 service swift] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:33.210929 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a0938-f130-4818-9429-506ecf3d5585 service swift] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:33.211205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5a0938-f130-4818-9429-506ecf3d5585 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:33.220695 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a0938-f130-4818-9429-506ecf3d5585 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:33.222528 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5a0938-f130-4818-9429-506ecf3d5585 service swift] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:33.231493 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1088/2164] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Aug 5 02:23:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 02:23:36.426546 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b062e-3f0b-4051-a9b6-9361853e2c9a None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:36.507292 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-184b062e-3f0b-4051-a9b6-9361853e2c9a None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:36.514727 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf847228-13e8-475d-8aaf-13b0e4ba91ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:36.515524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf847228-13e8-475d-8aaf-13b0e4ba91ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:36.515810 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf847228-13e8-475d-8aaf-13b0e4ba91ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:36.516144 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf847228-13e8-475d-8aaf-13b0e4ba91ac admin admin] PATH_INFO: `/v3/users/aa2be07f0b3a411b9c93d784e7d67242` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:36.517687 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf847228-13e8-475d-8aaf-13b0e4ba91ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=aa2be07f0b3a411b9c93d784e7d67242)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:36.520706 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf847228-13e8-475d-8aaf-13b0e4ba91ac admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:36.578083 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:36.598525 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-cf847228-13e8-475d-8aaf-13b0e4ba91ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aa2be07f0b3a411b9c93d784e7d67242'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:36.623979 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-cf847228-13e8-475d-8aaf-13b0e4ba91ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aa2be07f0b3a411b9c93d784e7d67242'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:36.625029 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-cf847228-13e8-475d-8aaf-13b0e4ba91ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aa2be07f0b3a411b9c93d784e7d67242'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:36.625720 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-cf847228-13e8-475d-8aaf-13b0e4ba91ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aa2be07f0b3a411b9c93d784e7d67242'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:36.637694 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-cf847228-13e8-475d-8aaf-13b0e4ba91ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aa2be07f0b3a411b9c93d784e7d67242'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:36.654308 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1077/2165] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:23:36 2022] DELETE /identity/v3/users/aa2be07f0b3a411b9c93d784e7d67242 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:23:36.659383 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1170849-d16e-48ae-8f41-340ba6c99785 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:36.660351 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1170849-d16e-48ae-8f41-340ba6c99785 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:36.660638 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1170849-d16e-48ae-8f41-340ba6c99785 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:36.682161 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-e1170849-d16e-48ae-8f41-340ba6c99785 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:23:36.683431 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-e1170849-d16e-48ae-8f41-340ba6c99785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:36.786251 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1089/2166] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:23:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:23:36.792961 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf847228-13e8-475d-8aaf-13b0e4ba91ac admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:36.794588 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-cf847228-13e8-475d-8aaf-13b0e4ba91ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:36.856428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf847228-13e8-475d-8aaf-13b0e4ba91ac admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:36.862147 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e22d5b7-ae07-405b-b0d8-9881e0e4c117 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:36.863038 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22d5b7-ae07-405b-b0d8-9881e0e4c117 service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:36.863415 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22d5b7-ae07-405b-b0d8-9881e0e4c117 service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:36.863762 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e22d5b7-ae07-405b-b0d8-9881e0e4c117 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:36.876698 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e22d5b7-ae07-405b-b0d8-9881e0e4c117 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:36.878144 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e22d5b7-ae07-405b-b0d8-9881e0e4c117 service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:36.891780 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1078/2167] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:23:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:23:37.181547 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1170849-d16e-48ae-8f41-340ba6c99785 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:37.183589 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-e1170849-d16e-48ae-8f41-340ba6c99785 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:37.211763 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1170849-d16e-48ae-8f41-340ba6c99785 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:37.217394 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e5dfc-34d5-4438-b8aa-8c5be261bfdd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:37.218131 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e5dfc-34d5-4438-b8aa-8c5be261bfdd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:37.227133 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e5dfc-34d5-4438-b8aa-8c5be261bfdd admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:37.227430 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74e5dfc-34d5-4438-b8aa-8c5be261bfdd admin admin] PATH_INFO: `/v3/projects/e4823984c3f54419ba691f207fb34fcb` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:37.229057 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e5dfc-34d5-4438-b8aa-8c5be261bfdd admin admin] RBAC: Authorizing `identity:delete_project(project_id=e4823984c3f54419ba691f207fb34fcb)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:37.231641 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74e5dfc-34d5-4438-b8aa-8c5be261bfdd admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:37.257489 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:37.306573 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-a74e5dfc-34d5-4438-b8aa-8c5be261bfdd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e4823984c3f54419ba691f207fb34fcb', 'request_id': 'req-a74e5dfc-34d5-4438-b8aa-8c5be261bfdd'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:37.315804 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-a74e5dfc-34d5-4438-b8aa-8c5be261bfdd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e4823984c3f54419ba691f207fb34fcb', 'request_id': 'req-a74e5dfc-34d5-4438-b8aa-8c5be261bfdd'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:37.335198 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-a74e5dfc-34d5-4438-b8aa-8c5be261bfdd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e4823984c3f54419ba691f207fb34fcb', 'request_id': 'req-a74e5dfc-34d5-4438-b8aa-8c5be261bfdd'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:37.354644 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-a74e5dfc-34d5-4438-b8aa-8c5be261bfdd admin admin] The token cache is being invalidate because project e4823984c3f54419ba691f207fb34fcb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:23:37.355040 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-a74e5dfc-34d5-4438-b8aa-8c5be261bfdd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:37.355802 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-a74e5dfc-34d5-4438-b8aa-8c5be261bfdd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:37.360522 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1090/2168] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:23:37 2022] DELETE /identity/v3/projects/e4823984c3f54419ba691f207fb34fcb => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:23:37.361745 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e22d5b7-ae07-405b-b0d8-9881e0e4c117 service neutron] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:37.373057 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e22d5b7-ae07-405b-b0d8-9881e0e4c117 service neutron] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:37.459933 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57ce550d-1bb3-4cb8-bd66-ae0884884cd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:37.461336 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce550d-1bb3-4cb8-bd66-ae0884884cd1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:37.461336 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce550d-1bb3-4cb8-bd66-ae0884884cd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:37.461336 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57ce550d-1bb3-4cb8-bd66-ae0884884cd1 admin admin] PATH_INFO: `/v3/users/1a2fad4553294928aceae0d5327e8ce6` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:37.462768 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce550d-1bb3-4cb8-bd66-ae0884884cd1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1a2fad4553294928aceae0d5327e8ce6)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:37.465177 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57ce550d-1bb3-4cb8-bd66-ae0884884cd1 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:37.518157 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-57ce550d-1bb3-4cb8-bd66-ae0884884cd1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1a2fad4553294928aceae0d5327e8ce6'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:37.526946 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:37.533013 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-57ce550d-1bb3-4cb8-bd66-ae0884884cd1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1a2fad4553294928aceae0d5327e8ce6'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:37.534078 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-57ce550d-1bb3-4cb8-bd66-ae0884884cd1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1a2fad4553294928aceae0d5327e8ce6'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:37.535237 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-57ce550d-1bb3-4cb8-bd66-ae0884884cd1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1a2fad4553294928aceae0d5327e8ce6'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:37.545142 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-57ce550d-1bb3-4cb8-bd66-ae0884884cd1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1a2fad4553294928aceae0d5327e8ce6'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:37.563206 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1079/2169] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:23:37 2022] DELETE /identity/v3/users/1a2fad4553294928aceae0d5327e8ce6 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:23:37.869332 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e5dfc-34d5-4438-b8aa-8c5be261bfdd admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:37.874019 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-a74e5dfc-34d5-4438-b8aa-8c5be261bfdd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:37.900152 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74e5dfc-34d5-4438-b8aa-8c5be261bfdd admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:37.997437 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c700b94f-eade-45b5-92de-27e751f4ab54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:37.998090 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700b94f-eade-45b5-92de-27e751f4ab54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:37.998370 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700b94f-eade-45b5-92de-27e751f4ab54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:37.998648 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c700b94f-eade-45b5-92de-27e751f4ab54 admin admin] PATH_INFO: `/v3/projects/f34e385f0aeb4746aad56e46830ae3fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:37.999805 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700b94f-eade-45b5-92de-27e751f4ab54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f34e385f0aeb4746aad56e46830ae3fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:38.001818 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c700b94f-eade-45b5-92de-27e751f4ab54 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:38.071267 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c700b94f-eade-45b5-92de-27e751f4ab54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f34e385f0aeb4746aad56e46830ae3fa', 'request_id': 'req-c700b94f-eade-45b5-92de-27e751f4ab54'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:38.092067 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c700b94f-eade-45b5-92de-27e751f4ab54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f34e385f0aeb4746aad56e46830ae3fa', 'request_id': 'req-c700b94f-eade-45b5-92de-27e751f4ab54'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:38.111962 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c700b94f-eade-45b5-92de-27e751f4ab54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f34e385f0aeb4746aad56e46830ae3fa', 'request_id': 'req-c700b94f-eade-45b5-92de-27e751f4ab54'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:38.127733 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c700b94f-eade-45b5-92de-27e751f4ab54 admin admin] The token cache is being invalidate because project f34e385f0aeb4746aad56e46830ae3fa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:23:38.128197 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c700b94f-eade-45b5-92de-27e751f4ab54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:38.129045 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c700b94f-eade-45b5-92de-27e751f4ab54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:38.131140 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1091/2170] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:23:37 2022] DELETE /identity/v3/projects/f34e385f0aeb4746aad56e46830ae3fa => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:23:38.136865 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68278cc8-7575-405f-b2b9-8af30ee3fe05 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:38.137168 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68278cc8-7575-405f-b2b9-8af30ee3fe05 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:38.137577 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68278cc8-7575-405f-b2b9-8af30ee3fe05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:38.171899 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-68278cc8-7575-405f-b2b9-8af30ee3fe05 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:23:38.173678 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-68278cc8-7575-405f-b2b9-8af30ee3fe05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:38.247135 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1080/2171] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:23:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:23:38.256568 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb3876-a54d-47ac-9c91-574a96273e96 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:38.256914 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb3876-a54d-47ac-9c91-574a96273e96 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:38.257266 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dbb3876-a54d-47ac-9c91-574a96273e96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:38.280244 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-4dbb3876-a54d-47ac-9c91-574a96273e96 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:23:38.281757 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-4dbb3876-a54d-47ac-9c91-574a96273e96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:38.289919 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1092/2172] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:23:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:23:38.295364 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68278cc8-7575-405f-b2b9-8af30ee3fe05 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:38.308672 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68278cc8-7575-405f-b2b9-8af30ee3fe05 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:38.313578 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befef9de-a65d-4625-8a53-5ec7649f971c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:38.315372 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befef9de-a65d-4625-8a53-5ec7649f971c admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:38.315372 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befef9de-a65d-4625-8a53-5ec7649f971c admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:38.315372 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-befef9de-a65d-4625-8a53-5ec7649f971c admin admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:38.315694 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befef9de-a65d-4625-8a53-5ec7649f971c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:23:38.315798 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befef9de-a65d-4625-8a53-5ec7649f971c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:38.317493 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-befef9de-a65d-4625-8a53-5ec7649f971c admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:38.335363 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1081/2173] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:23:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:23:38.336862 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb3876-a54d-47ac-9c91-574a96273e96 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:38.348616 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dbb3876-a54d-47ac-9c91-574a96273e96 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:38.353717 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582fa92-72f6-4473-8dd6-9310848ad135 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:38.355056 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582fa92-72f6-4473-8dd6-9310848ad135 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:38.355752 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582fa92-72f6-4473-8dd6-9310848ad135 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:38.355752 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9582fa92-72f6-4473-8dd6-9310848ad135 admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:38.356449 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9582fa92-72f6-4473-8dd6-9310848ad135 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:38.358352 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9582fa92-72f6-4473-8dd6-9310848ad135 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:38.399278 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1093/2174] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:23:38 2022] POST /identity/v3/projects => generated 409 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:23:38.400268 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befef9de-a65d-4625-8a53-5ec7649f971c admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:38.411798 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-befef9de-a65d-4625-8a53-5ec7649f971c admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:38.498588 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ecb84-d956-4da1-a43f-7f7ecda3feb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:38.499274 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ecb84-d956-4da1-a43f-7f7ecda3feb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:38.499584 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ecb84-d956-4da1-a43f-7f7ecda3feb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:38.499760 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41ecb84-d956-4da1-a43f-7f7ecda3feb7 admin admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:38.500704 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ecb84-d956-4da1-a43f-7f7ecda3feb7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:38.502762 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41ecb84-d956-4da1-a43f-7f7ecda3feb7 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:38.529644 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1082/2175] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:23:38 2022] POST /identity/v3/users => generated 305 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:23:38.533272 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582fa92-72f6-4473-8dd6-9310848ad135 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:38.550446 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9582fa92-72f6-4473-8dd6-9310848ad135 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:38.555743 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33898fe9-bd24-4552-b331-4acffb683ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:38.556390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33898fe9-bd24-4552-b331-4acffb683ef6 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:38.556675 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33898fe9-bd24-4552-b331-4acffb683ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:38.556995 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33898fe9-bd24-4552-b331-4acffb683ef6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:38.558318 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33898fe9-bd24-4552-b331-4acffb683ef6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:38.560028 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33898fe9-bd24-4552-b331-4acffb683ef6 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:38.562450 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:38.578673 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1094/2176] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:23:38.582500 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ecb84-d956-4da1-a43f-7f7ecda3feb7 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:38.595812 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41ecb84-d956-4da1-a43f-7f7ecda3feb7 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:38.614500 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab29a8d9-10b8-4794-97be-80bd47f30195 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:38.615837 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29a8d9-10b8-4794-97be-80bd47f30195 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:38.616126 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29a8d9-10b8-4794-97be-80bd47f30195 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:38.616430 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab29a8d9-10b8-4794-97be-80bd47f30195 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:38.617136 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab29a8d9-10b8-4794-97be-80bd47f30195 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:38.619266 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab29a8d9-10b8-4794-97be-80bd47f30195 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:38.646027 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1083/2177] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 64 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:23:38.650011 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33898fe9-bd24-4552-b331-4acffb683ef6 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:38.666435 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33898fe9-bd24-4552-b331-4acffb683ef6 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:38.674163 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f19e03-dd10-4b33-9c4f-724a269618f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:38.675643 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f19e03-dd10-4b33-9c4f-724a269618f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:38.676030 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f19e03-dd10-4b33-9c4f-724a269618f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:38.676380 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f19e03-dd10-4b33-9c4f-724a269618f1 admin admin] PATH_INFO: `/v3/projects/5f72ab3d4f214f199bfc113fcb145968/users/50a0f58f48c047a9af13547ddf5de939/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:38.695092 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f19e03-dd10-4b33-9c4f-724a269618f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f72ab3d4f214f199bfc113fcb145968, user_id=50a0f58f48c047a9af13547ddf5de939, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:38.698202 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f19e03-dd10-4b33-9c4f-724a269618f1 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:38.718757 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1095/2178] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:23:38 2022] PUT /identity/v3/projects/5f72ab3d4f214f199bfc113fcb145968/users/50a0f58f48c047a9af13547ddf5de939/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:23:38.729130 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1614414-7ffb-40bb-98a9-d9077dc0d578 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:38.729130 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1614414-7ffb-40bb-98a9-d9077dc0d578 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:38.729820 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1614414-7ffb-40bb-98a9-d9077dc0d578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:38.762267 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-f1614414-7ffb-40bb-98a9-d9077dc0d578 None None] MFA Rules not processed for user `50a0f58f48c047a9af13547ddf5de939`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:23:38.763912 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-f1614414-7ffb-40bb-98a9-d9077dc0d578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:38.803994 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:38.879330 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1084/2179] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:23:38 2022] POST /identity/v3/auth/tokens => generated 3286 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:23:38.883869 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f19e03-dd10-4b33-9c4f-724a269618f1 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:38.975833 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f19e03-dd10-4b33-9c4f-724a269618f1 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:38.984036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95bb5c-767f-4098-9250-5d4aca45e7f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:38.984930 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95bb5c-767f-4098-9250-5d4aca45e7f0 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:38.987013 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95bb5c-767f-4098-9250-5d4aca45e7f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:38.987610 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de95bb5c-767f-4098-9250-5d4aca45e7f0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:38.989254 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de95bb5c-767f-4098-9250-5d4aca45e7f0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:38.992743 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de95bb5c-767f-4098-9250-5d4aca45e7f0 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:39.032511 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1096/2180] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:23:38 2022] POST /identity/v3/projects => generated 409 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:23:39.034654 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1614414-7ffb-40bb-98a9-d9077dc0d578 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:39.049275 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1614414-7ffb-40bb-98a9-d9077dc0d578 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:39.150628 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ac388-1a3b-417e-a862-ac20aaaf3d45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:39.152445 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ac388-1a3b-417e-a862-ac20aaaf3d45 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:39.153062 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ac388-1a3b-417e-a862-ac20aaaf3d45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:39.153685 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110ac388-1a3b-417e-a862-ac20aaaf3d45 admin admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:39.154967 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ac388-1a3b-417e-a862-ac20aaaf3d45 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:39.158058 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110ac388-1a3b-417e-a862-ac20aaaf3d45 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:39.207874 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1085/2181] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:23:39 2022] POST /identity/v3/users => generated 311 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:23:39.209146 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95bb5c-767f-4098-9250-5d4aca45e7f0 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:39.225363 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de95bb5c-767f-4098-9250-5d4aca45e7f0 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:39.237862 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34de919-2ee2-45c9-9856-985b012ca441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:39.238750 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34de919-2ee2-45c9-9856-985b012ca441 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:39.239360 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34de919-2ee2-45c9-9856-985b012ca441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:39.239943 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34de919-2ee2-45c9-9856-985b012ca441 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:39.241406 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34de919-2ee2-45c9-9856-985b012ca441 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:39.244659 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34de919-2ee2-45c9-9856-985b012ca441 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:39.267068 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ac388-1a3b-417e-a862-ac20aaaf3d45 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:39.267991 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1097/2182] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:23:39.279563 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110ac388-1a3b-417e-a862-ac20aaaf3d45 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:39.284740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa5c0b4-3823-4c43-ba33-3b6b48ee1f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:39.285498 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5c0b4-3823-4c43-ba33-3b6b48ee1f6f admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:39.285844 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5c0b4-3823-4c43-ba33-3b6b48ee1f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:39.286216 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa5c0b4-3823-4c43-ba33-3b6b48ee1f6f admin admin] PATH_INFO: `/v3/projects/f6ec847e152648e98ed55b37c5b7e9f9/users/4a5fe823130b4fc2a9cd722cfa749b4b/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:39.304682 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa5c0b4-3823-4c43-ba33-3b6b48ee1f6f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6ec847e152648e98ed55b37c5b7e9f9, user_id=4a5fe823130b4fc2a9cd722cfa749b4b, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:39.307739 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa5c0b4-3823-4c43-ba33-3b6b48ee1f6f admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:39.329846 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1086/2183] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:23:39 2022] PUT /identity/v3/projects/f6ec847e152648e98ed55b37c5b7e9f9/users/4a5fe823130b4fc2a9cd722cfa749b4b/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:23:39.334291 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34de919-2ee2-45c9-9856-985b012ca441 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:39.348175 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34de919-2ee2-45c9-9856-985b012ca441 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:39.428959 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5792b116-7330-436a-927b-cac982c38450 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:39.429732 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792b116-7330-436a-927b-cac982c38450 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:39.430201 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792b116-7330-436a-927b-cac982c38450 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:39.430674 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5792b116-7330-436a-927b-cac982c38450 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:39.431510 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5792b116-7330-436a-927b-cac982c38450 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:39.434480 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5792b116-7330-436a-927b-cac982c38450 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:39.447655 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1098/2184] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:23:39.453924 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa5c0b4-3823-4c43-ba33-3b6b48ee1f6f admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:39.468606 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa5c0b4-3823-4c43-ba33-3b6b48ee1f6f admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:39.473985 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390378c2-acd2-4676-87a4-a43fab90939c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:39.474812 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390378c2-acd2-4676-87a4-a43fab90939c admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:39.475728 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390378c2-acd2-4676-87a4-a43fab90939c admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:39.476019 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390378c2-acd2-4676-87a4-a43fab90939c admin admin] PATH_INFO: `/v3/projects/f6ec847e152648e98ed55b37c5b7e9f9/users/4a5fe823130b4fc2a9cd722cfa749b4b/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:39.478150 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390378c2-acd2-4676-87a4-a43fab90939c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f6ec847e152648e98ed55b37c5b7e9f9, user_id=4a5fe823130b4fc2a9cd722cfa749b4b, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:39.480986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390378c2-acd2-4676-87a4-a43fab90939c admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:39.504283 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1087/2185] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:23:39 2022] PUT /identity/v3/projects/f6ec847e152648e98ed55b37c5b7e9f9/users/4a5fe823130b4fc2a9cd722cfa749b4b/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:23:39.516651 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f9a54-2a83-46f3-ad2d-9844f8d99b51 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:39.517257 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f9a54-2a83-46f3-ad2d-9844f8d99b51 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:39.517632 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80f9a54-2a83-46f3-ad2d-9844f8d99b51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:39.559434 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-e80f9a54-2a83-46f3-ad2d-9844f8d99b51 None None] MFA Rules not processed for user `4a5fe823130b4fc2a9cd722cfa749b4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:23:39.561226 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-e80f9a54-2a83-46f3-ad2d-9844f8d99b51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:39.611133 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:39.659238 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1099/2186] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:23:39 2022] POST /identity/v3/auth/tokens => generated 3353 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:23:39.673112 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390378c2-acd2-4676-87a4-a43fab90939c admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:39.674909 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-390378c2-acd2-4676-87a4-a43fab90939c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:39.740822 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390378c2-acd2-4676-87a4-a43fab90939c admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:39.745457 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c9ddb5-a877-46d0-ad6e-6962b0f08a26 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:39.745687 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9ddb5-a877-46d0-ad6e-6962b0f08a26 service cinder] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:39.745950 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9ddb5-a877-46d0-ad6e-6962b0f08a26 service cinder] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:39.746366 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c9ddb5-a877-46d0-ad6e-6962b0f08a26 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:39.755849 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9ddb5-a877-46d0-ad6e-6962b0f08a26 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:39.757355 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c9ddb5-a877-46d0-ad6e-6962b0f08a26 service cinder] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:39.770816 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1088/2187] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:23:39 2022] GET /identity/v3/auth/tokens => generated 3353 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:23:40.065788 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f9a54-2a83-46f3-ad2d-9844f8d99b51 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:40.080423 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e80f9a54-2a83-46f3-ad2d-9844f8d99b51 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:40.085104 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f170fb8-951a-4fba-be42-4fab8a67aa17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:40.086165 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f170fb8-951a-4fba-be42-4fab8a67aa17 service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:40.086454 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f170fb8-951a-4fba-be42-4fab8a67aa17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:40.086764 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f170fb8-951a-4fba-be42-4fab8a67aa17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:40.167545 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f170fb8-951a-4fba-be42-4fab8a67aa17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:40.169894 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f170fb8-951a-4fba-be42-4fab8a67aa17 service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:40.181941 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1100/2188] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:23:40 2022] GET /identity/v3/auth/tokens => generated 3286 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:23:49.773974 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=83,keystone:INSERT=5 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:50.176114 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=43 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:50.606245 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf716a-dace-449f-bbe4-979dff313b8d None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:50.606530 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf716a-dace-449f-bbe4-979dff313b8d None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:50.606801 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbf716a-dace-449f-bbe4-979dff313b8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:50.626656 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-1fbf716a-dace-449f-bbe4-979dff313b8d None None] MFA Rules not processed for user `36970f0778384576b599cd7217b5084d`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:23:50.627842 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-1fbf716a-dace-449f-bbe4-979dff313b8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:50.679939 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1089/2189] 10.222.0.15 () {58 vars in 967 bytes} [Fri Aug 5 02:23:50 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:23:50.692765 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f170fb8-951a-4fba-be42-4fab8a67aa17 service cinder] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:50.694154 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-5f170fb8-951a-4fba-be42-4fab8a67aa17 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:50.763138 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f170fb8-951a-4fba-be42-4fab8a67aa17 service cinder] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:50.768240 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d202db96-0020-4cce-a809-e43e48509b0f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f03233b0ee3540cdb5105f6603cfdff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:50.768915 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202db96-0020-4cce-a809-e43e48509b0f service swift] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:50.769196 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202db96-0020-4cce-a809-e43e48509b0f service swift] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:50.769469 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d202db96-0020-4cce-a809-e43e48509b0f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:50.777876 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202db96-0020-4cce-a809-e43e48509b0f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:50.779453 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d202db96-0020-4cce-a809-e43e48509b0f service swift] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:50.787555 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1101/2190] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Aug 5 02:23:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 02:23:51.001181 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf716a-dace-449f-bbe4-979dff313b8d None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:51.078471 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbf716a-dace-449f-bbe4-979dff313b8d None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:51.083621 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28b668-0eae-4d7d-80e0-043d264e5fa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:51.084471 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28b668-0eae-4d7d-80e0-043d264e5fa5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:51.084778 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28b668-0eae-4d7d-80e0-043d264e5fa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:51.085115 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb28b668-0eae-4d7d-80e0-043d264e5fa5 admin admin] PATH_INFO: `/v3/users/50a0f58f48c047a9af13547ddf5de939` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:51.086674 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb28b668-0eae-4d7d-80e0-043d264e5fa5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50a0f58f48c047a9af13547ddf5de939)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:51.088891 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb28b668-0eae-4d7d-80e0-043d264e5fa5 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:51.150435 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-bb28b668-0eae-4d7d-80e0-043d264e5fa5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50a0f58f48c047a9af13547ddf5de939'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:51.167234 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-bb28b668-0eae-4d7d-80e0-043d264e5fa5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50a0f58f48c047a9af13547ddf5de939'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:51.168010 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-bb28b668-0eae-4d7d-80e0-043d264e5fa5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50a0f58f48c047a9af13547ddf5de939'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:51.168691 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-bb28b668-0eae-4d7d-80e0-043d264e5fa5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50a0f58f48c047a9af13547ddf5de939'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:51.181998 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-bb28b668-0eae-4d7d-80e0-043d264e5fa5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50a0f58f48c047a9af13547ddf5de939'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:51.204407 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1090/2191] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:23:51 2022] DELETE /identity/v3/users/50a0f58f48c047a9af13547ddf5de939 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:23:51.209659 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c6d60-7fa0-492a-af35-be0a723cd87b None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:51.210132 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c6d60-7fa0-492a-af35-be0a723cd87b None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:51.210132 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395c6d60-7fa0-492a-af35-be0a723cd87b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:51.239242 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-395c6d60-7fa0-492a-af35-be0a723cd87b None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:23:51.240494 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-395c6d60-7fa0-492a-af35-be0a723cd87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:51.312749 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1102/2192] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:23:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:23:51.322789 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28b668-0eae-4d7d-80e0-043d264e5fa5 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:51.324183 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-bb28b668-0eae-4d7d-80e0-043d264e5fa5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:51.354968 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:51.386357 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb28b668-0eae-4d7d-80e0-043d264e5fa5 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:51.389993 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c412e83a-e38a-42b6-9bf1-a6b4aa602eb9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:51.390610 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412e83a-e38a-42b6-9bf1-a6b4aa602eb9 service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:51.390883 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412e83a-e38a-42b6-9bf1-a6b4aa602eb9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:51.391153 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c412e83a-e38a-42b6-9bf1-a6b4aa602eb9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:51.400207 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c412e83a-e38a-42b6-9bf1-a6b4aa602eb9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:51.402310 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c412e83a-e38a-42b6-9bf1-a6b4aa602eb9 service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:51.411757 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1091/2193] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:23:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:23:51.714737 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c6d60-7fa0-492a-af35-be0a723cd87b None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:51.716390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-395c6d60-7fa0-492a-af35-be0a723cd87b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:51.732268 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395c6d60-7fa0-492a-af35-be0a723cd87b None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:51.737877 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96dd942-c701-4c46-a4e5-c13477ff6cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:51.738543 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96dd942-c701-4c46-a4e5-c13477ff6cab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:51.738829 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96dd942-c701-4c46-a4e5-c13477ff6cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:51.739101 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c96dd942-c701-4c46-a4e5-c13477ff6cab admin admin] PATH_INFO: `/v3/projects/5f72ab3d4f214f199bfc113fcb145968` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:51.740363 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96dd942-c701-4c46-a4e5-c13477ff6cab admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f72ab3d4f214f199bfc113fcb145968)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:51.743311 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c96dd942-c701-4c46-a4e5-c13477ff6cab admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:51.798361 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c96dd942-c701-4c46-a4e5-c13477ff6cab admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f72ab3d4f214f199bfc113fcb145968', 'request_id': 'req-c96dd942-c701-4c46-a4e5-c13477ff6cab'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:51.804639 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c96dd942-c701-4c46-a4e5-c13477ff6cab admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f72ab3d4f214f199bfc113fcb145968', 'request_id': 'req-c96dd942-c701-4c46-a4e5-c13477ff6cab'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:51.813885 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c96dd942-c701-4c46-a4e5-c13477ff6cab admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f72ab3d4f214f199bfc113fcb145968', 'request_id': 'req-c96dd942-c701-4c46-a4e5-c13477ff6cab'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:51.826549 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c96dd942-c701-4c46-a4e5-c13477ff6cab admin admin] The token cache is being invalidate because project 5f72ab3d4f214f199bfc113fcb145968 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:23:51.826846 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c96dd942-c701-4c46-a4e5-c13477ff6cab admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:51.833502 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c96dd942-c701-4c46-a4e5-c13477ff6cab admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:51.835508 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1103/2194] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:23:51 2022] DELETE /identity/v3/projects/5f72ab3d4f214f199bfc113fcb145968 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:23:51.839892 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c412e83a-e38a-42b6-9bf1-a6b4aa602eb9 service neutron] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:51.850834 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c412e83a-e38a-42b6-9bf1-a6b4aa602eb9 service neutron] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:51.913800 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c01a930-a127-4d50-8def-a3b1b34f194f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:51.914441 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01a930-a127-4d50-8def-a3b1b34f194f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:51.914714 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01a930-a127-4d50-8def-a3b1b34f194f admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:51.914987 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c01a930-a127-4d50-8def-a3b1b34f194f admin admin] PATH_INFO: `/v3/users/4a5fe823130b4fc2a9cd722cfa749b4b` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:51.916196 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c01a930-a127-4d50-8def-a3b1b34f194f admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a5fe823130b4fc2a9cd722cfa749b4b)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:51.918566 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c01a930-a127-4d50-8def-a3b1b34f194f admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:51.973269 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-5c01a930-a127-4d50-8def-a3b1b34f194f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a5fe823130b4fc2a9cd722cfa749b4b'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:51.990072 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-5c01a930-a127-4d50-8def-a3b1b34f194f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a5fe823130b4fc2a9cd722cfa749b4b'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:51.990929 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-5c01a930-a127-4d50-8def-a3b1b34f194f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a5fe823130b4fc2a9cd722cfa749b4b'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:51.991673 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-5c01a930-a127-4d50-8def-a3b1b34f194f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a5fe823130b4fc2a9cd722cfa749b4b'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:52.003280 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-5c01a930-a127-4d50-8def-a3b1b34f194f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a5fe823130b4fc2a9cd722cfa749b4b'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:52.019098 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1092/2195] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:23:51 2022] DELETE /identity/v3/users/4a5fe823130b4fc2a9cd722cfa749b4b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:23:52.327504 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96dd942-c701-4c46-a4e5-c13477ff6cab admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:52.329012 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-c96dd942-c701-4c46-a4e5-c13477ff6cab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:52.344052 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c96dd942-c701-4c46-a4e5-c13477ff6cab admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:52.354138 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:52.424517 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be5ba7e-739b-449f-825a-9a77af76181d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:52.425336 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5ba7e-739b-449f-825a-9a77af76181d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:52.425624 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5ba7e-739b-449f-825a-9a77af76181d admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:52.426488 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be5ba7e-739b-449f-825a-9a77af76181d admin admin] PATH_INFO: `/v3/projects/f6ec847e152648e98ed55b37c5b7e9f9` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:52.427123 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be5ba7e-739b-449f-825a-9a77af76181d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f6ec847e152648e98ed55b37c5b7e9f9)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:52.429075 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be5ba7e-739b-449f-825a-9a77af76181d admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:52.483742 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-4be5ba7e-739b-449f-825a-9a77af76181d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f6ec847e152648e98ed55b37c5b7e9f9', 'request_id': 'req-4be5ba7e-739b-449f-825a-9a77af76181d'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:52.493174 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-4be5ba7e-739b-449f-825a-9a77af76181d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f6ec847e152648e98ed55b37c5b7e9f9', 'request_id': 'req-4be5ba7e-739b-449f-825a-9a77af76181d'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:52.504271 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-4be5ba7e-739b-449f-825a-9a77af76181d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f6ec847e152648e98ed55b37c5b7e9f9', 'request_id': 'req-4be5ba7e-739b-449f-825a-9a77af76181d'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:52.519631 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-4be5ba7e-739b-449f-825a-9a77af76181d admin admin] The token cache is being invalidate because project f6ec847e152648e98ed55b37c5b7e9f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:23:52.519891 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-4be5ba7e-739b-449f-825a-9a77af76181d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:52.520965 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-4be5ba7e-739b-449f-825a-9a77af76181d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:52.526578 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1104/2196] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:23:52 2022] DELETE /identity/v3/projects/f6ec847e152648e98ed55b37c5b7e9f9 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:23:52.529794 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec4baa-13cd-42a5-83c5-b86dc07bfc6b None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:52.530237 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec4baa-13cd-42a5-83c5-b86dc07bfc6b None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:52.530507 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ec4baa-13cd-42a5-83c5-b86dc07bfc6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:52.553507 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-85ec4baa-13cd-42a5-83c5-b86dc07bfc6b None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:23:52.555202 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-85ec4baa-13cd-42a5-83c5-b86dc07bfc6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:52.606254 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:52.629436 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1093/2197] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:23:52.637021 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608b1af-f86b-4e3e-b7ca-cc5456f55ca9 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:52.637300 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608b1af-f86b-4e3e-b7ca-cc5456f55ca9 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:52.637577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7608b1af-f86b-4e3e-b7ca-cc5456f55ca9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:52.660531 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-7608b1af-f86b-4e3e-b7ca-cc5456f55ca9 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:23:52.662111 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-7608b1af-f86b-4e3e-b7ca-cc5456f55ca9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:52.671232 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1105/2198] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:23:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:23:52.675558 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec4baa-13cd-42a5-83c5-b86dc07bfc6b None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:52.693726 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ec4baa-13cd-42a5-83c5-b86dc07bfc6b None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:52.700920 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e822067-04a3-4458-98d8-a03bc8a58db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:52.701959 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e822067-04a3-4458-98d8-a03bc8a58db1 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:52.702241 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e822067-04a3-4458-98d8-a03bc8a58db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:52.702516 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e822067-04a3-4458-98d8-a03bc8a58db1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:52.704607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e822067-04a3-4458-98d8-a03bc8a58db1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:23:52.704607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e822067-04a3-4458-98d8-a03bc8a58db1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:52.706395 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e822067-04a3-4458-98d8-a03bc8a58db1 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:52.725891 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608b1af-f86b-4e3e-b7ca-cc5456f55ca9 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:52.733005 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1094/2199] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:23:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:23:52.737189 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7608b1af-f86b-4e3e-b7ca-cc5456f55ca9 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:52.743166 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee3fa2-bf3c-4d8b-a252-cb0041218d4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:52.743533 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee3fa2-bf3c-4d8b-a252-cb0041218d4d admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:52.743882 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee3fa2-bf3c-4d8b-a252-cb0041218d4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:52.744274 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bee3fa2-bf3c-4d8b-a252-cb0041218d4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:52.745728 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee3fa2-bf3c-4d8b-a252-cb0041218d4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:52.747952 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bee3fa2-bf3c-4d8b-a252-cb0041218d4d admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:52.783887 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1106/2200] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:23:52 2022] POST /identity/v3/projects => generated 367 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:23:52.785993 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e822067-04a3-4458-98d8-a03bc8a58db1 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:52.797654 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e822067-04a3-4458-98d8-a03bc8a58db1 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:52.886242 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c3e8c-7171-4932-83b8-01ac5444e108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:52.886863 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c3e8c-7171-4932-83b8-01ac5444e108 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:52.887147 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c3e8c-7171-4932-83b8-01ac5444e108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:52.887412 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e3c3e8c-7171-4932-83b8-01ac5444e108 admin admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:52.888078 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c3e8c-7171-4932-83b8-01ac5444e108 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:52.890137 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e3c3e8c-7171-4932-83b8-01ac5444e108 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:52.922272 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1095/2201] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:23:52 2022] POST /identity/v3/users => generated 284 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:23:52.922767 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee3fa2-bf3c-4d8b-a252-cb0041218d4d admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:52.937819 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bee3fa2-bf3c-4d8b-a252-cb0041218d4d admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:52.948127 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5009c01-65c3-4603-a53a-ef18f37ae210 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:52.948970 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c3e8c-7171-4932-83b8-01ac5444e108 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:52.949391 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5009c01-65c3-4603-a53a-ef18f37ae210 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:52.949882 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5009c01-65c3-4603-a53a-ef18f37ae210 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:52.950364 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5009c01-65c3-4603-a53a-ef18f37ae210 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:52.950827 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-4e3c3e8c-7171-4932-83b8-01ac5444e108 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:52.951532 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5009c01-65c3-4603-a53a-ef18f37ae210 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:52.953567 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5009c01-65c3-4603-a53a-ef18f37ae210 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:52.966067 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1107/2202] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:23:52.969841 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5009c01-65c3-4603-a53a-ef18f37ae210 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:52.980507 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e3c3e8c-7171-4932-83b8-01ac5444e108 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:52.982827 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5009c01-65c3-4603-a53a-ef18f37ae210 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:52.987485 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b513b-b27c-410e-b51a-f568945b9beb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:52.988374 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b513b-b27c-410e-b51a-f568945b9beb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:52.988548 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b513b-b27c-410e-b51a-f568945b9beb admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:52.988736 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12b513b-b27c-410e-b51a-f568945b9beb admin admin] PATH_INFO: `/v3/users/47d90567551e4cfb9bcc974e11d4e42c` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:52.989952 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b513b-b27c-410e-b51a-f568945b9beb admin admin] RBAC: Authorizing `identity:delete_user(user_id=47d90567551e4cfb9bcc974e11d4e42c)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:52.991898 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb6783-805d-4db6-8d1b-fd99ea48f05e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:52.992710 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb6783-805d-4db6-8d1b-fd99ea48f05e admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:52.993066 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb6783-805d-4db6-8d1b-fd99ea48f05e admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:52.993242 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12b513b-b27c-410e-b51a-f568945b9beb admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:52.993452 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eb6783-805d-4db6-8d1b-fd99ea48f05e admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:52.995749 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb6783-805d-4db6-8d1b-fd99ea48f05e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:52.998242 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eb6783-805d-4db6-8d1b-fd99ea48f05e admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:53.016260 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1108/2203] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:23:53.017709 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb6783-805d-4db6-8d1b-fd99ea48f05e admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:53.029548 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eb6783-805d-4db6-8d1b-fd99ea48f05e admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:53.036588 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3585ed67-4365-44e7-87f0-f7f3ec4d83f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:53.037309 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585ed67-4365-44e7-87f0-f7f3ec4d83f3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:53.037594 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585ed67-4365-44e7-87f0-f7f3ec4d83f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:53.038052 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3585ed67-4365-44e7-87f0-f7f3ec4d83f3 admin admin] PATH_INFO: `/v3/projects/4f3b634a5045475486c8617332996e25/users/c44b1b97e5e54bfbbf6b7cc7bc00ef7e/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:53.059541 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3585ed67-4365-44e7-87f0-f7f3ec4d83f3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f3b634a5045475486c8617332996e25, user_id=c44b1b97e5e54bfbbf6b7cc7bc00ef7e, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:53.062588 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3585ed67-4365-44e7-87f0-f7f3ec4d83f3 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:53.068620 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-c12b513b-b27c-410e-b51a-f568945b9beb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47d90567551e4cfb9bcc974e11d4e42c'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:53.086349 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1109/2204] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:23:53 2022] PUT /identity/v3/projects/4f3b634a5045475486c8617332996e25/users/c44b1b97e5e54bfbbf6b7cc7bc00ef7e/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 68 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:23:53.091734 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-c12b513b-b27c-410e-b51a-f568945b9beb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47d90567551e4cfb9bcc974e11d4e42c'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:53.092725 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-c12b513b-b27c-410e-b51a-f568945b9beb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47d90567551e4cfb9bcc974e11d4e42c'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:53.093751 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-c12b513b-b27c-410e-b51a-f568945b9beb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47d90567551e4cfb9bcc974e11d4e42c'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:53.096145 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774ee58-aa5e-44b0-979d-0570c32cfea9 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:53.096663 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774ee58-aa5e-44b0-979d-0570c32cfea9 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:53.097189 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1774ee58-aa5e-44b0-979d-0570c32cfea9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:53.111433 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-c12b513b-b27c-410e-b51a-f568945b9beb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47d90567551e4cfb9bcc974e11d4e42c'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:53.127187 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1096/2205] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:23:52 2022] DELETE /identity/v3/users/47d90567551e4cfb9bcc974e11d4e42c => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:23:53.142251 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-1774ee58-aa5e-44b0-979d-0570c32cfea9 None None] MFA Rules not processed for user `c44b1b97e5e54bfbbf6b7cc7bc00ef7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:23:53.143600 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-1774ee58-aa5e-44b0-979d-0570c32cfea9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:53.165100 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:53.225815 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1110/2206] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:23:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:23:53.230916 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b513b-b27c-410e-b51a-f568945b9beb admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:53.232500 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-c12b513b-b27c-410e-b51a-f568945b9beb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:53.276427 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:53.308238 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12b513b-b27c-410e-b51a-f568945b9beb admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:53.313433 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f7b02-f489-4088-b937-547744ab4957 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:53.314006 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f7b02-f489-4088-b937-547744ab4957 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:53.314286 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f7b02-f489-4088-b937-547744ab4957 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:53.314561 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4f7b02-f489-4088-b937-547744ab4957 admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:53.315222 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4f7b02-f489-4088-b937-547744ab4957 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:53.317165 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4f7b02-f489-4088-b937-547744ab4957 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:53.351281 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1097/2207] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:23:53 2022] POST /identity/v3/projects => generated 367 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:23:53.356153 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774ee58-aa5e-44b0-979d-0570c32cfea9 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:53.367314 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1774ee58-aa5e-44b0-979d-0570c32cfea9 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:53.432393 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44f588-5df2-43d9-a2f0-936d35e683fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:53.433725 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44f588-5df2-43d9-a2f0-936d35e683fd admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:53.434183 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44f588-5df2-43d9-a2f0-936d35e683fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:53.434471 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb44f588-5df2-43d9-a2f0-936d35e683fd admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:53.435212 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44f588-5df2-43d9-a2f0-936d35e683fd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:53.437262 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb44f588-5df2-43d9-a2f0-936d35e683fd admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:53.466372 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1111/2208] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:23:53 2022] POST /identity/v3/users => generated 290 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:23:53.469653 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f7b02-f489-4088-b937-547744ab4957 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:53.481490 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4f7b02-f489-4088-b937-547744ab4957 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:53.486241 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6b8f4-314d-45a9-8f03-638cdafed7ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:53.486928 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6b8f4-314d-45a9-8f03-638cdafed7ca admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:53.488078 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6b8f4-314d-45a9-8f03-638cdafed7ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:53.488078 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b6b8f4-314d-45a9-8f03-638cdafed7ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:53.488283 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b6b8f4-314d-45a9-8f03-638cdafed7ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:53.489983 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b6b8f4-314d-45a9-8f03-638cdafed7ca admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:53.504786 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1098/2209] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:23:53.508901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44f588-5df2-43d9-a2f0-936d35e683fd admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:53.511532 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6b8f4-314d-45a9-8f03-638cdafed7ca admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:53.515908 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-e2b6b8f4-314d-45a9-8f03-638cdafed7ca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:53.519599 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb44f588-5df2-43d9-a2f0-936d35e683fd admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:53.526242 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a7165-742c-4910-9333-d7f04b8601e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:53.532496 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a7165-742c-4910-9333-d7f04b8601e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:53.532972 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a7165-742c-4910-9333-d7f04b8601e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:53.533401 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533a7165-742c-4910-9333-d7f04b8601e2 admin admin] PATH_INFO: `/v3/projects/d25e473918f54831a8b27a6d25f803dd/users/b9407b15e7294ce6842e09d6406437dc/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:53.539101 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b6b8f4-314d-45a9-8f03-638cdafed7ca admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:53.546695 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd27758-da41-476e-b368-71bf1689aaf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:53.547484 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd27758-da41-476e-b368-71bf1689aaf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:53.547770 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd27758-da41-476e-b368-71bf1689aaf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:53.548586 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd27758-da41-476e-b368-71bf1689aaf9 admin admin] PATH_INFO: `/v3/projects/14962cc915f647cc916994ec724de454` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:53.549810 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd27758-da41-476e-b368-71bf1689aaf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14962cc915f647cc916994ec724de454)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:53.551743 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd27758-da41-476e-b368-71bf1689aaf9 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:53.553753 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a7165-742c-4910-9333-d7f04b8601e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d25e473918f54831a8b27a6d25f803dd, user_id=b9407b15e7294ce6842e09d6406437dc, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:53.556991 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-533a7165-742c-4910-9333-d7f04b8601e2 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:53.581588 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1112/2210] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:23:53 2022] PUT /identity/v3/projects/d25e473918f54831a8b27a6d25f803dd/users/b9407b15e7294ce6842e09d6406437dc/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:23:53.582797 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a7165-742c-4910-9333-d7f04b8601e2 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:53.628133 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-ffd27758-da41-476e-b368-71bf1689aaf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14962cc915f647cc916994ec724de454', 'request_id': 'req-ffd27758-da41-476e-b368-71bf1689aaf9'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:53.633920 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-ffd27758-da41-476e-b368-71bf1689aaf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14962cc915f647cc916994ec724de454', 'request_id': 'req-ffd27758-da41-476e-b368-71bf1689aaf9'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:53.643052 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-ffd27758-da41-476e-b368-71bf1689aaf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14962cc915f647cc916994ec724de454', 'request_id': 'req-ffd27758-da41-476e-b368-71bf1689aaf9'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:53.655770 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-ffd27758-da41-476e-b368-71bf1689aaf9 admin admin] The token cache is being invalidate because project 14962cc915f647cc916994ec724de454 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:23:53.656065 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-ffd27758-da41-476e-b368-71bf1689aaf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:53.656802 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-ffd27758-da41-476e-b368-71bf1689aaf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:53.658519 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1099/2211] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:23:53 2022] DELETE /identity/v3/projects/14962cc915f647cc916994ec724de454 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:23:53.663064 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61df7b-f281-45c5-a043-46fdd9210b0a None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:53.663398 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61df7b-f281-45c5-a043-46fdd9210b0a None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:53.663527 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-533a7165-742c-4910-9333-d7f04b8601e2 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:53.663724 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f61df7b-f281-45c5-a043-46fdd9210b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:53.686646 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-3f61df7b-f281-45c5-a043-46fdd9210b0a None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:23:53.688262 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-3f61df7b-f281-45c5-a043-46fdd9210b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:53.696126 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:53.727334 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e8f8d-9b84-4a35-b348-29a44522988c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:53.728117 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e8f8d-9b84-4a35-b348-29a44522988c admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:53.729056 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e8f8d-9b84-4a35-b348-29a44522988c admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:53.729480 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4e8f8d-9b84-4a35-b348-29a44522988c admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:53.730373 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4e8f8d-9b84-4a35-b348-29a44522988c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:53.731958 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4e8f8d-9b84-4a35-b348-29a44522988c admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:53.742257 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1113/2212] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:23:53 2022] GET /identity/v3/roles => generated 1420 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:23:53.747167 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e8f8d-9b84-4a35-b348-29a44522988c admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:53.749065 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-2d4e8f8d-9b84-4a35-b348-29a44522988c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:53.757888 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1100/2213] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:23:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:23:53.764120 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4e8f8d-9b84-4a35-b348-29a44522988c admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:53.769136 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c70d545-68f1-4661-8e3f-db470e2330d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:53.769851 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70d545-68f1-4661-8e3f-db470e2330d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:53.770120 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70d545-68f1-4661-8e3f-db470e2330d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:53.770394 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c70d545-68f1-4661-8e3f-db470e2330d4 admin admin] PATH_INFO: `/v3/projects/d25e473918f54831a8b27a6d25f803dd/users/b9407b15e7294ce6842e09d6406437dc/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:53.772476 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c70d545-68f1-4661-8e3f-db470e2330d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d25e473918f54831a8b27a6d25f803dd, user_id=b9407b15e7294ce6842e09d6406437dc, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:53.775201 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c70d545-68f1-4661-8e3f-db470e2330d4 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:53.800516 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1114/2214] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:23:53 2022] PUT /identity/v3/projects/d25e473918f54831a8b27a6d25f803dd/users/b9407b15e7294ce6842e09d6406437dc/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:23:53.802604 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8b54c-60fd-4dbe-8534-de772ba79ebc None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:53.802892 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8b54c-60fd-4dbe-8534-de772ba79ebc None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:53.803257 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c8b54c-60fd-4dbe-8534-de772ba79ebc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:53.828546 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e98f8-2e1e-47d5-abdf-cc9f3abb0adf None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:53.828840 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e98f8-2e1e-47d5-abdf-cc9f3abb0adf None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:53.829120 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183e98f8-2e1e-47d5-abdf-cc9f3abb0adf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:53.843930 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-f2c8b54c-60fd-4dbe-8534-de772ba79ebc None None] MFA Rules not processed for user `b9407b15e7294ce6842e09d6406437dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:23:53.845451 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-f2c8b54c-60fd-4dbe-8534-de772ba79ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:53.853017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-183e98f8-2e1e-47d5-abdf-cc9f3abb0adf None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:23:53.854955 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-183e98f8-2e1e-47d5-abdf-cc9f3abb0adf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:53.869241 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:53.920457 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1115/2215] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:23:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:23:53.924570 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e98f8-2e1e-47d5-abdf-cc9f3abb0adf None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:53.933889 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1101/2216] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:23:53 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:23:53.934971 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183e98f8-2e1e-47d5-abdf-cc9f3abb0adf None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:53.940752 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e3cd6-9c3d-4ca1-877a-50eacd37f5ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:53.941463 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e3cd6-9c3d-4ca1-877a-50eacd37f5ae admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:53.942112 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e3cd6-9c3d-4ca1-877a-50eacd37f5ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:53.942112 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-454e3cd6-9c3d-4ca1-877a-50eacd37f5ae admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:53.942927 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e3cd6-9c3d-4ca1-877a-50eacd37f5ae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:23:53.943298 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e3cd6-9c3d-4ca1-877a-50eacd37f5ae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:53.945092 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-454e3cd6-9c3d-4ca1-877a-50eacd37f5ae admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:53.945673 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8b54c-60fd-4dbe-8534-de772ba79ebc None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:53.947071 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-f2c8b54c-60fd-4dbe-8534-de772ba79ebc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:53.960272 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1116/2217] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:23:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:23:53.964616 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e3cd6-9c3d-4ca1-877a-50eacd37f5ae admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:53.976679 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-454e3cd6-9c3d-4ca1-877a-50eacd37f5ae admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:53.982098 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08358b6-3627-47d0-ab1c-fae1e694ecc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:53.982713 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08358b6-3627-47d0-ab1c-fae1e694ecc1 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:53.982991 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08358b6-3627-47d0-ab1c-fae1e694ecc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:53.983327 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08358b6-3627-47d0-ab1c-fae1e694ecc1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:53.984009 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08358b6-3627-47d0-ab1c-fae1e694ecc1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:53.985925 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08358b6-3627-47d0-ab1c-fae1e694ecc1 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:54.015585 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1117/2218] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:23:53 2022] POST /identity/v3/projects => generated 365 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:23:54.019155 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08358b6-3627-47d0-ab1c-fae1e694ecc1 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:54.022174 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c8b54c-60fd-4dbe-8534-de772ba79ebc None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:54.076005 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5a371-c78f-48b0-b9b2-2502c47669ac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:54.077007 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5a371-c78f-48b0-b9b2-2502c47669ac service cinder] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:54.077133 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5a371-c78f-48b0-b9b2-2502c47669ac service cinder] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:54.077350 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb5a371-c78f-48b0-b9b2-2502c47669ac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:54.084579 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08358b6-3627-47d0-ab1c-fae1e694ecc1 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:54.090341 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e1036-394e-4caa-b798-76661cfab4a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:54.090993 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e1036-394e-4caa-b798-76661cfab4a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:54.091280 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e1036-394e-4caa-b798-76661cfab4a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:54.091558 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80e1036-394e-4caa-b798-76661cfab4a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:54.092251 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e1036-394e-4caa-b798-76661cfab4a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:54.094454 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80e1036-394e-4caa-b798-76661cfab4a1 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:54.116032 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1118/2219] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:23:54 2022] POST /identity/v3/users => generated 283 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:23:54.120119 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e1036-394e-4caa-b798-76661cfab4a1 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:54.129737 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80e1036-394e-4caa-b798-76661cfab4a1 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:54.134413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e8c05-c9a2-406b-8343-c4a4b1936ec4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:54.135603 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e8c05-c9a2-406b-8343-c4a4b1936ec4 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:54.135886 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e8c05-c9a2-406b-8343-c4a4b1936ec4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:54.136162 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518e8c05-c9a2-406b-8343-c4a4b1936ec4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:54.136893 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518e8c05-c9a2-406b-8343-c4a4b1936ec4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:54.138463 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518e8c05-c9a2-406b-8343-c4a4b1936ec4 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:54.140619 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:54.145487 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb5a371-c78f-48b0-b9b2-2502c47669ac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:54.147057 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb5a371-c78f-48b0-b9b2-2502c47669ac service cinder] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:54.152642 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1119/2220] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:23:54.154433 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e8c05-c9a2-406b-8343-c4a4b1936ec4 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:54.157989 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1102/2221] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:23:53 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:23:54.163989 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518e8c05-c9a2-406b-8343-c4a4b1936ec4 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:54.168619 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576c57c-1110-457d-96c0-30f09eedccc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:54.169224 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576c57c-1110-457d-96c0-30f09eedccc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:54.169510 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576c57c-1110-457d-96c0-30f09eedccc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:54.169785 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9576c57c-1110-457d-96c0-30f09eedccc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:54.170475 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9576c57c-1110-457d-96c0-30f09eedccc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:54.172050 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9576c57c-1110-457d-96c0-30f09eedccc3 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:54.184517 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1120/2222] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:23:54 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:23:54.189046 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5a371-c78f-48b0-b9b2-2502c47669ac service cinder] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:54.200277 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb5a371-c78f-48b0-b9b2-2502c47669ac service cinder] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:54.204921 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41faa393-18e7-49f9-b1f2-6c26dadd9e03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:54.205587 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41faa393-18e7-49f9-b1f2-6c26dadd9e03 admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:54.205868 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41faa393-18e7-49f9-b1f2-6c26dadd9e03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:54.206171 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41faa393-18e7-49f9-b1f2-6c26dadd9e03 admin admin] PATH_INFO: `/v3/projects/658bcc8ba8094676a94c09b1bf474604/users/35aa8d4be50a486988ecfb9e55d3b045/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:54.221974 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41faa393-18e7-49f9-b1f2-6c26dadd9e03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=658bcc8ba8094676a94c09b1bf474604, user_id=35aa8d4be50a486988ecfb9e55d3b045, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:54.225247 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41faa393-18e7-49f9-b1f2-6c26dadd9e03 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:54.239514 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:54.241764 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1103/2223] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:23:54 2022] PUT /identity/v3/projects/658bcc8ba8094676a94c09b1bf474604/users/35aa8d4be50a486988ecfb9e55d3b045/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:23:54.249619 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576c57c-1110-457d-96c0-30f09eedccc3 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:54.251147 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1aec9d-6421-4ca2-98b6-f1f9107550be None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:54.251434 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1aec9d-6421-4ca2-98b6-f1f9107550be None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:54.251828 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1aec9d-6421-4ca2-98b6-f1f9107550be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:54.259882 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9576c57c-1110-457d-96c0-30f09eedccc3 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:54.279468 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-8f1aec9d-6421-4ca2-98b6-f1f9107550be None None] MFA Rules not processed for user `35aa8d4be50a486988ecfb9e55d3b045`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:23:54.280729 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-8f1aec9d-6421-4ca2-98b6-f1f9107550be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:54.309121 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49711a46-2c99-4e7f-a2d6-cf807939144f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:54.309777 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49711a46-2c99-4e7f-a2d6-cf807939144f service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:54.310083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49711a46-2c99-4e7f-a2d6-cf807939144f service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:54.310388 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49711a46-2c99-4e7f-a2d6-cf807939144f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:54.312193 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-49711a46-2c99-4e7f-a2d6-cf807939144f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:54.346037 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1104/2224] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:23:54 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:23:54.358304 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1aec9d-6421-4ca2-98b6-f1f9107550be None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:54.359688 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-8f1aec9d-6421-4ca2-98b6-f1f9107550be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:54.372136 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1aec9d-6421-4ca2-98b6-f1f9107550be None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:54.375119 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49711a46-2c99-4e7f-a2d6-cf807939144f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:54.376394 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdaa5d11-f45e-4cf4-bc30-7f55ec03ee21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:54.376654 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49711a46-2c99-4e7f-a2d6-cf807939144f service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:54.377096 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa5d11-f45e-4cf4-bc30-7f55ec03ee21 service cinder] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:54.377380 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa5d11-f45e-4cf4-bc30-7f55ec03ee21 service cinder] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:54.377658 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdaa5d11-f45e-4cf4-bc30-7f55ec03ee21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:54.386116 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1121/2225] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:23:54 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:23:54.386920 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaa5d11-f45e-4cf4-bc30-7f55ec03ee21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:54.388377 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdaa5d11-f45e-4cf4-bc30-7f55ec03ee21 service cinder] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:54.397655 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1105/2226] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:23:54 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:23:59.146865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49711a46-2c99-4e7f-a2d6-cf807939144f service cinder] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:59.207606 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49711a46-2c99-4e7f-a2d6-cf807939144f service cinder] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:59.212079 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a590ac-2a29-4b7d-b56c-3f57e4f04ef4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:59.212867 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a590ac-2a29-4b7d-b56c-3f57e4f04ef4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:59.213144 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a590ac-2a29-4b7d-b56c-3f57e4f04ef4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:59.213416 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a590ac-2a29-4b7d-b56c-3f57e4f04ef4 admin admin] PATH_INFO: `/v3/users/c44b1b97e5e54bfbbf6b7cc7bc00ef7e` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:59.214560 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a590ac-2a29-4b7d-b56c-3f57e4f04ef4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c44b1b97e5e54bfbbf6b7cc7bc00ef7e)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:59.216499 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a590ac-2a29-4b7d-b56c-3f57e4f04ef4 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:59.259625 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:59.262901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-13a590ac-2a29-4b7d-b56c-3f57e4f04ef4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c44b1b97e5e54bfbbf6b7cc7bc00ef7e'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:59.274810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-13a590ac-2a29-4b7d-b56c-3f57e4f04ef4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c44b1b97e5e54bfbbf6b7cc7bc00ef7e'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:59.275491 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-13a590ac-2a29-4b7d-b56c-3f57e4f04ef4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c44b1b97e5e54bfbbf6b7cc7bc00ef7e'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:59.276099 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-13a590ac-2a29-4b7d-b56c-3f57e4f04ef4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c44b1b97e5e54bfbbf6b7cc7bc00ef7e'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:59.283074 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-13a590ac-2a29-4b7d-b56c-3f57e4f04ef4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c44b1b97e5e54bfbbf6b7cc7bc00ef7e'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:59.296203 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1122/2227] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:23:59 2022] DELETE /identity/v3/users/c44b1b97e5e54bfbbf6b7cc7bc00ef7e => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:23:59.300774 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075eeca-c861-49b7-9fb4-832ca2ddd5fd None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:59.301234 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075eeca-c861-49b7-9fb4-832ca2ddd5fd None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:59.301325 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c075eeca-c861-49b7-9fb4-832ca2ddd5fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:59.322361 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-c075eeca-c861-49b7-9fb4-832ca2ddd5fd None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:23:59.323538 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-c075eeca-c861-49b7-9fb4-832ca2ddd5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:59.381113 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1106/2228] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:23:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:23:59.390976 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a590ac-2a29-4b7d-b56c-3f57e4f04ef4 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:59.392413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-13a590ac-2a29-4b7d-b56c-3f57e4f04ef4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:59.447874 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a590ac-2a29-4b7d-b56c-3f57e4f04ef4 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:59.451438 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3dc88-b0a2-4922-b292-a63d1e4ae46f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:59.452065 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3dc88-b0a2-4922-b292-a63d1e4ae46f service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:59.452353 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3dc88-b0a2-4922-b292-a63d1e4ae46f service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:59.452625 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d3dc88-b0a2-4922-b292-a63d1e4ae46f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:59.461318 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d3dc88-b0a2-4922-b292-a63d1e4ae46f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:59.463231 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d3dc88-b0a2-4922-b292-a63d1e4ae46f service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:59.472642 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1123/2229] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:23:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:23:59.753553 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075eeca-c861-49b7-9fb4-832ca2ddd5fd None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:59.755074 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-c075eeca-c861-49b7-9fb4-832ca2ddd5fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:23:59.769423 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c075eeca-c861-49b7-9fb4-832ca2ddd5fd None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:59.774130 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74218c6-80af-4ab1-93d6-e0130a03b0c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:59.774825 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74218c6-80af-4ab1-93d6-e0130a03b0c7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:59.775726 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74218c6-80af-4ab1-93d6-e0130a03b0c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:59.776133 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d74218c6-80af-4ab1-93d6-e0130a03b0c7 admin admin] PATH_INFO: `/v3/projects/4f3b634a5045475486c8617332996e25` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:59.777526 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74218c6-80af-4ab1-93d6-e0130a03b0c7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f3b634a5045475486c8617332996e25)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:59.779943 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d74218c6-80af-4ab1-93d6-e0130a03b0c7 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:59.826748 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-d74218c6-80af-4ab1-93d6-e0130a03b0c7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f3b634a5045475486c8617332996e25', 'request_id': 'req-d74218c6-80af-4ab1-93d6-e0130a03b0c7'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:59.832169 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-d74218c6-80af-4ab1-93d6-e0130a03b0c7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f3b634a5045475486c8617332996e25', 'request_id': 'req-d74218c6-80af-4ab1-93d6-e0130a03b0c7'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:59.841073 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-d74218c6-80af-4ab1-93d6-e0130a03b0c7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f3b634a5045475486c8617332996e25', 'request_id': 'req-d74218c6-80af-4ab1-93d6-e0130a03b0c7'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:59.849642 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:23:59.854645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-d74218c6-80af-4ab1-93d6-e0130a03b0c7 admin admin] The token cache is being invalidate because project 4f3b634a5045475486c8617332996e25 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:23:59.855378 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-d74218c6-80af-4ab1-93d6-e0130a03b0c7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:59.855999 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-d74218c6-80af-4ab1-93d6-e0130a03b0c7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:23:59.857539 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1107/2230] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:23:59 2022] DELETE /identity/v3/projects/4f3b634a5045475486c8617332996e25 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:23:59.861977 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3dc88-b0a2-4922-b292-a63d1e4ae46f service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:23:59.872319 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d3dc88-b0a2-4922-b292-a63d1e4ae46f service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:23:59.939995 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f5a5990-c64e-4ea4-b16e-4c305156995a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:23:59.940673 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a5990-c64e-4ea4-b16e-4c305156995a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:23:59.940950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a5990-c64e-4ea4-b16e-4c305156995a admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:23:59.941220 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f5a5990-c64e-4ea4-b16e-4c305156995a admin admin] PATH_INFO: `/v3/users/b9407b15e7294ce6842e09d6406437dc` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:23:59.942391 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a5990-c64e-4ea4-b16e-4c305156995a admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9407b15e7294ce6842e09d6406437dc)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:23:59.944276 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f5a5990-c64e-4ea4-b16e-4c305156995a admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:23:59.992092 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-0f5a5990-c64e-4ea4-b16e-4c305156995a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9407b15e7294ce6842e09d6406437dc'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:00.007151 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-0f5a5990-c64e-4ea4-b16e-4c305156995a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9407b15e7294ce6842e09d6406437dc'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:00.007849 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-0f5a5990-c64e-4ea4-b16e-4c305156995a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9407b15e7294ce6842e09d6406437dc'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:00.008493 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-0f5a5990-c64e-4ea4-b16e-4c305156995a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9407b15e7294ce6842e09d6406437dc'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:00.010422 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:DELETE=13,keystone:SELECT=86,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:24:00.017393 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-0f5a5990-c64e-4ea4-b16e-4c305156995a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9407b15e7294ce6842e09d6406437dc'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:00.031290 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1124/2231] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:23:59 2022] DELETE /identity/v3/users/b9407b15e7294ce6842e09d6406437dc => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:24:00.305755 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74218c6-80af-4ab1-93d6-e0130a03b0c7 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:24:00.307918 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-d74218c6-80af-4ab1-93d6-e0130a03b0c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:24:00.321119 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d74218c6-80af-4ab1-93d6-e0130a03b0c7 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:24:00.379628 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7db1f957-ee59-4da6-9a86-e5574f1fdfe9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:24:00.380264 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1f957-ee59-4da6-9a86-e5574f1fdfe9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:00.380580 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1f957-ee59-4da6-9a86-e5574f1fdfe9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:00.380860 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7db1f957-ee59-4da6-9a86-e5574f1fdfe9 admin admin] PATH_INFO: `/v3/projects/d25e473918f54831a8b27a6d25f803dd` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:00.382017 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db1f957-ee59-4da6-9a86-e5574f1fdfe9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d25e473918f54831a8b27a6d25f803dd)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:24:00.383920 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7db1f957-ee59-4da6-9a86-e5574f1fdfe9 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:24:00.431232 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-7db1f957-ee59-4da6-9a86-e5574f1fdfe9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd25e473918f54831a8b27a6d25f803dd', 'request_id': 'req-7db1f957-ee59-4da6-9a86-e5574f1fdfe9'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:00.436643 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-7db1f957-ee59-4da6-9a86-e5574f1fdfe9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd25e473918f54831a8b27a6d25f803dd', 'request_id': 'req-7db1f957-ee59-4da6-9a86-e5574f1fdfe9'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:00.443783 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-7db1f957-ee59-4da6-9a86-e5574f1fdfe9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd25e473918f54831a8b27a6d25f803dd', 'request_id': 'req-7db1f957-ee59-4da6-9a86-e5574f1fdfe9'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:00.454677 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-7db1f957-ee59-4da6-9a86-e5574f1fdfe9 admin admin] The token cache is being invalidate because project d25e473918f54831a8b27a6d25f803dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:24:00.454960 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-7db1f957-ee59-4da6-9a86-e5574f1fdfe9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:00.455576 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-7db1f957-ee59-4da6-9a86-e5574f1fdfe9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:00.457087 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1108/2232] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:24:00 2022] DELETE /identity/v3/projects/d25e473918f54831a8b27a6d25f803dd => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:24:00.461949 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ed286-c6bf-45f0-8af4-d4b6d03f86fc None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:00.462914 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ed286-c6bf-45f0-8af4-d4b6d03f86fc None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:00.463095 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773ed286-c6bf-45f0-8af4-d4b6d03f86fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:00.482957 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-773ed286-c6bf-45f0-8af4-d4b6d03f86fc None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:24:00.484147 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-773ed286-c6bf-45f0-8af4-d4b6d03f86fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:24:00.541764 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1125/2233] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:24:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:24:00.549642 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e52a83-5202-44a3-a4a2-0f335deb0fc4 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:00.549930 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e52a83-5202-44a3-a4a2-0f335deb0fc4 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:00.550209 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03e52a83-5202-44a3-a4a2-0f335deb0fc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:00.570056 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-03e52a83-5202-44a3-a4a2-0f335deb0fc4 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:24:00.571251 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-03e52a83-5202-44a3-a4a2-0f335deb0fc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:24:00.579467 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1109/2234] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:24:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:24:00.583763 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ed286-c6bf-45f0-8af4-d4b6d03f86fc None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:24:00.594451 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773ed286-c6bf-45f0-8af4-d4b6d03f86fc None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:24:00.599054 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b4466-5f48-4ba9-9841-525dd96af203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:24:00.599662 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b4466-5f48-4ba9-9841-525dd96af203 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:00.599944 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b4466-5f48-4ba9-9841-525dd96af203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:00.600218 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6b4466-5f48-4ba9-9841-525dd96af203 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:00.600952 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b4466-5f48-4ba9-9841-525dd96af203 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:24:00.601252 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b4466-5f48-4ba9-9841-525dd96af203 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:24:00.602862 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff6b4466-5f48-4ba9-9841-525dd96af203 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:24:00.615055 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1126/2235] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:24:00.620539 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e52a83-5202-44a3-a4a2-0f335deb0fc4 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:24:00.629745 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03e52a83-5202-44a3-a4a2-0f335deb0fc4 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:24:00.635032 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ae63b-2a9f-4d5f-a7f2-7330427c6843 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:24:00.635635 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ae63b-2a9f-4d5f-a7f2-7330427c6843 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:00.635918 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ae63b-2a9f-4d5f-a7f2-7330427c6843 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:00.636193 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4ae63b-2a9f-4d5f-a7f2-7330427c6843 admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:00.636891 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ae63b-2a9f-4d5f-a7f2-7330427c6843 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:24:00.638782 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d4ae63b-2a9f-4d5f-a7f2-7330427c6843 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:24:00.665386 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1110/2236] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:24:00 2022] POST /identity/v3/projects => generated 387 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:24:00.670006 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b4466-5f48-4ba9-9841-525dd96af203 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:24:00.679910 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6b4466-5f48-4ba9-9841-525dd96af203 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:24:00.741076 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07790c15-99f8-4950-b531-b3afafaf09de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:24:00.741694 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07790c15-99f8-4950-b531-b3afafaf09de admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:00.741973 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07790c15-99f8-4950-b531-b3afafaf09de admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:00.742243 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07790c15-99f8-4950-b531-b3afafaf09de admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:00.742908 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07790c15-99f8-4950-b531-b3afafaf09de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:24:00.745640 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07790c15-99f8-4950-b531-b3afafaf09de admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:24:00.767465 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1127/2237] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:24:00 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:24:00.771824 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ae63b-2a9f-4d5f-a7f2-7330427c6843 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:24:00.782414 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d4ae63b-2a9f-4d5f-a7f2-7330427c6843 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:24:00.787075 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9326597-9601-43e5-b2a2-87b991f0020e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:24:00.787677 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9326597-9601-43e5-b2a2-87b991f0020e admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:00.787961 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9326597-9601-43e5-b2a2-87b991f0020e admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:00.788235 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9326597-9601-43e5-b2a2-87b991f0020e admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:00.788961 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9326597-9601-43e5-b2a2-87b991f0020e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:24:00.791122 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9326597-9601-43e5-b2a2-87b991f0020e admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:24:00.804575 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1111/2238] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:24:00.805920 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07790c15-99f8-4950-b531-b3afafaf09de admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:24:00.817170 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07790c15-99f8-4950-b531-b3afafaf09de admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:24:00.822630 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72fab8dc-a5cb-49d2-b827-7b78648797c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:24:00.823253 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fab8dc-a5cb-49d2-b827-7b78648797c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:00.823534 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fab8dc-a5cb-49d2-b827-7b78648797c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:00.823950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72fab8dc-a5cb-49d2-b827-7b78648797c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:00.824689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fab8dc-a5cb-49d2-b827-7b78648797c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:24:00.826277 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72fab8dc-a5cb-49d2-b827-7b78648797c6 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:24:00.850528 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1128/2239] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:24:00 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:24:00.852084 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9326597-9601-43e5-b2a2-87b991f0020e admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:24:00.868039 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9326597-9601-43e5-b2a2-87b991f0020e admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:24:00.872849 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8facabd4-1752-4cb3-901c-57e14dc4b71b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:24:00.873504 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facabd4-1752-4cb3-901c-57e14dc4b71b admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:00.873784 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facabd4-1752-4cb3-901c-57e14dc4b71b admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:00.874061 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8facabd4-1752-4cb3-901c-57e14dc4b71b admin admin] PATH_INFO: `/v3/projects/e09f39345ccc4e879435869548a33d21/users/7225cc4c756d4cb6ba8bad6ab5f47f99/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:00.890225 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8facabd4-1752-4cb3-901c-57e14dc4b71b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e09f39345ccc4e879435869548a33d21, user_id=7225cc4c756d4cb6ba8bad6ab5f47f99, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:24:00.892938 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8facabd4-1752-4cb3-901c-57e14dc4b71b admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:24:00.906931 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1112/2240] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:24:00 2022] PUT /identity/v3/projects/e09f39345ccc4e879435869548a33d21/users/7225cc4c756d4cb6ba8bad6ab5f47f99/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:24:00.919125 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9c109-841f-4189-a45b-0270f901e1cf None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:00.919439 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9c109-841f-4189-a45b-0270f901e1cf None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:00.919718 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad9c109-841f-4189-a45b-0270f901e1cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:00.954001 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-0ad9c109-841f-4189-a45b-0270f901e1cf None None] MFA Rules not processed for user `7225cc4c756d4cb6ba8bad6ab5f47f99`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:24:00.955300 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-0ad9c109-841f-4189-a45b-0270f901e1cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:24:01.021647 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:INSERT=4,keystone:DELETE=1,keystone:SELECT=95 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:24:01.049790 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1129/2241] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:24:00 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:24:01.054398 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8facabd4-1752-4cb3-901c-57e14dc4b71b admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:24:01.084849 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:24:01.118423 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8facabd4-1752-4cb3-901c-57e14dc4b71b admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:24:01.124177 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de30201-46df-41d7-91cb-e79da2e0e7da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:24:01.124785 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de30201-46df-41d7-91cb-e79da2e0e7da admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:01.125066 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de30201-46df-41d7-91cb-e79da2e0e7da admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:01.125340 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de30201-46df-41d7-91cb-e79da2e0e7da admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:01.126010 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de30201-46df-41d7-91cb-e79da2e0e7da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:24:01.127935 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de30201-46df-41d7-91cb-e79da2e0e7da admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:24:01.154667 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1113/2242] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:24:01 2022] POST /identity/v3/projects => generated 387 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:24:01.158647 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9c109-841f-4189-a45b-0270f901e1cf None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:24:01.169164 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad9c109-841f-4189-a45b-0270f901e1cf None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:24:01.227049 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e865022-3c35-4e06-af57-143b898a97a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:24:01.227592 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e865022-3c35-4e06-af57-143b898a97a5 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:01.227873 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e865022-3c35-4e06-af57-143b898a97a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:01.228151 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e865022-3c35-4e06-af57-143b898a97a5 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:01.228856 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e865022-3c35-4e06-af57-143b898a97a5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:24:01.230764 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e865022-3c35-4e06-af57-143b898a97a5 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:24:01.252051 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1130/2243] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:24:01 2022] POST /identity/v3/users => generated 300 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:24:01.256021 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de30201-46df-41d7-91cb-e79da2e0e7da admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:24:01.267102 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de30201-46df-41d7-91cb-e79da2e0e7da admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:24:01.271665 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9474a-6069-45e6-a038-42cf6a4f3d3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:24:01.272270 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9474a-6069-45e6-a038-42cf6a4f3d3d admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:01.272578 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9474a-6069-45e6-a038-42cf6a4f3d3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:01.272852 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae9474a-6069-45e6-a038-42cf6a4f3d3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:01.273542 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae9474a-6069-45e6-a038-42cf6a4f3d3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:24:01.275330 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae9474a-6069-45e6-a038-42cf6a4f3d3d admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:24:01.285855 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1114/2244] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:24:01.290011 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e865022-3c35-4e06-af57-143b898a97a5 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:24:01.300971 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e865022-3c35-4e06-af57-143b898a97a5 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:24:01.305436 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90532343-eb9d-4a48-9bf1-75f6038dbf8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:24:01.306858 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90532343-eb9d-4a48-9bf1-75f6038dbf8b admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:01.307343 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90532343-eb9d-4a48-9bf1-75f6038dbf8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:01.307343 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90532343-eb9d-4a48-9bf1-75f6038dbf8b admin admin] PATH_INFO: `/v3/projects/18db467702a54a8cb0ac7403acf70f44/users/4a30d62160c54e56a84a2b370fea11bb/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:01.322335 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90532343-eb9d-4a48-9bf1-75f6038dbf8b admin admin] RBAC: Authorizing `identity:create_grant(project_id=18db467702a54a8cb0ac7403acf70f44, user_id=4a30d62160c54e56a84a2b370fea11bb, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:24:01.324724 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90532343-eb9d-4a48-9bf1-75f6038dbf8b admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:24:01.336907 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1131/2245] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:24:01 2022] PUT /identity/v3/projects/18db467702a54a8cb0ac7403acf70f44/users/4a30d62160c54e56a84a2b370fea11bb/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:24:01.340937 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9474a-6069-45e6-a038-42cf6a4f3d3d admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:24:01.351199 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae9474a-6069-45e6-a038-42cf6a4f3d3d admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:24:01.407431 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875c019b-40ba-4f27-a081-00eca717d1e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:24:01.408140 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c019b-40ba-4f27-a081-00eca717d1e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:01.408448 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c019b-40ba-4f27-a081-00eca717d1e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:01.408720 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875c019b-40ba-4f27-a081-00eca717d1e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:01.409401 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c019b-40ba-4f27-a081-00eca717d1e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:24:01.410972 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875c019b-40ba-4f27-a081-00eca717d1e0 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:24:01.421180 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1115/2246] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:24:01 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:24:01.425324 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90532343-eb9d-4a48-9bf1-75f6038dbf8b admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:24:01.435583 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90532343-eb9d-4a48-9bf1-75f6038dbf8b admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:24:01.440070 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45995a4a-9ed5-432a-b6cf-9b02da7d9fc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:24:01.440874 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45995a4a-9ed5-432a-b6cf-9b02da7d9fc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:01.441154 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45995a4a-9ed5-432a-b6cf-9b02da7d9fc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:01.441422 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45995a4a-9ed5-432a-b6cf-9b02da7d9fc1 admin admin] PATH_INFO: `/v3/projects/18db467702a54a8cb0ac7403acf70f44/users/4a30d62160c54e56a84a2b370fea11bb/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:01.443332 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45995a4a-9ed5-432a-b6cf-9b02da7d9fc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=18db467702a54a8cb0ac7403acf70f44, user_id=4a30d62160c54e56a84a2b370fea11bb, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:24:01.445964 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45995a4a-9ed5-432a-b6cf-9b02da7d9fc1 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:24:01.456471 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1132/2247] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:24:01 2022] PUT /identity/v3/projects/18db467702a54a8cb0ac7403acf70f44/users/4a30d62160c54e56a84a2b370fea11bb/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:24:01.467032 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cded91-4c14-4f0e-b3c3-0c2d2d0a62e5 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:01.467318 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cded91-4c14-4f0e-b3c3-0c2d2d0a62e5 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:01.467597 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cded91-4c14-4f0e-b3c3-0c2d2d0a62e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:01.494822 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-27cded91-4c14-4f0e-b3c3-0c2d2d0a62e5 None None] MFA Rules not processed for user `4a30d62160c54e56a84a2b370fea11bb`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:24:01.495979 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-27cded91-4c14-4f0e-b3c3-0c2d2d0a62e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:24:01.563609 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1116/2248] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:24:01 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:24:01.575376 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45995a4a-9ed5-432a-b6cf-9b02da7d9fc1 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:24:01.577239 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-45995a4a-9ed5-432a-b6cf-9b02da7d9fc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:24:01.634082 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45995a4a-9ed5-432a-b6cf-9b02da7d9fc1 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:24:01.638212 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcfe7cce-c011-40af-8c8b-0157e1e19ecf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:24:01.638808 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe7cce-c011-40af-8c8b-0157e1e19ecf service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:01.639089 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe7cce-c011-40af-8c8b-0157e1e19ecf service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:01.639362 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcfe7cce-c011-40af-8c8b-0157e1e19ecf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:01.648241 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe7cce-c011-40af-8c8b-0157e1e19ecf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:24:01.649667 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcfe7cce-c011-40af-8c8b-0157e1e19ecf service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:24:01.659347 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1133/2249] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:24:01 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:24:02.256237 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cded91-4c14-4f0e-b3c3-0c2d2d0a62e5 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:24:02.281859 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:24:02.330929 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cded91-4c14-4f0e-b3c3-0c2d2d0a62e5 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:24:02.335624 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d525b-20ec-41a2-ba4d-4f474e144e88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:24:02.336281 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d525b-20ec-41a2-ba4d-4f474e144e88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:02.336583 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d525b-20ec-41a2-ba4d-4f474e144e88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:02.336853 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40d525b-20ec-41a2-ba4d-4f474e144e88 admin admin] PATH_INFO: `/v3/users/7225cc4c756d4cb6ba8bad6ab5f47f99` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:02.338884 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d525b-20ec-41a2-ba4d-4f474e144e88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7225cc4c756d4cb6ba8bad6ab5f47f99)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:24:02.341011 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40d525b-20ec-41a2-ba4d-4f474e144e88 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:24:02.405098 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-e40d525b-20ec-41a2-ba4d-4f474e144e88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7225cc4c756d4cb6ba8bad6ab5f47f99'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:02.423942 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-e40d525b-20ec-41a2-ba4d-4f474e144e88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7225cc4c756d4cb6ba8bad6ab5f47f99'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:02.424684 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-e40d525b-20ec-41a2-ba4d-4f474e144e88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7225cc4c756d4cb6ba8bad6ab5f47f99'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:02.425317 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-e40d525b-20ec-41a2-ba4d-4f474e144e88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7225cc4c756d4cb6ba8bad6ab5f47f99'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:02.433509 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-e40d525b-20ec-41a2-ba4d-4f474e144e88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7225cc4c756d4cb6ba8bad6ab5f47f99'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:02.446518 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1117/2250] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:24:02 2022] DELETE /identity/v3/users/7225cc4c756d4cb6ba8bad6ab5f47f99 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:24:02.452107 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1c4bc-4cbb-4eae-bc91-ebd224fa5d04 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:02.452455 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1c4bc-4cbb-4eae-bc91-ebd224fa5d04 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:02.452787 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90d1c4bc-4cbb-4eae-bc91-ebd224fa5d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:02.472199 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-90d1c4bc-4cbb-4eae-bc91-ebd224fa5d04 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:24:02.473439 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-90d1c4bc-4cbb-4eae-bc91-ebd224fa5d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:24:02.502816 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:24:02.535151 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1134/2251] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:24:02 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:24:02.544853 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d525b-20ec-41a2-ba4d-4f474e144e88 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:24:02.546272 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-e40d525b-20ec-41a2-ba4d-4f474e144e88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:24:02.604114 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40d525b-20ec-41a2-ba4d-4f474e144e88 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:24:02.607690 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39b224-d568-4531-b3c2-f6bab8d3de71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:24:02.608296 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39b224-d568-4531-b3c2-f6bab8d3de71 service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:02.608604 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39b224-d568-4531-b3c2-f6bab8d3de71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:02.608878 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c39b224-d568-4531-b3c2-f6bab8d3de71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:02.617776 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c39b224-d568-4531-b3c2-f6bab8d3de71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:24:02.619975 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c39b224-d568-4531-b3c2-f6bab8d3de71 service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:24:02.629217 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1118/2252] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:24:02 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:24:02.894478 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1c4bc-4cbb-4eae-bc91-ebd224fa5d04 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:24:02.896126 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-90d1c4bc-4cbb-4eae-bc91-ebd224fa5d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:24:02.908925 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90d1c4bc-4cbb-4eae-bc91-ebd224fa5d04 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:24:02.913616 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e7d8c7-6773-4561-b89e-a98b8435bc74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:24:02.914273 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7d8c7-6773-4561-b89e-a98b8435bc74 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:02.914554 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7d8c7-6773-4561-b89e-a98b8435bc74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:02.914861 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e7d8c7-6773-4561-b89e-a98b8435bc74 admin admin] PATH_INFO: `/v3/projects/e09f39345ccc4e879435869548a33d21` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:02.916676 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e7d8c7-6773-4561-b89e-a98b8435bc74 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e09f39345ccc4e879435869548a33d21)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:24:02.918748 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69e7d8c7-6773-4561-b89e-a98b8435bc74 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:24:02.965189 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-69e7d8c7-6773-4561-b89e-a98b8435bc74 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e09f39345ccc4e879435869548a33d21', 'request_id': 'req-69e7d8c7-6773-4561-b89e-a98b8435bc74'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:02.970936 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-69e7d8c7-6773-4561-b89e-a98b8435bc74 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e09f39345ccc4e879435869548a33d21', 'request_id': 'req-69e7d8c7-6773-4561-b89e-a98b8435bc74'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:02.978936 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-69e7d8c7-6773-4561-b89e-a98b8435bc74 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e09f39345ccc4e879435869548a33d21', 'request_id': 'req-69e7d8c7-6773-4561-b89e-a98b8435bc74'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:02.990048 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-69e7d8c7-6773-4561-b89e-a98b8435bc74 admin admin] The token cache is being invalidate because project e09f39345ccc4e879435869548a33d21 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:24:02.990339 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-69e7d8c7-6773-4561-b89e-a98b8435bc74 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:02.990967 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-69e7d8c7-6773-4561-b89e-a98b8435bc74 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:02.992514 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1135/2253] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:24:02 2022] DELETE /identity/v3/projects/e09f39345ccc4e879435869548a33d21 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:24:02.997226 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39b224-d568-4531-b3c2-f6bab8d3de71 service neutron] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:24:03.007230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c39b224-d568-4531-b3c2-f6bab8d3de71 service neutron] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:24:03.049575 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:24:03.066584 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f24ae783-6a9e-4860-adec-982cb9465d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:24:03.067227 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ae783-6a9e-4860-adec-982cb9465d71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:03.067509 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ae783-6a9e-4860-adec-982cb9465d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:03.067783 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f24ae783-6a9e-4860-adec-982cb9465d71 admin admin] PATH_INFO: `/v3/users/4a30d62160c54e56a84a2b370fea11bb` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:03.068965 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ae783-6a9e-4860-adec-982cb9465d71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4a30d62160c54e56a84a2b370fea11bb)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:24:03.070881 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f24ae783-6a9e-4860-adec-982cb9465d71 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:24:03.115112 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-f24ae783-6a9e-4860-adec-982cb9465d71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4a30d62160c54e56a84a2b370fea11bb'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:03.127250 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-f24ae783-6a9e-4860-adec-982cb9465d71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4a30d62160c54e56a84a2b370fea11bb'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:03.127906 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-f24ae783-6a9e-4860-adec-982cb9465d71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4a30d62160c54e56a84a2b370fea11bb'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:03.128535 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-f24ae783-6a9e-4860-adec-982cb9465d71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4a30d62160c54e56a84a2b370fea11bb'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:03.135519 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-f24ae783-6a9e-4860-adec-982cb9465d71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4a30d62160c54e56a84a2b370fea11bb'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:03.147272 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1119/2254] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:24:02 2022] DELETE /identity/v3/users/4a30d62160c54e56a84a2b370fea11bb => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:24:03.416662 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e7d8c7-6773-4561-b89e-a98b8435bc74 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:24:03.418312 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-69e7d8c7-6773-4561-b89e-a98b8435bc74 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:24:03.436763 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e7d8c7-6773-4561-b89e-a98b8435bc74 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:24:03.492070 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c616151a-df86-49d8-adf0-33729a7c5a12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:24:03.492740 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616151a-df86-49d8-adf0-33729a7c5a12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:03.493016 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616151a-df86-49d8-adf0-33729a7c5a12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:03.493288 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c616151a-df86-49d8-adf0-33729a7c5a12 admin admin] PATH_INFO: `/v3/projects/18db467702a54a8cb0ac7403acf70f44` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:03.495039 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616151a-df86-49d8-adf0-33729a7c5a12 admin admin] RBAC: Authorizing `identity:delete_project(project_id=18db467702a54a8cb0ac7403acf70f44)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:24:03.496968 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c616151a-df86-49d8-adf0-33729a7c5a12 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:24:03.542648 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c616151a-df86-49d8-adf0-33729a7c5a12 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '18db467702a54a8cb0ac7403acf70f44', 'request_id': 'req-c616151a-df86-49d8-adf0-33729a7c5a12'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:03.547910 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c616151a-df86-49d8-adf0-33729a7c5a12 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '18db467702a54a8cb0ac7403acf70f44', 'request_id': 'req-c616151a-df86-49d8-adf0-33729a7c5a12'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:03.549525 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:24:03.557233 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c616151a-df86-49d8-adf0-33729a7c5a12 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '18db467702a54a8cb0ac7403acf70f44', 'request_id': 'req-c616151a-df86-49d8-adf0-33729a7c5a12'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:03.569348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c616151a-df86-49d8-adf0-33729a7c5a12 admin admin] The token cache is being invalidate because project 18db467702a54a8cb0ac7403acf70f44 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:24:03.569631 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c616151a-df86-49d8-adf0-33729a7c5a12 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:03.570241 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c616151a-df86-49d8-adf0-33729a7c5a12 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:03.571714 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1136/2255] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:24:03 2022] DELETE /identity/v3/projects/18db467702a54a8cb0ac7403acf70f44 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:24:03.577170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb6667-5647-43ab-8629-f7968684bde2 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:03.577635 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb6667-5647-43ab-8629-f7968684bde2 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:03.577746 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bb6667-5647-43ab-8629-f7968684bde2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:03.600048 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-28bb6667-5647-43ab-8629-f7968684bde2 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:24:03.601302 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-28bb6667-5647-43ab-8629-f7968684bde2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:24:03.659972 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1120/2256] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:24:03.668310 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33dd325-04e7-40c8-8cf0-d39921fd5cf8 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:03.668622 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33dd325-04e7-40c8-8cf0-d39921fd5cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:03.668900 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33dd325-04e7-40c8-8cf0-d39921fd5cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:03.688154 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-c33dd325-04e7-40c8-8cf0-d39921fd5cf8 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:24:03.689378 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-c33dd325-04e7-40c8-8cf0-d39921fd5cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:24:03.697829 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1137/2257] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:24:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:24:03.702017 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb6667-5647-43ab-8629-f7968684bde2 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:24:03.711516 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bb6667-5647-43ab-8629-f7968684bde2 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:24:03.717013 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e46c30-9e8b-4fcf-9c48-b083f4d8f151 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:24:03.717863 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e46c30-9e8b-4fcf-9c48-b083f4d8f151 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:03.718154 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e46c30-9e8b-4fcf-9c48-b083f4d8f151 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:03.718424 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e46c30-9e8b-4fcf-9c48-b083f4d8f151 admin admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:03.719108 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e46c30-9e8b-4fcf-9c48-b083f4d8f151 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:24:03.719407 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e46c30-9e8b-4fcf-9c48-b083f4d8f151 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:24:03.721020 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e46c30-9e8b-4fcf-9c48-b083f4d8f151 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:24:03.732252 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1121/2258] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:24:03.736360 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33dd325-04e7-40c8-8cf0-d39921fd5cf8 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:24:03.745614 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33dd325-04e7-40c8-8cf0-d39921fd5cf8 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:24:03.750237 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311a309-07f1-4f1d-a8b2-d53f1f7eb7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:24:03.750831 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311a309-07f1-4f1d-a8b2-d53f1f7eb7ee admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:03.751107 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311a309-07f1-4f1d-a8b2-d53f1f7eb7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:03.751378 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1311a309-07f1-4f1d-a8b2-d53f1f7eb7ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:03.752030 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1311a309-07f1-4f1d-a8b2-d53f1f7eb7ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:24:03.754006 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1311a309-07f1-4f1d-a8b2-d53f1f7eb7ee admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:24:03.781142 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1138/2259] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:24:03 2022] POST /identity/v3/projects => generated 375 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:24:03.785175 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e46c30-9e8b-4fcf-9c48-b083f4d8f151 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:24:03.795693 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e46c30-9e8b-4fcf-9c48-b083f4d8f151 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:24:03.846963 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:24:03.859034 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cc1fc-1188-4dc3-84d0-896b4db91150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:24:03.859677 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cc1fc-1188-4dc3-84d0-896b4db91150 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:03.859960 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cc1fc-1188-4dc3-84d0-896b4db91150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:03.860238 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018cc1fc-1188-4dc3-84d0-896b4db91150 admin admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:03.860959 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018cc1fc-1188-4dc3-84d0-896b4db91150 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:24:03.862895 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018cc1fc-1188-4dc3-84d0-896b4db91150 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:24:03.883835 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1122/2260] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:24:03 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:24:03.888178 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311a309-07f1-4f1d-a8b2-d53f1f7eb7ee admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:24:03.898577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1311a309-07f1-4f1d-a8b2-d53f1f7eb7ee admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:24:03.903179 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745aa356-6849-4537-81d6-a954c75a831b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:24:03.903789 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745aa356-6849-4537-81d6-a954c75a831b admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:03.904070 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745aa356-6849-4537-81d6-a954c75a831b admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:03.904367 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745aa356-6849-4537-81d6-a954c75a831b admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:03.905068 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745aa356-6849-4537-81d6-a954c75a831b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:24:03.906860 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745aa356-6849-4537-81d6-a954c75a831b admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:24:03.917554 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1139/2261] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:24:03.921143 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cc1fc-1188-4dc3-84d0-896b4db91150 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:24:03.931067 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018cc1fc-1188-4dc3-84d0-896b4db91150 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:24:03.936402 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c2866-f1f8-426b-98c5-e5030c9d0ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:24:03.937014 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c2866-f1f8-426b-98c5-e5030c9d0ddf admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:03.937291 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c2866-f1f8-426b-98c5-e5030c9d0ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:03.937562 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c2866-f1f8-426b-98c5-e5030c9d0ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:03.938251 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c2866-f1f8-426b-98c5-e5030c9d0ddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:24:03.939828 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c2866-f1f8-426b-98c5-e5030c9d0ddf admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:24:03.950672 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1123/2262] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:24:03 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:24:03.954685 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745aa356-6849-4537-81d6-a954c75a831b admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:24:03.965233 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745aa356-6849-4537-81d6-a954c75a831b admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:24:03.970034 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aafbb4-0197-42f1-9b72-2340cba7cf94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:24:03.970680 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aafbb4-0197-42f1-9b72-2340cba7cf94 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:03.970964 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aafbb4-0197-42f1-9b72-2340cba7cf94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:03.971235 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1aafbb4-0197-42f1-9b72-2340cba7cf94 admin admin] PATH_INFO: `/v3/projects/0dc47ee6310d44d191d6d6df7a8a57b6/users/ae68a4992e474718ba04e8ccd736fcc5/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:03.986423 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aafbb4-0197-42f1-9b72-2340cba7cf94 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dc47ee6310d44d191d6d6df7a8a57b6, user_id=ae68a4992e474718ba04e8ccd736fcc5, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:24:03.989098 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1aafbb4-0197-42f1-9b72-2340cba7cf94 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:24:04.001862 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1140/2263] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:24:03 2022] PUT /identity/v3/projects/0dc47ee6310d44d191d6d6df7a8a57b6/users/ae68a4992e474718ba04e8ccd736fcc5/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:24:04.013528 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204341a1-206a-44e3-8716-2ec0d10c03dd None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:04.013811 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204341a1-206a-44e3-8716-2ec0d10c03dd None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:04.014089 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204341a1-206a-44e3-8716-2ec0d10c03dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:04.042445 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-204341a1-206a-44e3-8716-2ec0d10c03dd None None] MFA Rules not processed for user `ae68a4992e474718ba04e8ccd736fcc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:24:04.043643 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-204341a1-206a-44e3-8716-2ec0d10c03dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:24:04.107211 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1124/2264] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:24:04 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:24:04.117867 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aafbb4-0197-42f1-9b72-2340cba7cf94 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:24:04.119632 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-d1aafbb4-0197-42f1-9b72-2340cba7cf94 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:24:04.176716 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1aafbb4-0197-42f1-9b72-2340cba7cf94 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:24:04.180223 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c145cda7-80a5-4cbf-aa18-0432d1da67a3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:24:04.180862 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145cda7-80a5-4cbf-aa18-0432d1da67a3 service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:04.181185 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145cda7-80a5-4cbf-aa18-0432d1da67a3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:04.181611 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c145cda7-80a5-4cbf-aa18-0432d1da67a3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:04.189678 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145cda7-80a5-4cbf-aa18-0432d1da67a3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:24:04.191080 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c145cda7-80a5-4cbf-aa18-0432d1da67a3 service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:24:04.199948 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1141/2265] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:24:04 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:24:08.720728 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60302085-28a6-4e32-8c85-d89aa6b8513b None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:08.721268 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60302085-28a6-4e32-8c85-d89aa6b8513b None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:08.721268 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60302085-28a6-4e32-8c85-d89aa6b8513b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:08.742158 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-60302085-28a6-4e32-8c85-d89aa6b8513b None None] MFA Rules not processed for user `ae68a4992e474718ba04e8ccd736fcc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:24:08.743496 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-60302085-28a6-4e32-8c85-d89aa6b8513b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:24:08.750768 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1125/2266] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:24:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:24:14.195802 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:INSERT=3,keystone:DELETE=1,keystone:SELECT=57 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:24:18.735424 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=46,keystone:INSERT=3 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:24:29.690286 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559eab0-636b-4938-bac0-de8e547d0cf0 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:29.690872 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559eab0-636b-4938-bac0-de8e547d0cf0 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:29.690872 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f559eab0-636b-4938-bac0-de8e547d0cf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:29.712406 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-f559eab0-636b-4938-bac0-de8e547d0cf0 None None] MFA Rules not processed for user `36970f0778384576b599cd7217b5084d`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:24:29.714871 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-f559eab0-636b-4938-bac0-de8e547d0cf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:24:29.772432 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1142/2267] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Aug 5 02:24:29 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:24:29.785368 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60302085-28a6-4e32-8c85-d89aa6b8513b None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:24:29.787410 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-60302085-28a6-4e32-8c85-d89aa6b8513b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:24:29.871141 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66706de7-a957-453d-aec4-dbc39a9b6732 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:29.875643 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60302085-28a6-4e32-8c85-d89aa6b8513b None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:24:29.875984 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66706de7-a957-453d-aec4-dbc39a9b6732 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:29.876384 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66706de7-a957-453d-aec4-dbc39a9b6732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:29.881586 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-225c49c0-ba15-4c38-9a60-da1b4662b9b9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f03233b0ee3540cdb5105f6603cfdff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:24:29.882249 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c49c0-ba15-4c38-9a60-da1b4662b9b9 service swift] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:29.882530 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c49c0-ba15-4c38-9a60-da1b4662b9b9 service swift] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:29.882802 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225c49c0-ba15-4c38-9a60-da1b4662b9b9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:29.891913 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c49c0-ba15-4c38-9a60-da1b4662b9b9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:24:29.893511 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-225c49c0-ba15-4c38-9a60-da1b4662b9b9 service swift] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:24:29.896021 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-66706de7-a957-453d-aec4-dbc39a9b6732 None None] MFA Rules not processed for user `600f51be8202427fb3691db566ed2ff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:24:29.897246 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-66706de7-a957-453d-aec4-dbc39a9b6732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:24:29.901997 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1126/2268] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Aug 5 02:24:29 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 02:24:29.967791 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1143/2269] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:24:29 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:24:30.516623 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012fa5ff-f7be-4391-b6d3-02563aa1a4a6 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:30.516943 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012fa5ff-f7be-4391-b6d3-02563aa1a4a6 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:30.517175 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012fa5ff-f7be-4391-b6d3-02563aa1a4a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:30.536588 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-012fa5ff-f7be-4391-b6d3-02563aa1a4a6 None None] MFA Rules not processed for user `36970f0778384576b599cd7217b5084d`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:24:30.538206 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-012fa5ff-f7be-4391-b6d3-02563aa1a4a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:24:30.546054 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1127/2270] 10.222.0.15 () {58 vars in 967 bytes} [Fri Aug 5 02:24:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:24:30.566800 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66706de7-a957-453d-aec4-dbc39a9b6732 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:24:30.579007 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66706de7-a957-453d-aec4-dbc39a9b6732 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:24:30.585413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11798e3-3dca-4c0c-9ba3-93011744f27d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f03233b0ee3540cdb5105f6603cfdff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:24:30.586034 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11798e3-3dca-4c0c-9ba3-93011744f27d service swift] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:30.586321 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11798e3-3dca-4c0c-9ba3-93011744f27d service swift] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:30.586598 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a11798e3-3dca-4c0c-9ba3-93011744f27d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:30.597229 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11798e3-3dca-4c0c-9ba3-93011744f27d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:24:30.599065 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a11798e3-3dca-4c0c-9ba3-93011744f27d service swift] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:24:30.608096 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1144/2271] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Aug 5 02:24:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 02:24:30.879347 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14824f-6da1-4145-9107-8090e77812ae None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:30.879807 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14824f-6da1-4145-9107-8090e77812ae None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:30.879897 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea14824f-6da1-4145-9107-8090e77812ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:30.899273 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-ea14824f-6da1-4145-9107-8090e77812ae None None] MFA Rules not processed for user `36970f0778384576b599cd7217b5084d`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:24:30.901330 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-ea14824f-6da1-4145-9107-8090e77812ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:24:30.909665 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1128/2272] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Aug 5 02:24:30 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:24:30.921938 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11798e3-3dca-4c0c-9ba3-93011744f27d service swift] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:24:30.934886 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a11798e3-3dca-4c0c-9ba3-93011744f27d service swift] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:24:30.940849 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13a6d6-87e4-4c86-8b44-eff3e94765f6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f03233b0ee3540cdb5105f6603cfdff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:24:30.941469 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13a6d6-87e4-4c86-8b44-eff3e94765f6 service swift] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:30.941754 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13a6d6-87e4-4c86-8b44-eff3e94765f6 service swift] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:30.942032 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf13a6d6-87e4-4c86-8b44-eff3e94765f6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:30.952101 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf13a6d6-87e4-4c86-8b44-eff3e94765f6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:24:30.953717 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf13a6d6-87e4-4c86-8b44-eff3e94765f6 service swift] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:24:30.962354 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1145/2273] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Aug 5 02:24:30 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 02:24:31.317942 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dddc60-a0f2-40ed-a21a-b89dd528b3b6 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:31.318150 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dddc60-a0f2-40ed-a21a-b89dd528b3b6 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:31.318422 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55dddc60-a0f2-40ed-a21a-b89dd528b3b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:31.343085 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-55dddc60-a0f2-40ed-a21a-b89dd528b3b6 None None] MFA Rules not processed for user `36970f0778384576b599cd7217b5084d`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:24:31.345264 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-55dddc60-a0f2-40ed-a21a-b89dd528b3b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:24:31.354104 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1129/2274] 10.222.0.15 () {58 vars in 967 bytes} [Fri Aug 5 02:24:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:24:31.367528 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13a6d6-87e4-4c86-8b44-eff3e94765f6 service swift] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:24:31.378968 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf13a6d6-87e4-4c86-8b44-eff3e94765f6 service swift] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:24:31.385615 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01435167-31dd-439e-aad0-e8aaa068cc9a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f03233b0ee3540cdb5105f6603cfdff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:24:31.386359 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01435167-31dd-439e-aad0-e8aaa068cc9a service swift] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:31.386705 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01435167-31dd-439e-aad0-e8aaa068cc9a service swift] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:31.387044 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01435167-31dd-439e-aad0-e8aaa068cc9a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:31.395773 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01435167-31dd-439e-aad0-e8aaa068cc9a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:24:31.397560 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01435167-31dd-439e-aad0-e8aaa068cc9a service swift] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:24:31.411000 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1146/2275] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Aug 5 02:24:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 02:24:33.721273 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dddc60-a0f2-40ed-a21a-b89dd528b3b6 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:24:33.793900 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55dddc60-a0f2-40ed-a21a-b89dd528b3b6 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:24:33.799601 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9d82f-c0b1-4d3f-a0e8-d170374ac9c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:24:33.800248 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9d82f-c0b1-4d3f-a0e8-d170374ac9c3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:33.800661 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9d82f-c0b1-4d3f-a0e8-d170374ac9c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:33.801100 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b9d82f-c0b1-4d3f-a0e8-d170374ac9c3 admin admin] PATH_INFO: `/v3/users/ae68a4992e474718ba04e8ccd736fcc5` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:33.802343 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b9d82f-c0b1-4d3f-a0e8-d170374ac9c3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ae68a4992e474718ba04e8ccd736fcc5)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:24:33.804974 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b9d82f-c0b1-4d3f-a0e8-d170374ac9c3 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:24:33.864626 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-b8b9d82f-c0b1-4d3f-a0e8-d170374ac9c3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ae68a4992e474718ba04e8ccd736fcc5'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:33.877406 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-b8b9d82f-c0b1-4d3f-a0e8-d170374ac9c3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ae68a4992e474718ba04e8ccd736fcc5'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:33.878316 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-b8b9d82f-c0b1-4d3f-a0e8-d170374ac9c3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ae68a4992e474718ba04e8ccd736fcc5'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:33.879078 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-b8b9d82f-c0b1-4d3f-a0e8-d170374ac9c3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ae68a4992e474718ba04e8ccd736fcc5'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:33.886968 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-b8b9d82f-c0b1-4d3f-a0e8-d170374ac9c3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ae68a4992e474718ba04e8ccd736fcc5'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:33.888551 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:24:33.902812 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1130/2276] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:24:33 2022] DELETE /identity/v3/users/ae68a4992e474718ba04e8ccd736fcc5 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:24:33.907348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a44e4-4865-4434-9c5f-5ca61b9cb90f None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:33.907826 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a44e4-4865-4434-9c5f-5ca61b9cb90f None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:33.907924 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745a44e4-4865-4434-9c5f-5ca61b9cb90f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:33.928307 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-745a44e4-4865-4434-9c5f-5ca61b9cb90f None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:24:33.929202 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-745a44e4-4865-4434-9c5f-5ca61b9cb90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:24:33.994802 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1147/2277] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:24:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:24:34.004564 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9d82f-c0b1-4d3f-a0e8-d170374ac9c3 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:24:34.005969 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-b8b9d82f-c0b1-4d3f-a0e8-d170374ac9c3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:24:34.073254 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b9d82f-c0b1-4d3f-a0e8-d170374ac9c3 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:24:34.077486 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893de27-1d0f-4d2e-b53a-1d1cc713c364 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:24:34.078103 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893de27-1d0f-4d2e-b53a-1d1cc713c364 service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:34.078380 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893de27-1d0f-4d2e-b53a-1d1cc713c364 service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:34.078747 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f893de27-1d0f-4d2e-b53a-1d1cc713c364 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:34.089488 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893de27-1d0f-4d2e-b53a-1d1cc713c364 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:24:34.091338 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f893de27-1d0f-4d2e-b53a-1d1cc713c364 service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:24:34.106717 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1131/2278] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:24:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:24:34.336834 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a44e4-4865-4434-9c5f-5ca61b9cb90f None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:24:34.338521 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-745a44e4-4865-4434-9c5f-5ca61b9cb90f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:24:34.351104 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745a44e4-4865-4434-9c5f-5ca61b9cb90f None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:24:34.357453 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61ffc30-030d-422d-a963-4ee86a5e22cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:24:34.358114 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ffc30-030d-422d-a963-4ee86a5e22cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:34.358394 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ffc30-030d-422d-a963-4ee86a5e22cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:34.358668 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61ffc30-030d-422d-a963-4ee86a5e22cf admin admin] PATH_INFO: `/v3/projects/0dc47ee6310d44d191d6d6df7a8a57b6` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:34.359868 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61ffc30-030d-422d-a963-4ee86a5e22cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dc47ee6310d44d191d6d6df7a8a57b6)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:24:34.361837 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61ffc30-030d-422d-a963-4ee86a5e22cf admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:24:34.371207 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:24:34.409274 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-f61ffc30-030d-422d-a963-4ee86a5e22cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dc47ee6310d44d191d6d6df7a8a57b6', 'request_id': 'req-f61ffc30-030d-422d-a963-4ee86a5e22cf'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:34.415035 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-f61ffc30-030d-422d-a963-4ee86a5e22cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dc47ee6310d44d191d6d6df7a8a57b6', 'request_id': 'req-f61ffc30-030d-422d-a963-4ee86a5e22cf'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:34.423344 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-f61ffc30-030d-422d-a963-4ee86a5e22cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dc47ee6310d44d191d6d6df7a8a57b6', 'request_id': 'req-f61ffc30-030d-422d-a963-4ee86a5e22cf'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:34.435118 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-f61ffc30-030d-422d-a963-4ee86a5e22cf admin admin] The token cache is being invalidate because project 0dc47ee6310d44d191d6d6df7a8a57b6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:24:34.435406 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-f61ffc30-030d-422d-a963-4ee86a5e22cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:34.436034 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-f61ffc30-030d-422d-a963-4ee86a5e22cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:34.437557 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1148/2279] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:24:34 2022] DELETE /identity/v3/projects/0dc47ee6310d44d191d6d6df7a8a57b6 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:24:44.097202 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=31 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:24:44.431455 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=22,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:24:45.789682 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893de27-1d0f-4d2e-b53a-1d1cc713c364 service neutron] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:24:45.791099 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-f893de27-1d0f-4d2e-b53a-1d1cc713c364 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:24:45.803628 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f893de27-1d0f-4d2e-b53a-1d1cc713c364 service neutron] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:24:45.859614 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d9dbee-0f95-467e-b986-80bc84d32f97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:24:45.860249 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9dbee-0f95-467e-b986-80bc84d32f97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:45.860562 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9dbee-0f95-467e-b986-80bc84d32f97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:45.860841 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d9dbee-0f95-467e-b986-80bc84d32f97 admin admin] PATH_INFO: `/v3/users/35aa8d4be50a486988ecfb9e55d3b045` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:45.862007 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d9dbee-0f95-467e-b986-80bc84d32f97 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35aa8d4be50a486988ecfb9e55d3b045)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:24:45.863927 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d9dbee-0f95-467e-b986-80bc84d32f97 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:24:45.911241 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-17d9dbee-0f95-467e-b986-80bc84d32f97 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35aa8d4be50a486988ecfb9e55d3b045'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:45.923699 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-17d9dbee-0f95-467e-b986-80bc84d32f97 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35aa8d4be50a486988ecfb9e55d3b045'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:45.924416 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-17d9dbee-0f95-467e-b986-80bc84d32f97 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35aa8d4be50a486988ecfb9e55d3b045'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:45.925173 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-17d9dbee-0f95-467e-b986-80bc84d32f97 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35aa8d4be50a486988ecfb9e55d3b045'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:45.933477 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-17d9dbee-0f95-467e-b986-80bc84d32f97 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35aa8d4be50a486988ecfb9e55d3b045'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:45.945720 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1132/2280] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:24:45 2022] DELETE /identity/v3/users/35aa8d4be50a486988ecfb9e55d3b045 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:24:45.950920 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b991d4d-dbf1-45be-bf44-2aa069800442 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:45.951422 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b991d4d-dbf1-45be-bf44-2aa069800442 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:45.951520 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b991d4d-dbf1-45be-bf44-2aa069800442 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:45.971158 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-7b991d4d-dbf1-45be-bf44-2aa069800442 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:24:45.972386 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-7b991d4d-dbf1-45be-bf44-2aa069800442 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:24:46.040475 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1149/2281] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:24:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:24:46.059396 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d9dbee-0f95-467e-b986-80bc84d32f97 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:24:46.061248 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-17d9dbee-0f95-467e-b986-80bc84d32f97 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:24:46.143849 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d9dbee-0f95-467e-b986-80bc84d32f97 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:24:46.148633 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187aa0a7-b1d7-4dc1-961d-e69e71e5ec14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:24:46.149275 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187aa0a7-b1d7-4dc1-961d-e69e71e5ec14 service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:46.149558 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187aa0a7-b1d7-4dc1-961d-e69e71e5ec14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:46.149832 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-187aa0a7-b1d7-4dc1-961d-e69e71e5ec14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:46.160636 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187aa0a7-b1d7-4dc1-961d-e69e71e5ec14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:24:46.162266 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-187aa0a7-b1d7-4dc1-961d-e69e71e5ec14 service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:24:46.173182 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1133/2282] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:24:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:24:46.337050 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc38a9-108e-4984-a073-54873a148884 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:46.337344 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc38a9-108e-4984-a073-54873a148884 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:46.337627 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cc38a9-108e-4984-a073-54873a148884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:46.358917 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-d1cc38a9-108e-4984-a073-54873a148884 None None] MFA Rules not processed for user `36970f0778384576b599cd7217b5084d`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:24:46.360134 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-d1cc38a9-108e-4984-a073-54873a148884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:24:46.438544 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1150/2283] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Aug 5 02:24:46 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:24:46.462386 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187aa0a7-b1d7-4dc1-961d-e69e71e5ec14 service neutron] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:24:46.465338 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-187aa0a7-b1d7-4dc1-961d-e69e71e5ec14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:24:46.498801 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:24:46.550813 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-187aa0a7-b1d7-4dc1-961d-e69e71e5ec14 service neutron] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:24:46.555807 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6ed0a4-b4df-48e4-a99d-2c06960e4b20 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f03233b0ee3540cdb5105f6603cfdff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:24:46.556584 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ed0a4-b4df-48e4-a99d-2c06960e4b20 service swift] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:46.557057 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ed0a4-b4df-48e4-a99d-2c06960e4b20 service swift] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:46.557502 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6ed0a4-b4df-48e4-a99d-2c06960e4b20 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:46.567079 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ed0a4-b4df-48e4-a99d-2c06960e4b20 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:24:46.568980 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6ed0a4-b4df-48e4-a99d-2c06960e4b20 service swift] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:24:46.578885 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1134/2284] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Aug 5 02:24:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 02:24:46.804566 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc38a9-108e-4984-a073-54873a148884 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:24:46.806103 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-d1cc38a9-108e-4984-a073-54873a148884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:24:46.839484 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cc38a9-108e-4984-a073-54873a148884 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:24:46.850535 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51a55bbb-c4af-4f32-8529-f20db982c67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:24:46.851493 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a55bbb-c4af-4f32-8529-f20db982c67e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:24:46.851776 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a55bbb-c4af-4f32-8529-f20db982c67e admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:24:46.852074 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51a55bbb-c4af-4f32-8529-f20db982c67e admin admin] PATH_INFO: `/v3/projects/658bcc8ba8094676a94c09b1bf474604` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:24:46.856692 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a55bbb-c4af-4f32-8529-f20db982c67e admin admin] RBAC: Authorizing `identity:delete_project(project_id=658bcc8ba8094676a94c09b1bf474604)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:24:46.860013 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51a55bbb-c4af-4f32-8529-f20db982c67e admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:24:46.926939 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-51a55bbb-c4af-4f32-8529-f20db982c67e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '658bcc8ba8094676a94c09b1bf474604', 'request_id': 'req-51a55bbb-c4af-4f32-8529-f20db982c67e'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:46.934051 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-51a55bbb-c4af-4f32-8529-f20db982c67e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '658bcc8ba8094676a94c09b1bf474604', 'request_id': 'req-51a55bbb-c4af-4f32-8529-f20db982c67e'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:46.946135 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-51a55bbb-c4af-4f32-8529-f20db982c67e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '658bcc8ba8094676a94c09b1bf474604', 'request_id': 'req-51a55bbb-c4af-4f32-8529-f20db982c67e'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:46.960221 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-51a55bbb-c4af-4f32-8529-f20db982c67e admin admin] The token cache is being invalidate because project 658bcc8ba8094676a94c09b1bf474604 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:24:46.960928 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-51a55bbb-c4af-4f32-8529-f20db982c67e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:46.961532 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-51a55bbb-c4af-4f32-8529-f20db982c67e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:24:46.964052 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1151/2285] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:24:46 2022] DELETE /identity/v3/projects/658bcc8ba8094676a94c09b1bf474604 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:24:56.575394 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=22 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:24:56.956584 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=79,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:25:00.339887 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bda343-e5a6-4e0d-ba5b-9822f00abb04 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:25:00.340504 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bda343-e5a6-4e0d-ba5b-9822f00abb04 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:25:00.340611 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bda343-e5a6-4e0d-ba5b-9822f00abb04 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:25:00.342293 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1135/2286] 10.222.0.15 () {54 vars in 921 bytes} [Fri Aug 5 02:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 05 02:25:00.348719 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd6673-75da-48e1-8997-b77c1aeff0a0 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:25:00.349235 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd6673-75da-48e1-8997-b77c1aeff0a0 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:25:00.349347 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ebd6673-75da-48e1-8997-b77c1aeff0a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:25:00.370001 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-7ebd6673-75da-48e1-8997-b77c1aeff0a0 None None] MFA Rules not processed for user `4b5c0958604b436daa44b1f67c9dec26`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:25:00.371255 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-7ebd6673-75da-48e1-8997-b77c1aeff0a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:25:00.448426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1152/2287] 10.222.0.15 () {58 vars in 1018 bytes} [Fri Aug 5 02:25:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:25:00.459876 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bda343-e5a6-4e0d-ba5b-9822f00abb04 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:25:00.461618 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-35bda343-e5a6-4e0d-ba5b-9822f00abb04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:25:00.521326 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bda343-e5a6-4e0d-ba5b-9822f00abb04 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:25:00.524797 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250e4819-a412-4ce5-9c99-ce09248da304 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c09080c507f4c35b81d482cfbaa6a88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:25:00.525393 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e4819-a412-4ce5-9c99-ce09248da304 service glance] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:25:00.525669 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e4819-a412-4ce5-9c99-ce09248da304 service glance] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:25:00.525937 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250e4819-a412-4ce5-9c99-ce09248da304 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:25:00.535747 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e4819-a412-4ce5-9c99-ce09248da304 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:25:00.537188 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250e4819-a412-4ce5-9c99-ce09248da304 service glance] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:25:00.547822 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1136/2288] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:25:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:25:00.617918 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daff06b-b871-4904-87c2-2959b80bf044 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:25:00.618750 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daff06b-b871-4904-87c2-2959b80bf044 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:25:00.619126 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3daff06b-b871-4904-87c2-2959b80bf044 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:25:00.620548 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1153/2289] 10.222.0.15 () {54 vars in 921 bytes} [Fri Aug 5 02:25:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:25:00.625320 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df3e9f-98e1-4171-a826-bca403b5d026 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:25:00.625605 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df3e9f-98e1-4171-a826-bca403b5d026 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:25:00.625875 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df3e9f-98e1-4171-a826-bca403b5d026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:25:00.645967 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-b7df3e9f-98e1-4171-a826-bca403b5d026 None None] MFA Rules not processed for user `f81daf3da9b34e7380c61005019a53bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:25:00.647169 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-b7df3e9f-98e1-4171-a826-bca403b5d026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:25:00.696155 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1137/2290] 10.222.0.15 () {58 vars in 1018 bytes} [Fri Aug 5 02:25:00 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:25:00.708408 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daff06b-b871-4904-87c2-2959b80bf044 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:25:00.710126 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-3daff06b-b871-4904-87c2-2959b80bf044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:25:00.723500 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3daff06b-b871-4904-87c2-2959b80bf044 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:25:00.726913 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cbdc052-7cd1-463e-904c-36709e17844c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:25:00.727513 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdc052-7cd1-463e-904c-36709e17844c service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:25:00.727920 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdc052-7cd1-463e-904c-36709e17844c service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:25:00.727920 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbdc052-7cd1-463e-904c-36709e17844c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:25:00.734940 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbdc052-7cd1-463e-904c-36709e17844c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:25:00.736366 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cbdc052-7cd1-463e-904c-36709e17844c service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:25:00.744458 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1154/2291] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:25:00 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:25:00.828078 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2498e-dcf1-4e14-81a5-6eb6f3eed05d None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:25:00.828459 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2498e-dcf1-4e14-81a5-6eb6f3eed05d None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:25:00.828801 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e2498e-dcf1-4e14-81a5-6eb6f3eed05d None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:25:00.830233 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1138/2292] 10.222.0.15 () {54 vars in 921 bytes} [Fri Aug 5 02:25:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:25:00.835559 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b0cf1-499a-4249-a355-f7bb3dcb5d1d None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:25:00.835841 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b0cf1-499a-4249-a355-f7bb3dcb5d1d None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:25:00.836113 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74b0cf1-499a-4249-a355-f7bb3dcb5d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:25:00.856249 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-e74b0cf1-499a-4249-a355-f7bb3dcb5d1d None None] MFA Rules not processed for user `4b5c0958604b436daa44b1f67c9dec26`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:25:00.857560 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-e74b0cf1-499a-4249-a355-f7bb3dcb5d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:25:00.867416 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1155/2293] 10.222.0.15 () {58 vars in 1018 bytes} [Fri Aug 5 02:25:00 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:25:00.880160 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2498e-dcf1-4e14-81a5-6eb6f3eed05d None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:25:00.892463 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e2498e-dcf1-4e14-81a5-6eb6f3eed05d None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:25:00.896076 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1a69f-2a5e-41c1-a2fe-ba370f986e90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:25:00.896706 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1a69f-2a5e-41c1-a2fe-ba370f986e90 service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:25:00.896990 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1a69f-2a5e-41c1-a2fe-ba370f986e90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:25:00.897265 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9e1a69f-2a5e-41c1-a2fe-ba370f986e90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:25:00.907497 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e1a69f-2a5e-41c1-a2fe-ba370f986e90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:25:00.908964 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9e1a69f-2a5e-41c1-a2fe-ba370f986e90 service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:25:00.920070 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1139/2294] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:25:00 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:25:03.778631 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aba727-abe4-49e8-8793-d3ea474abcd1 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:25:03.779102 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aba727-abe4-49e8-8793-d3ea474abcd1 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:25:03.779207 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69aba727-abe4-49e8-8793-d3ea474abcd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:25:03.798082 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-69aba727-abe4-49e8-8793-d3ea474abcd1 None None] MFA Rules not processed for user `36970f0778384576b599cd7217b5084d`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:25:03.799198 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-69aba727-abe4-49e8-8793-d3ea474abcd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:25:03.855499 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1156/2295] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Aug 5 02:25:03 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:25:03.867468 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1a69f-2a5e-41c1-a2fe-ba370f986e90 service neutron] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:25:03.869520 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-c9e1a69f-2a5e-41c1-a2fe-ba370f986e90 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:25:03.939822 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9e1a69f-2a5e-41c1-a2fe-ba370f986e90 service neutron] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:25:03.944790 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e58ee-8373-4314-918c-83437079693e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f03233b0ee3540cdb5105f6603cfdff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:25:03.945398 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e58ee-8373-4314-918c-83437079693e service swift] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:25:03.945676 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e58ee-8373-4314-918c-83437079693e service swift] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:25:03.945945 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989e58ee-8373-4314-918c-83437079693e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:25:03.954268 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e58ee-8373-4314-918c-83437079693e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:25:03.955845 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989e58ee-8373-4314-918c-83437079693e service swift] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:25:03.964816 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1140/2296] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Aug 5 02:25:03 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 02:25:13.578400 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aba727-abe4-49e8-8793-d3ea474abcd1 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:25:13.587741 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69aba727-abe4-49e8-8793-d3ea474abcd1 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:25:13.592389 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d2f2d-f61e-4cf3-8b68-167d8ccb4955 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:25:13.592999 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d2f2d-f61e-4cf3-8b68-167d8ccb4955 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:25:13.593275 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d2f2d-f61e-4cf3-8b68-167d8ccb4955 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:25:13.593543 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6d2f2d-f61e-4cf3-8b68-167d8ccb4955 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:25:13.595303 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-6e6d2f2d-f61e-4cf3-8b68-167d8ccb4955 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:25:13.611845 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d2f2d-f61e-4cf3-8b68-167d8ccb4955 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:25:13.613413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6d2f2d-f61e-4cf3-8b68-167d8ccb4955 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:25:13.637381 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1157/2297] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:25:13 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:25:13.960656 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=87 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:25:15.773044 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e58ee-8373-4314-918c-83437079693e service swift] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:25:15.774604 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-989e58ee-8373-4314-918c-83437079693e service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:25:15.790323 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989e58ee-8373-4314-918c-83437079693e service swift] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:25:15.794638 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7fe2f3-7108-4691-825e-c9c9872b4c2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:25:15.795277 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fe2f3-7108-4691-825e-c9c9872b4c2d service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:25:15.795552 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fe2f3-7108-4691-825e-c9c9872b4c2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:25:15.795823 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7fe2f3-7108-4691-825e-c9c9872b4c2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:25:15.797607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-2e7fe2f3-7108-4691-825e-c9c9872b4c2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:25:15.812172 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7fe2f3-7108-4691-825e-c9c9872b4c2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:25:15.813737 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7fe2f3-7108-4691-825e-c9c9872b4c2d service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:25:15.825507 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1141/2298] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:25:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:25:23.620915 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=71 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:25:25.819945 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=6 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:25:34.547234 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d2f2d-f61e-4cf3-8b68-167d8ccb4955 service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:25:34.557417 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6d2f2d-f61e-4cf3-8b68-167d8ccb4955 service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:25:34.561028 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f79eb6-f3a5-431f-99e1-f5962cd6acbf service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c09080c507f4c35b81d482cfbaa6a88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:25:34.561634 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f79eb6-f3a5-431f-99e1-f5962cd6acbf service glance] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:25:34.561913 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f79eb6-f3a5-431f-99e1-f5962cd6acbf service glance] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:25:34.562189 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f79eb6-f3a5-431f-99e1-f5962cd6acbf service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:25:34.563935 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-76f79eb6-f3a5-431f-99e1-f5962cd6acbf service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:25:34.599803 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7fe2f3-7108-4691-825e-c9c9872b4c2d service neutron] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:25:34.601858 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-2e7fe2f3-7108-4691-825e-c9c9872b4c2d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:25:34.616314 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7fe2f3-7108-4691-825e-c9c9872b4c2d service neutron] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:25:34.622281 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df14282-2a89-4a5e-8bfa-3cc4adc0084e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:25:34.622877 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df14282-2a89-4a5e-8bfa-3cc4adc0084e service nova] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:25:34.623158 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df14282-2a89-4a5e-8bfa-3cc4adc0084e service nova] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:25:34.623426 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df14282-2a89-4a5e-8bfa-3cc4adc0084e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:25:34.624187 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f79eb6-f3a5-431f-99e1-f5962cd6acbf service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:25:34.625687 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f79eb6-f3a5-431f-99e1-f5962cd6acbf service glance] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:25:34.631477 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df14282-2a89-4a5e-8bfa-3cc4adc0084e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:25:34.633145 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df14282-2a89-4a5e-8bfa-3cc4adc0084e service nova] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:25:34.635053 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1158/2299] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:25:34 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:25:34.642468 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1142/2300] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:25:34 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:25:34.668838 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3dbed-6098-4aeb-9a44-1f63eca750be None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:25:34.669285 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3dbed-6098-4aeb-9a44-1f63eca750be None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:25:34.669572 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af3dbed-6098-4aeb-9a44-1f63eca750be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:25:34.689031 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-3af3dbed-6098-4aeb-9a44-1f63eca750be None None] MFA Rules not processed for user `36970f0778384576b599cd7217b5084d`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:25:34.690247 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-3af3dbed-6098-4aeb-9a44-1f63eca750be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:25:34.697669 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1159/2301] 10.222.0.15 () {58 vars in 967 bytes} [Fri Aug 5 02:25:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:25:34.709993 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df14282-2a89-4a5e-8bfa-3cc4adc0084e service nova] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:25:34.722228 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df14282-2a89-4a5e-8bfa-3cc4adc0084e service nova] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:25:34.727208 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921eb9be-42c8-4c5c-943d-b3fb21bb3953 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f03233b0ee3540cdb5105f6603cfdff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:25:34.727846 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921eb9be-42c8-4c5c-943d-b3fb21bb3953 service swift] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:25:34.728157 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921eb9be-42c8-4c5c-943d-b3fb21bb3953 service swift] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:25:34.729221 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-921eb9be-42c8-4c5c-943d-b3fb21bb3953 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:25:34.737776 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921eb9be-42c8-4c5c-943d-b3fb21bb3953 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:25:34.739368 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-921eb9be-42c8-4c5c-943d-b3fb21bb3953 service swift] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:25:34.748078 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1143/2302] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Aug 5 02:25:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 02:25:38.099527 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3dbed-6098-4aeb-9a44-1f63eca750be None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:25:38.101499 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-3af3dbed-6098-4aeb-9a44-1f63eca750be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:25:38.117198 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af3dbed-6098-4aeb-9a44-1f63eca750be None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:25:38.122570 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85efb34-ddfd-474c-96b0-b4ef66981a32 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:25:38.123179 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85efb34-ddfd-474c-96b0-b4ef66981a32 service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:25:38.123460 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85efb34-ddfd-474c-96b0-b4ef66981a32 service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:25:38.123735 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85efb34-ddfd-474c-96b0-b4ef66981a32 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:25:38.125464 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-b85efb34-ddfd-474c-96b0-b4ef66981a32 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:25:38.183061 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85efb34-ddfd-474c-96b0-b4ef66981a32 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:25:38.184642 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85efb34-ddfd-474c-96b0-b4ef66981a32 service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:25:38.193489 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1160/2303] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:25:38 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:25:44.744418 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=12 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:25:48.189295 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=59 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:26:00.715322 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921eb9be-42c8-4c5c-943d-b3fb21bb3953 service swift] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:26:00.728448 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-921eb9be-42c8-4c5c-943d-b3fb21bb3953 service swift] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:26:00.734569 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7510c33b-2923-4640-9244-0b231f7951a8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:26:00.735177 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510c33b-2923-4640-9244-0b231f7951a8 service nova] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:26:00.735454 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510c33b-2923-4640-9244-0b231f7951a8 service nova] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:26:00.735723 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7510c33b-2923-4640-9244-0b231f7951a8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:26:00.737513 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-7510c33b-2923-4640-9244-0b231f7951a8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:26:00.799603 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7510c33b-2923-4640-9244-0b231f7951a8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:26:00.801231 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7510c33b-2923-4640-9244-0b231f7951a8 service nova] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:26:00.811212 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1144/2304] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:26:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:26:05.860908 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85efb34-ddfd-474c-96b0-b4ef66981a32 service nova] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:26:05.870661 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85efb34-ddfd-474c-96b0-b4ef66981a32 service nova] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:26:05.874276 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503dd11-728d-4719-9857-0ccb9371ee7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:26:05.874887 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503dd11-728d-4719-9857-0ccb9371ee7d service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:26:05.875168 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503dd11-728d-4719-9857-0ccb9371ee7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:26:05.875441 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3503dd11-728d-4719-9857-0ccb9371ee7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:26:05.877192 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-3503dd11-728d-4719-9857-0ccb9371ee7d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:26:05.887640 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3503dd11-728d-4719-9857-0ccb9371ee7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:26:05.889071 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3503dd11-728d-4719-9857-0ccb9371ee7d service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:26:05.897023 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1161/2305] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:26:05 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:26:08.758147 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea38f9f-b671-4bd4-9dd9-30fa06a005b0 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:26:08.758657 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea38f9f-b671-4bd4-9dd9-30fa06a005b0 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:26:08.758782 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ea38f9f-b671-4bd4-9dd9-30fa06a005b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:26:08.778682 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-4ea38f9f-b671-4bd4-9dd9-30fa06a005b0 None None] MFA Rules not processed for user `5bf84408a3984972a5bb68a3117c0501`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:26:08.779881 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-4ea38f9f-b671-4bd4-9dd9-30fa06a005b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:26:08.786644 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1145/2306] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:26:08 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:26:15.243909 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503dd11-728d-4719-9857-0ccb9371ee7d service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:26:15.258243 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3503dd11-728d-4719-9857-0ccb9371ee7d service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:26:15.264783 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8064e5-a03c-4a9a-be04-5d1686d8d1de service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:26:15.265411 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8064e5-a03c-4a9a-be04-5d1686d8d1de service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:26:15.265688 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8064e5-a03c-4a9a-be04-5d1686d8d1de service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:26:15.265970 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8064e5-a03c-4a9a-be04-5d1686d8d1de service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:26:15.268974 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-da8064e5-a03c-4a9a-be04-5d1686d8d1de service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:26:15.281198 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8064e5-a03c-4a9a-be04-5d1686d8d1de service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:26:15.282810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8064e5-a03c-4a9a-be04-5d1686d8d1de service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:26:15.294602 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1162/2307] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:26:15 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:26:17.769126 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea38f9f-b671-4bd4-9dd9-30fa06a005b0 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:26:17.783569 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ea38f9f-b671-4bd4-9dd9-30fa06a005b0 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:26:17.789596 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf755baf-87f0-46e4-b39b-6cb227a9f538 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:26:17.790216 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf755baf-87f0-46e4-b39b-6cb227a9f538 service nova] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:26:17.790701 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf755baf-87f0-46e4-b39b-6cb227a9f538 service nova] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:26:17.790981 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf755baf-87f0-46e4-b39b-6cb227a9f538 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:26:17.793045 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-bf755baf-87f0-46e4-b39b-6cb227a9f538 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:26:17.858590 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf755baf-87f0-46e4-b39b-6cb227a9f538 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:26:17.860238 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf755baf-87f0-46e4-b39b-6cb227a9f538 service nova] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:26:17.869295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1146/2308] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:26:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:26:21.370235 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8064e5-a03c-4a9a-be04-5d1686d8d1de service nova] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:26:21.384622 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8064e5-a03c-4a9a-be04-5d1686d8d1de service nova] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:26:21.391806 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c586bb-9bfb-452d-9300-424ea4937f08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:26:21.392555 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c586bb-9bfb-452d-9300-424ea4937f08 service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:26:21.392907 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c586bb-9bfb-452d-9300-424ea4937f08 service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:26:21.393232 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c586bb-9bfb-452d-9300-424ea4937f08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:26:21.395297 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-b5c586bb-9bfb-452d-9300-424ea4937f08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:26:21.409715 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c586bb-9bfb-452d-9300-424ea4937f08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:26:21.411619 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c586bb-9bfb-452d-9300-424ea4937f08 service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:26:21.428526 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1163/2309] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:26:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:26:27.865210 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=59 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:26:31.418578 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=18 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:26:31.609217 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f73a08-a2f4-4c96-b9c1-1f862d51d3f1 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:26:31.609769 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f73a08-a2f4-4c96-b9c1-1f862d51d3f1 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:26:31.609769 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f73a08-a2f4-4c96-b9c1-1f862d51d3f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:26:31.634138 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-13f73a08-a2f4-4c96-b9c1-1f862d51d3f1 None None] MFA Rules not processed for user `600f51be8202427fb3691db566ed2ff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:26:31.636214 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-13f73a08-a2f4-4c96-b9c1-1f862d51d3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:26:31.643220 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1147/2310] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:26:31 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:26:31.948658 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c586bb-9bfb-452d-9300-424ea4937f08 service nova] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:26:31.957748 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c586bb-9bfb-452d-9300-424ea4937f08 service nova] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:26:31.961533 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287374b5-fa1b-4a0b-8cb6-62f09a0565e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:26:31.962142 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287374b5-fa1b-4a0b-8cb6-62f09a0565e3 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:26:31.962420 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287374b5-fa1b-4a0b-8cb6-62f09a0565e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:26:31.962693 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287374b5-fa1b-4a0b-8cb6-62f09a0565e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:26:31.964782 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-287374b5-fa1b-4a0b-8cb6-62f09a0565e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:26:31.974119 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287374b5-fa1b-4a0b-8cb6-62f09a0565e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:26:31.975512 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287374b5-fa1b-4a0b-8cb6-62f09a0565e3 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:26:31.983874 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1164/2311] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:26:31 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:26:32.288499 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f73a08-a2f4-4c96-b9c1-1f862d51d3f1 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:26:32.289955 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-13f73a08-a2f4-4c96-b9c1-1f862d51d3f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:26:32.360310 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f73a08-a2f4-4c96-b9c1-1f862d51d3f1 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:26:32.365224 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7220e8-5618-431d-ac61-0c1feb9f4c02 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e84ea976b5914aea94c4d8f805139daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:26:32.365839 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7220e8-5618-431d-ac61-0c1feb9f4c02 service placement] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:26:32.366117 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7220e8-5618-431d-ac61-0c1feb9f4c02 service placement] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:26:32.366390 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7220e8-5618-431d-ac61-0c1feb9f4c02 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:26:32.368079 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-cf7220e8-5618-431d-ac61-0c1feb9f4c02 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:26:32.380222 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7220e8-5618-431d-ac61-0c1feb9f4c02 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:26:32.382123 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7220e8-5618-431d-ac61-0c1feb9f4c02 service placement] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:26:32.392595 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1148/2312] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:26:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:26:41.820793 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287374b5-fa1b-4a0b-8cb6-62f09a0565e3 service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:26:41.835920 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287374b5-fa1b-4a0b-8cb6-62f09a0565e3 service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:26:41.841844 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0748aa46-18d3-48cc-a1b4-0d1dd1cabcdb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:26:41.842571 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748aa46-18d3-48cc-a1b4-0d1dd1cabcdb service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:26:41.843034 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748aa46-18d3-48cc-a1b4-0d1dd1cabcdb service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:26:41.843309 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0748aa46-18d3-48cc-a1b4-0d1dd1cabcdb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:26:41.845093 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-0748aa46-18d3-48cc-a1b4-0d1dd1cabcdb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:26:41.858801 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0748aa46-18d3-48cc-a1b4-0d1dd1cabcdb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:26:41.860680 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0748aa46-18d3-48cc-a1b4-0d1dd1cabcdb service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:26:41.872756 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1165/2313] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:26:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:26:42.388489 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=35 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:26:51.866886 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=12 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:26:52.500863 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218b5f5-21cb-412c-b3cf-e43af83b4c0d None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:26:52.501398 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218b5f5-21cb-412c-b3cf-e43af83b4c0d None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:26:52.502118 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7218b5f5-21cb-412c-b3cf-e43af83b4c0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:26:52.520260 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-7218b5f5-21cb-412c-b3cf-e43af83b4c0d None None] MFA Rules not processed for user `3d47613c7085460da42e2179625b3f16`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:26:52.521471 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-7218b5f5-21cb-412c-b3cf-e43af83b4c0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:26:52.528946 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1149/2314] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:26:52 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:26:52.828060 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0748aa46-18d3-48cc-a1b4-0d1dd1cabcdb service nova] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:26:52.837900 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0748aa46-18d3-48cc-a1b4-0d1dd1cabcdb service nova] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:26:52.841740 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50736242-5bc5-4f94-a678-dcd05dcf36dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:26:52.842345 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50736242-5bc5-4f94-a678-dcd05dcf36dc service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:26:52.842829 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50736242-5bc5-4f94-a678-dcd05dcf36dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:26:52.843102 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50736242-5bc5-4f94-a678-dcd05dcf36dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:26:52.845030 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-50736242-5bc5-4f94-a678-dcd05dcf36dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:26:52.855453 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50736242-5bc5-4f94-a678-dcd05dcf36dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:26:52.856891 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50736242-5bc5-4f94-a678-dcd05dcf36dc service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:26:52.864778 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1166/2315] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:26:52 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:26:54.828504 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7218b5f5-21cb-412c-b3cf-e43af83b4c0d None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:26:54.848721 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7218b5f5-21cb-412c-b3cf-e43af83b4c0d None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:26:54.854762 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27925a-8e31-4b2a-b15d-6ec8392a151e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:26:54.855370 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27925a-8e31-4b2a-b15d-6ec8392a151e service nova] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:26:54.855648 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27925a-8e31-4b2a-b15d-6ec8392a151e service nova] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:26:54.855919 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b27925a-8e31-4b2a-b15d-6ec8392a151e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:26:54.857708 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-5b27925a-8e31-4b2a-b15d-6ec8392a151e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:26:54.916085 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27925a-8e31-4b2a-b15d-6ec8392a151e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:26:54.917743 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b27925a-8e31-4b2a-b15d-6ec8392a151e service nova] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:26:54.927078 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1150/2316] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:26:54 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:27:02.861200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=6 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:27:04.922876 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=31 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:27:08.342149 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb7194-1d64-44d9-8a8b-c025e74b2933 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:08.342697 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb7194-1d64-44d9-8a8b-c025e74b2933 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:08.342797 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dacb7194-1d64-44d9-8a8b-c025e74b2933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:08.363915 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-dacb7194-1d64-44d9-8a8b-c025e74b2933 None None] MFA Rules not processed for user `36970f0778384576b599cd7217b5084d`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:27:08.365095 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-dacb7194-1d64-44d9-8a8b-c025e74b2933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:27:08.372865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1167/2317] 10.222.0.15 () {58 vars in 967 bytes} [Fri Aug 5 02:27:08 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:27:08.421444 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27925a-8e31-4b2a-b15d-6ec8392a151e service nova] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:08.433568 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b27925a-8e31-4b2a-b15d-6ec8392a151e service nova] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:08.438804 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebe53a-84f8-44b4-ad9a-1a623ef95b1a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f03233b0ee3540cdb5105f6603cfdff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:08.439527 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebe53a-84f8-44b4-ad9a-1a623ef95b1a service swift] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:08.439814 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebe53a-84f8-44b4-ad9a-1a623ef95b1a service swift] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:08.440091 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adebe53a-84f8-44b4-ad9a-1a623ef95b1a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:08.450248 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebe53a-84f8-44b4-ad9a-1a623ef95b1a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:08.451834 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adebe53a-84f8-44b4-ad9a-1a623ef95b1a service swift] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:08.460144 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1151/2318] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Aug 5 02:27:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 02:27:08.830061 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb7194-1d64-44d9-8a8b-c025e74b2933 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:08.840279 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dacb7194-1d64-44d9-8a8b-c025e74b2933 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:08.844724 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739324de-56a2-4573-9418-859a210dbb2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:08.845435 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739324de-56a2-4573-9418-859a210dbb2a service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:08.845884 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739324de-56a2-4573-9418-859a210dbb2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:08.846161 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739324de-56a2-4573-9418-859a210dbb2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:08.847991 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-739324de-56a2-4573-9418-859a210dbb2a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:27:08.915414 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739324de-56a2-4573-9418-859a210dbb2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:08.917216 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739324de-56a2-4573-9418-859a210dbb2a service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:08.927064 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1168/2319] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:27:08 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:27:12.402082 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebe53a-84f8-44b4-ad9a-1a623ef95b1a service swift] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:12.414238 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adebe53a-84f8-44b4-ad9a-1a623ef95b1a service swift] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:12.421263 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce48b9e-ab33-4db7-8f91-c6336113df5d service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e84ea976b5914aea94c4d8f805139daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:12.421879 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce48b9e-ab33-4db7-8f91-c6336113df5d service placement] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:12.422162 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce48b9e-ab33-4db7-8f91-c6336113df5d service placement] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:12.422437 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce48b9e-ab33-4db7-8f91-c6336113df5d service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:12.424209 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-5ce48b9e-ab33-4db7-8f91-c6336113df5d service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:27:12.436896 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce48b9e-ab33-4db7-8f91-c6336113df5d service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:12.438663 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ce48b9e-ab33-4db7-8f91-c6336113df5d service placement] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:12.452615 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1152/2320] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:27:12 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:27:15.528767 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f39c6-2abf-4bfe-95fb-b71dd862c454 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:15.529324 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f39c6-2abf-4bfe-95fb-b71dd862c454 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:15.529324 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182f39c6-2abf-4bfe-95fb-b71dd862c454 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:15.530692 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1169/2321] 10.222.0.15 () {54 vars in 921 bytes} [Fri Aug 5 02:27:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:27:15.565064 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca347ca0-26ef-44bb-95c4-f8f6c4ca56e1 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:15.565605 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca347ca0-26ef-44bb-95c4-f8f6c4ca56e1 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:15.565751 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca347ca0-26ef-44bb-95c4-f8f6c4ca56e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:15.585430 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-ca347ca0-26ef-44bb-95c4-f8f6c4ca56e1 None None] MFA Rules not processed for user `e84ea976b5914aea94c4d8f805139daf`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:27:15.586846 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-ca347ca0-26ef-44bb-95c4-f8f6c4ca56e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:27:15.596749 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1153/2322] 10.222.0.15 () {58 vars in 1018 bytes} [Fri Aug 5 02:27:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:27:15.603854 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f39c6-2abf-4bfe-95fb-b71dd862c454 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:15.605798 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-182f39c6-2abf-4bfe-95fb-b71dd862c454 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:27:15.625795 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca347ca0-26ef-44bb-95c4-f8f6c4ca56e1 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:15.626785 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182f39c6-2abf-4bfe-95fb-b71dd862c454 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:15.631820 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2683aa-bfe7-4e5e-86a5-6c41dc7af1bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:15.632934 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2683aa-bfe7-4e5e-86a5-6c41dc7af1bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:15.633092 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2683aa-bfe7-4e5e-86a5-6c41dc7af1bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:15.633443 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2683aa-bfe7-4e5e-86a5-6c41dc7af1bd admin admin] PATH_INFO: `/v3/users/836dfe4afeef41ab86636b38cb9ccfc1` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:15.634697 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2683aa-bfe7-4e5e-86a5-6c41dc7af1bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=836dfe4afeef41ab86636b38cb9ccfc1)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:15.636496 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca347ca0-26ef-44bb-95c4-f8f6c4ca56e1 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:15.636792 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2683aa-bfe7-4e5e-86a5-6c41dc7af1bd admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:15.641569 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b0742f-4ea6-4c81-886b-94db4a5686a6 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e84ea976b5914aea94c4d8f805139daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:15.642176 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0742f-4ea6-4c81-886b-94db4a5686a6 service placement] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:15.642462 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0742f-4ea6-4c81-886b-94db4a5686a6 service placement] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:15.642756 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b0742f-4ea6-4c81-886b-94db4a5686a6 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:15.651504 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b0742f-4ea6-4c81-886b-94db4a5686a6 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:15.653157 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b0742f-4ea6-4c81-886b-94db4a5686a6 service placement] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:15.663675 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1154/2323] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:27:15 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:27:15.688186 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-2e2683aa-bfe7-4e5e-86a5-6c41dc7af1bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '836dfe4afeef41ab86636b38cb9ccfc1'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:15.701089 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-2e2683aa-bfe7-4e5e-86a5-6c41dc7af1bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '836dfe4afeef41ab86636b38cb9ccfc1'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:15.701787 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-2e2683aa-bfe7-4e5e-86a5-6c41dc7af1bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '836dfe4afeef41ab86636b38cb9ccfc1'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:15.702528 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-2e2683aa-bfe7-4e5e-86a5-6c41dc7af1bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '836dfe4afeef41ab86636b38cb9ccfc1'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:15.709921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-2e2683aa-bfe7-4e5e-86a5-6c41dc7af1bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '836dfe4afeef41ab86636b38cb9ccfc1'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:15.722440 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1170/2324] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:27:15 2022] DELETE /identity/v3/users/836dfe4afeef41ab86636b38cb9ccfc1 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:27:15.891377 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b0742f-4ea6-4c81-886b-94db4a5686a6 service placement] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:15.903164 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b0742f-4ea6-4c81-886b-94db4a5686a6 service placement] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:15.962867 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a759dc4-a3ef-4b5e-b9d8-3e3dae797bf9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:15.963763 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a759dc4-a3ef-4b5e-b9d8-3e3dae797bf9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:15.964048 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a759dc4-a3ef-4b5e-b9d8-3e3dae797bf9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:15.964345 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a759dc4-a3ef-4b5e-b9d8-3e3dae797bf9 admin admin] PATH_INFO: `/v3/projects/a5d8a01fa4024794b4dde3beebbbd7f1` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:15.965480 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a759dc4-a3ef-4b5e-b9d8-3e3dae797bf9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a5d8a01fa4024794b4dde3beebbbd7f1)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:15.967357 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a759dc4-a3ef-4b5e-b9d8-3e3dae797bf9 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:16.012713 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-8a759dc4-a3ef-4b5e-b9d8-3e3dae797bf9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'request_id': 'req-8a759dc4-a3ef-4b5e-b9d8-3e3dae797bf9'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:16.017948 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-8a759dc4-a3ef-4b5e-b9d8-3e3dae797bf9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'request_id': 'req-8a759dc4-a3ef-4b5e-b9d8-3e3dae797bf9'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:16.025675 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-8a759dc4-a3ef-4b5e-b9d8-3e3dae797bf9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a5d8a01fa4024794b4dde3beebbbd7f1', 'request_id': 'req-8a759dc4-a3ef-4b5e-b9d8-3e3dae797bf9'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:16.036442 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-8a759dc4-a3ef-4b5e-b9d8-3e3dae797bf9 admin admin] The token cache is being invalidate because project a5d8a01fa4024794b4dde3beebbbd7f1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:27:16.036723 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-8a759dc4-a3ef-4b5e-b9d8-3e3dae797bf9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:16.037338 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-8a759dc4-a3ef-4b5e-b9d8-3e3dae797bf9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:16.038836 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1155/2325] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:27:15 2022] DELETE /identity/v3/projects/a5d8a01fa4024794b4dde3beebbbd7f1 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:27:16.043553 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2683aa-bfe7-4e5e-86a5-6c41dc7af1bd admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:16.045028 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-2e2683aa-bfe7-4e5e-86a5-6c41dc7af1bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:27:16.058505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2683aa-bfe7-4e5e-86a5-6c41dc7af1bd admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:16.114822 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3297c2a-1a04-4aad-8b1e-705a18073de4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:16.115624 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3297c2a-1a04-4aad-8b1e-705a18073de4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:16.116117 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3297c2a-1a04-4aad-8b1e-705a18073de4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:16.116541 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3297c2a-1a04-4aad-8b1e-705a18073de4 admin admin] PATH_INFO: `/v3/users/25a3999ecb3f4a3bb52351cf752aa1b7` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:16.118206 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3297c2a-1a04-4aad-8b1e-705a18073de4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25a3999ecb3f4a3bb52351cf752aa1b7)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:16.120425 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3297c2a-1a04-4aad-8b1e-705a18073de4 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:16.122098 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:27:16.168568 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-d3297c2a-1a04-4aad-8b1e-705a18073de4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25a3999ecb3f4a3bb52351cf752aa1b7'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:16.181005 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-d3297c2a-1a04-4aad-8b1e-705a18073de4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25a3999ecb3f4a3bb52351cf752aa1b7'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:16.181810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-d3297c2a-1a04-4aad-8b1e-705a18073de4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25a3999ecb3f4a3bb52351cf752aa1b7'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:16.182462 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-d3297c2a-1a04-4aad-8b1e-705a18073de4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25a3999ecb3f4a3bb52351cf752aa1b7'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:16.192927 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-d3297c2a-1a04-4aad-8b1e-705a18073de4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25a3999ecb3f4a3bb52351cf752aa1b7'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:16.206145 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1171/2326] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:27:16 2022] DELETE /identity/v3/users/25a3999ecb3f4a3bb52351cf752aa1b7 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:27:16.396083 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a759dc4-a3ef-4b5e-b9d8-3e3dae797bf9 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:16.397997 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-8a759dc4-a3ef-4b5e-b9d8-3e3dae797bf9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:27:16.416257 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a759dc4-a3ef-4b5e-b9d8-3e3dae797bf9 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:16.463146 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:27:16.479693 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ab74f-ffb7-4f6f-8cf0-a432359b9416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:16.480354 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ab74f-ffb7-4f6f-8cf0-a432359b9416 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:16.480778 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ab74f-ffb7-4f6f-8cf0-a432359b9416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:16.481058 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ab74f-ffb7-4f6f-8cf0-a432359b9416 admin admin] PATH_INFO: `/v3/projects/6d514bb1894c4cbeabba468f621e9845` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:16.482203 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ab74f-ffb7-4f6f-8cf0-a432359b9416 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6d514bb1894c4cbeabba468f621e9845)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:16.484094 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ab74f-ffb7-4f6f-8cf0-a432359b9416 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:16.528839 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-370ab74f-ffb7-4f6f-8cf0-a432359b9416 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6d514bb1894c4cbeabba468f621e9845', 'request_id': 'req-370ab74f-ffb7-4f6f-8cf0-a432359b9416'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:16.534193 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-370ab74f-ffb7-4f6f-8cf0-a432359b9416 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6d514bb1894c4cbeabba468f621e9845', 'request_id': 'req-370ab74f-ffb7-4f6f-8cf0-a432359b9416'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:16.541555 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-370ab74f-ffb7-4f6f-8cf0-a432359b9416 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6d514bb1894c4cbeabba468f621e9845', 'request_id': 'req-370ab74f-ffb7-4f6f-8cf0-a432359b9416'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:16.552297 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-370ab74f-ffb7-4f6f-8cf0-a432359b9416 admin admin] The token cache is being invalidate because project 6d514bb1894c4cbeabba468f621e9845 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:27:16.552606 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-370ab74f-ffb7-4f6f-8cf0-a432359b9416 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:16.553218 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-370ab74f-ffb7-4f6f-8cf0-a432359b9416 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:16.555191 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1156/2327] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:27:16 2022] DELETE /identity/v3/projects/6d514bb1894c4cbeabba468f621e9845 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:27:16.560810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df02a93-1221-4353-b6b2-991a4ac470c9 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:16.561301 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df02a93-1221-4353-b6b2-991a4ac470c9 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:16.561301 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df02a93-1221-4353-b6b2-991a4ac470c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:16.580479 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-1df02a93-1221-4353-b6b2-991a4ac470c9 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:27:16.581682 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-1df02a93-1221-4353-b6b2-991a4ac470c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:27:16.642125 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1172/2328] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:27:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:27:16.650565 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44766ebb-12eb-49c8-913b-045b0c273fc2 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:16.651050 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44766ebb-12eb-49c8-913b-045b0c273fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:16.651165 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44766ebb-12eb-49c8-913b-045b0c273fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:16.670783 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-44766ebb-12eb-49c8-913b-045b0c273fc2 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:27:16.671967 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-44766ebb-12eb-49c8-913b-045b0c273fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:27:16.680069 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1157/2329] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:27:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:27:16.684300 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df02a93-1221-4353-b6b2-991a4ac470c9 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:16.694081 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df02a93-1221-4353-b6b2-991a4ac470c9 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:16.698663 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4eb12-efc8-4225-922a-61ca28da4ab9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:16.699380 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4eb12-efc8-4225-922a-61ca28da4ab9 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:16.699688 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4eb12-efc8-4225-922a-61ca28da4ab9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:16.699958 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9b4eb12-efc8-4225-922a-61ca28da4ab9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:16.700683 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b4eb12-efc8-4225-922a-61ca28da4ab9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:27:16.700983 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b4eb12-efc8-4225-922a-61ca28da4ab9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:16.702548 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9b4eb12-efc8-4225-922a-61ca28da4ab9 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:16.714935 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1173/2330] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:27:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:27:16.719121 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44766ebb-12eb-49c8-913b-045b0c273fc2 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:16.729064 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44766ebb-12eb-49c8-913b-045b0c273fc2 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:16.733577 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e83eae-7061-439a-8d89-e9f66a974fd8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:16.734165 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e83eae-7061-439a-8d89-e9f66a974fd8 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:16.734439 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e83eae-7061-439a-8d89-e9f66a974fd8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:16.734711 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e83eae-7061-439a-8d89-e9f66a974fd8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:16.735369 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e83eae-7061-439a-8d89-e9f66a974fd8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:16.737276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e83eae-7061-439a-8d89-e9f66a974fd8 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:16.765772 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1158/2331] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:27:16 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:27:16.769933 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4eb12-efc8-4225-922a-61ca28da4ab9 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:16.780682 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9b4eb12-efc8-4225-922a-61ca28da4ab9 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:16.838174 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22253e-9030-4d8b-b461-3a02f36c625a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:16.838803 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22253e-9030-4d8b-b461-3a02f36c625a admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:16.839087 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22253e-9030-4d8b-b461-3a02f36c625a admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:16.839364 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e22253e-9030-4d8b-b461-3a02f36c625a admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:16.840041 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22253e-9030-4d8b-b461-3a02f36c625a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:16.842078 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e22253e-9030-4d8b-b461-3a02f36c625a admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:16.853760 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:27:16.865879 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1174/2332] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:27:16 2022] POST /identity/v3/users => generated 286 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:27:16.869547 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e83eae-7061-439a-8d89-e9f66a974fd8 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:16.879841 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e83eae-7061-439a-8d89-e9f66a974fd8 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:16.885256 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69e661-7e4b-43cf-9d35-7f9f5dd9fc2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:16.885891 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69e661-7e4b-43cf-9d35-7f9f5dd9fc2c admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:16.886321 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69e661-7e4b-43cf-9d35-7f9f5dd9fc2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:16.886601 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b69e661-7e4b-43cf-9d35-7f9f5dd9fc2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:16.887298 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69e661-7e4b-43cf-9d35-7f9f5dd9fc2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:16.888950 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b69e661-7e4b-43cf-9d35-7f9f5dd9fc2c admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:16.899330 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1159/2333] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:27:16.903375 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22253e-9030-4d8b-b461-3a02f36c625a admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:16.913472 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e22253e-9030-4d8b-b461-3a02f36c625a admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:16.918265 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-755a7aac-9424-49cf-b4f0-d274fb263c8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:16.918875 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a7aac-9424-49cf-b4f0-d274fb263c8f admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:16.919164 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a7aac-9424-49cf-b4f0-d274fb263c8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:16.919436 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-755a7aac-9424-49cf-b4f0-d274fb263c8f admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:16.920128 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a7aac-9424-49cf-b4f0-d274fb263c8f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:16.921755 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-755a7aac-9424-49cf-b4f0-d274fb263c8f admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:16.932565 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1175/2334] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:27:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:27:16.936669 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69e661-7e4b-43cf-9d35-7f9f5dd9fc2c admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:16.947102 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b69e661-7e4b-43cf-9d35-7f9f5dd9fc2c admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:16.951646 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8be060-96b5-4e64-b958-a1e7863a2694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:16.952285 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8be060-96b5-4e64-b958-a1e7863a2694 admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:16.952590 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8be060-96b5-4e64-b958-a1e7863a2694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:16.952868 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac8be060-96b5-4e64-b958-a1e7863a2694 admin admin] PATH_INFO: `/v3/projects/b3677b84efd24f76bbbc0f8a762ec3f5/users/d7166065ae65434fbeaff2993a21cc01/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:16.967752 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8be060-96b5-4e64-b958-a1e7863a2694 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3677b84efd24f76bbbc0f8a762ec3f5, user_id=d7166065ae65434fbeaff2993a21cc01, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:16.970477 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac8be060-96b5-4e64-b958-a1e7863a2694 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:16.983749 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1160/2335] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:27:16 2022] PUT /identity/v3/projects/b3677b84efd24f76bbbc0f8a762ec3f5/users/d7166065ae65434fbeaff2993a21cc01/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:27:16.988798 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddcee9-8a02-4ce1-83af-ef167845fd33 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:16.989113 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddcee9-8a02-4ce1-83af-ef167845fd33 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:16.989390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fddcee9-8a02-4ce1-83af-ef167845fd33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:17.008437 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-8fddcee9-8a02-4ce1-83af-ef167845fd33 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:27:17.009643 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-8fddcee9-8a02-4ce1-83af-ef167845fd33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:27:17.066470 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1176/2336] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:27:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:27:17.076825 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8be060-96b5-4e64-b958-a1e7863a2694 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:17.078515 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-ac8be060-96b5-4e64-b958-a1e7863a2694 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:27:17.135245 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac8be060-96b5-4e64-b958-a1e7863a2694 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:17.138807 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ddb1c-6815-442d-b6cc-f882ce8fbaec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:17.139417 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ddb1c-6815-442d-b6cc-f882ce8fbaec service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:17.139698 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ddb1c-6815-442d-b6cc-f882ce8fbaec service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:17.139971 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ddb1c-6815-442d-b6cc-f882ce8fbaec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:17.149465 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ddb1c-6815-442d-b6cc-f882ce8fbaec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:17.150887 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ddb1c-6815-442d-b6cc-f882ce8fbaec service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:17.160089 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1161/2337] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:27:17 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:27:21.254950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee89d04-6ded-46e6-bb21-d965a6f297e4 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:21.256046 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee89d04-6ded-46e6-bb21-d965a6f297e4 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:21.256499 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee89d04-6ded-46e6-bb21-d965a6f297e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:21.290390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-fee89d04-6ded-46e6-bb21-d965a6f297e4 None None] MFA Rules not processed for user `d7166065ae65434fbeaff2993a21cc01`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:27:21.291636 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-fee89d04-6ded-46e6-bb21-d965a6f297e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:27:21.363418 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1177/2338] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:27:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:27:21.368091 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ddb1c-6815-442d-b6cc-f882ce8fbaec service neutron] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:21.378471 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ddb1c-6815-442d-b6cc-f882ce8fbaec service neutron] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:21.385395 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5511bf-ea18-4fc4-8661-588dadc00362 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:21.386111 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5511bf-ea18-4fc4-8661-588dadc00362 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:21.386455 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5511bf-ea18-4fc4-8661-588dadc00362 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:21.386791 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5511bf-ea18-4fc4-8661-588dadc00362 admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:21.387609 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5511bf-ea18-4fc4-8661-588dadc00362 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:21.389844 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5511bf-ea18-4fc4-8661-588dadc00362 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:21.402721 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:27:21.424592 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1162/2339] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:27:21 2022] POST /identity/v3/projects => generated 373 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:27:21.429440 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee89d04-6ded-46e6-bb21-d965a6f297e4 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:21.443710 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee89d04-6ded-46e6-bb21-d965a6f297e4 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:21.519036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c081719-eded-4d58-98c8-b65621026ccf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:21.519747 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c081719-eded-4d58-98c8-b65621026ccf admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:21.520097 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c081719-eded-4d58-98c8-b65621026ccf admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:21.520468 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c081719-eded-4d58-98c8-b65621026ccf admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:21.521220 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c081719-eded-4d58-98c8-b65621026ccf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:21.523207 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c081719-eded-4d58-98c8-b65621026ccf admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:21.563462 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1178/2340] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:27:21 2022] POST /identity/v3/users => generated 293 bytes in 135 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:27:21.567295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5511bf-ea18-4fc4-8661-588dadc00362 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:21.581492 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5511bf-ea18-4fc4-8661-588dadc00362 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:21.587018 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1bae19-94bb-4b28-a6f5-e069045130a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:21.587659 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1bae19-94bb-4b28-a6f5-e069045130a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:21.588270 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1bae19-94bb-4b28-a6f5-e069045130a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:21.588539 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea1bae19-94bb-4b28-a6f5-e069045130a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:21.589245 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1bae19-94bb-4b28-a6f5-e069045130a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:21.590888 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea1bae19-94bb-4b28-a6f5-e069045130a2 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:21.617125 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1163/2341] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:27:21.621436 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c081719-eded-4d58-98c8-b65621026ccf admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:21.629501 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:27:21.638499 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c081719-eded-4d58-98c8-b65621026ccf admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:21.645558 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a879d-24aa-49b4-a7fa-dba58da4024d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:21.646397 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a879d-24aa-49b4-a7fa-dba58da4024d admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:21.646773 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a879d-24aa-49b4-a7fa-dba58da4024d admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:21.647144 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95a879d-24aa-49b4-a7fa-dba58da4024d admin admin] PATH_INFO: `/v3/projects/71cef2110dfb43dabac1baaed43f2d7c/users/061d1edc56bd4cbca17fa307ee7c035b/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:21.674417 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a879d-24aa-49b4-a7fa-dba58da4024d admin admin] RBAC: Authorizing `identity:create_grant(project_id=71cef2110dfb43dabac1baaed43f2d7c, user_id=061d1edc56bd4cbca17fa307ee7c035b, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:21.678025 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d95a879d-24aa-49b4-a7fa-dba58da4024d admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:21.698721 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1179/2342] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:27:21 2022] PUT /identity/v3/projects/71cef2110dfb43dabac1baaed43f2d7c/users/061d1edc56bd4cbca17fa307ee7c035b/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:27:21.703185 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1bae19-94bb-4b28-a6f5-e069045130a2 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:21.717441 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea1bae19-94bb-4b28-a6f5-e069045130a2 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:21.794829 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2adffb-2735-4b70-ade2-a66e865c795e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:21.795542 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2adffb-2735-4b70-ade2-a66e865c795e admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:21.796006 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2adffb-2735-4b70-ade2-a66e865c795e admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:21.796463 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2adffb-2735-4b70-ade2-a66e865c795e admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:21.797183 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2adffb-2735-4b70-ade2-a66e865c795e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:21.799950 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2adffb-2735-4b70-ade2-a66e865c795e admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:21.816822 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1164/2343] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:27:21 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:27:21.821633 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a879d-24aa-49b4-a7fa-dba58da4024d admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:21.836701 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95a879d-24aa-49b4-a7fa-dba58da4024d admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:21.843487 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f88021-ef36-4857-8b3f-8af8f610fa38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:21.844207 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f88021-ef36-4857-8b3f-8af8f610fa38 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:21.846063 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f88021-ef36-4857-8b3f-8af8f610fa38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:21.846449 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f88021-ef36-4857-8b3f-8af8f610fa38 admin admin] PATH_INFO: `/v3/projects/71cef2110dfb43dabac1baaed43f2d7c/users/061d1edc56bd4cbca17fa307ee7c035b/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:21.859475 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f88021-ef36-4857-8b3f-8af8f610fa38 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71cef2110dfb43dabac1baaed43f2d7c, user_id=061d1edc56bd4cbca17fa307ee7c035b, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:21.862547 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f88021-ef36-4857-8b3f-8af8f610fa38 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:21.882293 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1180/2344] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:27:21 2022] PUT /identity/v3/projects/71cef2110dfb43dabac1baaed43f2d7c/users/061d1edc56bd4cbca17fa307ee7c035b/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:27:27.167999 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ef3ce-f9fb-4444-87df-3d7a0a42b502 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:27.168600 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ef3ce-f9fb-4444-87df-3d7a0a42b502 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:27.168600 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-327ef3ce-f9fb-4444-87df-3d7a0a42b502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:27.194308 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-327ef3ce-f9fb-4444-87df-3d7a0a42b502 None None] MFA Rules not processed for user `64280d0c3da14f329b6fc21228d92288`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:27:27.197246 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-327ef3ce-f9fb-4444-87df-3d7a0a42b502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:27:27.266018 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1165/2345] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:27:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:27:28.186912 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a0505-8d03-49d4-bf6a-3a8ecda9016a None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:28.187431 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a0505-8d03-49d4-bf6a-3a8ecda9016a None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:28.187535 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2a0505-8d03-49d4-bf6a-3a8ecda9016a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:28.227702 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-3b2a0505-8d03-49d4-bf6a-3a8ecda9016a None None] MFA Rules not processed for user `061d1edc56bd4cbca17fa307ee7c035b`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:27:28.229544 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-3b2a0505-8d03-49d4-bf6a-3a8ecda9016a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:27:28.333227 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1181/2346] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:27:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:27:28.350392 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ef3ce-f9fb-4444-87df-3d7a0a42b502 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:28.352807 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-327ef3ce-f9fb-4444-87df-3d7a0a42b502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:27:28.489784 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-327ef3ce-f9fb-4444-87df-3d7a0a42b502 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:28.507250 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4c47f-6d6b-4f04-8499-d3e877d07c42 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:28.507926 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4c47f-6d6b-4f04-8499-d3e877d07c42 service nova] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:28.508218 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4c47f-6d6b-4f04-8499-d3e877d07c42 service nova] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:28.508630 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1c4c47f-6d6b-4f04-8499-d3e877d07c42 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:28.534435 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:27:28.600279 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4c47f-6d6b-4f04-8499-d3e877d07c42 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:28.602519 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1c4c47f-6d6b-4f04-8499-d3e877d07c42 service nova] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:28.640283 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1166/2347] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:27:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:27:30.201505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0e7ec-7605-4882-83ff-c7f27409835c None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:30.202325 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0e7ec-7605-4882-83ff-c7f27409835c None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:30.202774 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d0e7ec-7605-4882-83ff-c7f27409835c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:30.234400 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-55d0e7ec-7605-4882-83ff-c7f27409835c None None] MFA Rules not processed for user `d7166065ae65434fbeaff2993a21cc01`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:27:30.235812 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-55d0e7ec-7605-4882-83ff-c7f27409835c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:27:30.259897 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1182/2348] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:27:30 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 59 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:27:38.614387 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=19 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:27:40.228469 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=50,keystone:INSERT=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:27:44.574611 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4c47f-6d6b-4f04-8499-d3e877d07c42 service nova] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:44.641408 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1c4c47f-6d6b-4f04-8499-d3e877d07c42 service nova] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:44.645751 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d89df-5e11-4c10-8839-474e96874cf0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:44.646504 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d89df-5e11-4c10-8839-474e96874cf0 service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:44.646764 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d89df-5e11-4c10-8839-474e96874cf0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:44.647048 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46d89df-5e11-4c10-8839-474e96874cf0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:44.649136 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-d46d89df-5e11-4c10-8839-474e96874cf0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:27:44.721888 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d89df-5e11-4c10-8839-474e96874cf0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:44.723338 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46d89df-5e11-4c10-8839-474e96874cf0 service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:44.735529 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1167/2349] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:27:44 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:27:48.029007 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0e7ec-7605-4882-83ff-c7f27409835c None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:48.030544 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-55d0e7ec-7605-4882-83ff-c7f27409835c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:27:48.046289 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d0e7ec-7605-4882-83ff-c7f27409835c None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:48.050781 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2446006-ae68-43f0-a7c0-d2f2b54ed8eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:48.051427 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2446006-ae68-43f0-a7c0-d2f2b54ed8eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:48.051703 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2446006-ae68-43f0-a7c0-d2f2b54ed8eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:48.051974 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2446006-ae68-43f0-a7c0-d2f2b54ed8eb admin admin] PATH_INFO: `/v3/users/5bf84408a3984972a5bb68a3117c0501` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:48.053192 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2446006-ae68-43f0-a7c0-d2f2b54ed8eb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5bf84408a3984972a5bb68a3117c0501)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:48.055101 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2446006-ae68-43f0-a7c0-d2f2b54ed8eb admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:48.114312 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-a2446006-ae68-43f0-a7c0-d2f2b54ed8eb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5bf84408a3984972a5bb68a3117c0501'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:48.126644 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-a2446006-ae68-43f0-a7c0-d2f2b54ed8eb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5bf84408a3984972a5bb68a3117c0501'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:48.127353 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-a2446006-ae68-43f0-a7c0-d2f2b54ed8eb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5bf84408a3984972a5bb68a3117c0501'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:48.127969 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-a2446006-ae68-43f0-a7c0-d2f2b54ed8eb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5bf84408a3984972a5bb68a3117c0501'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:48.134646 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-a2446006-ae68-43f0-a7c0-d2f2b54ed8eb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5bf84408a3984972a5bb68a3117c0501'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:48.147705 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1183/2350] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:27:48 2022] DELETE /identity/v3/users/5bf84408a3984972a5bb68a3117c0501 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:27:48.324946 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d89df-5e11-4c10-8839-474e96874cf0 service neutron] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:48.339928 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46d89df-5e11-4c10-8839-474e96874cf0 service neutron] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:48.397649 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38d61b0-9854-4369-bc79-8cb88836e3a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:48.398280 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d61b0-9854-4369-bc79-8cb88836e3a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:48.398561 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d61b0-9854-4369-bc79-8cb88836e3a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:48.398834 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38d61b0-9854-4369-bc79-8cb88836e3a8 admin admin] PATH_INFO: `/v3/projects/00eaaf2e12844123996e26c1827d80b2` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:48.399986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d61b0-9854-4369-bc79-8cb88836e3a8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=00eaaf2e12844123996e26c1827d80b2)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:48.402636 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38d61b0-9854-4369-bc79-8cb88836e3a8 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:48.450105 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-f38d61b0-9854-4369-bc79-8cb88836e3a8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '00eaaf2e12844123996e26c1827d80b2', 'request_id': 'req-f38d61b0-9854-4369-bc79-8cb88836e3a8'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:48.452098 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:27:48.456782 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-f38d61b0-9854-4369-bc79-8cb88836e3a8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '00eaaf2e12844123996e26c1827d80b2', 'request_id': 'req-f38d61b0-9854-4369-bc79-8cb88836e3a8'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:48.465032 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-f38d61b0-9854-4369-bc79-8cb88836e3a8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '00eaaf2e12844123996e26c1827d80b2', 'request_id': 'req-f38d61b0-9854-4369-bc79-8cb88836e3a8'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:48.477055 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-f38d61b0-9854-4369-bc79-8cb88836e3a8 admin admin] The token cache is being invalidate because project 00eaaf2e12844123996e26c1827d80b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:27:48.477553 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-f38d61b0-9854-4369-bc79-8cb88836e3a8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:48.478183 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-f38d61b0-9854-4369-bc79-8cb88836e3a8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:48.479848 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1168/2351] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:27:48 2022] DELETE /identity/v3/projects/00eaaf2e12844123996e26c1827d80b2 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:27:48.484818 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26aa3fb-8178-47df-8b29-f928deb44f16 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:48.485113 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26aa3fb-8178-47df-8b29-f928deb44f16 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:48.485394 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26aa3fb-8178-47df-8b29-f928deb44f16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:48.504790 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-d26aa3fb-8178-47df-8b29-f928deb44f16 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:27:48.506004 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-d26aa3fb-8178-47df-8b29-f928deb44f16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:27:48.565069 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1184/2352] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:27:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:27:48.572922 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9b254-5fb8-4ea1-a14c-0b9b4d5eb77a None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:48.573679 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9b254-5fb8-4ea1-a14c-0b9b4d5eb77a None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:48.574519 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eac9b254-5fb8-4ea1-a14c-0b9b4d5eb77a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:48.594974 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-eac9b254-5fb8-4ea1-a14c-0b9b4d5eb77a None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:27:48.596170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-eac9b254-5fb8-4ea1-a14c-0b9b4d5eb77a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:27:48.604012 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1169/2353] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:27:48 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:27:48.608309 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26aa3fb-8178-47df-8b29-f928deb44f16 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:48.619136 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26aa3fb-8178-47df-8b29-f928deb44f16 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:48.624395 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767196e-7b4a-42a5-9b0f-4b63715223b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:48.625010 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767196e-7b4a-42a5-9b0f-4b63715223b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:48.625292 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767196e-7b4a-42a5-9b0f-4b63715223b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:48.625569 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9767196e-7b4a-42a5-9b0f-4b63715223b5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:48.626290 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767196e-7b4a-42a5-9b0f-4b63715223b5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:27:48.626593 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767196e-7b4a-42a5-9b0f-4b63715223b5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:48.628175 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9767196e-7b4a-42a5-9b0f-4b63715223b5 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:48.640163 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1185/2354] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:27:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:27:48.644479 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9b254-5fb8-4ea1-a14c-0b9b4d5eb77a None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:48.653632 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eac9b254-5fb8-4ea1-a14c-0b9b4d5eb77a None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:48.658159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c8364-e385-4fd2-90cb-cbd77f49ab76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:48.658757 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c8364-e385-4fd2-90cb-cbd77f49ab76 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:48.659036 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c8364-e385-4fd2-90cb-cbd77f49ab76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:48.659306 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334c8364-e385-4fd2-90cb-cbd77f49ab76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:48.659953 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334c8364-e385-4fd2-90cb-cbd77f49ab76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:48.661877 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334c8364-e385-4fd2-90cb-cbd77f49ab76 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:48.688610 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1170/2355] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:27:48 2022] POST /identity/v3/projects => generated 367 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:27:48.692650 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767196e-7b4a-42a5-9b0f-4b63715223b5 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:48.703034 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9767196e-7b4a-42a5-9b0f-4b63715223b5 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:48.756927 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceee1d2-81c8-4f16-829d-5dde25cc60ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:48.757534 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceee1d2-81c8-4f16-829d-5dde25cc60ca admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:48.757809 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceee1d2-81c8-4f16-829d-5dde25cc60ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:48.758078 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceee1d2-81c8-4f16-829d-5dde25cc60ca admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:48.758732 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceee1d2-81c8-4f16-829d-5dde25cc60ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:48.761375 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceee1d2-81c8-4f16-829d-5dde25cc60ca admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:48.769000 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:27:48.783363 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1186/2356] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:27:48 2022] POST /identity/v3/users => generated 284 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:27:48.787544 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c8364-e385-4fd2-90cb-cbd77f49ab76 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:48.797979 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334c8364-e385-4fd2-90cb-cbd77f49ab76 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:48.802498 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a06c4-c2ea-452b-90fb-37184bf4f90f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:48.803097 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a06c4-c2ea-452b-90fb-37184bf4f90f admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:48.803374 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a06c4-c2ea-452b-90fb-37184bf4f90f admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:48.803647 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611a06c4-c2ea-452b-90fb-37184bf4f90f admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:48.804353 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a06c4-c2ea-452b-90fb-37184bf4f90f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:48.805948 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-611a06c4-c2ea-452b-90fb-37184bf4f90f admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:48.816732 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1171/2357] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:27:48.820553 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceee1d2-81c8-4f16-829d-5dde25cc60ca admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:48.830596 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceee1d2-81c8-4f16-829d-5dde25cc60ca admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:48.835216 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bbc426b-01d7-4e5d-96e2-b4408e67831d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:48.835847 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc426b-01d7-4e5d-96e2-b4408e67831d admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:48.836116 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc426b-01d7-4e5d-96e2-b4408e67831d admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:48.836443 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bbc426b-01d7-4e5d-96e2-b4408e67831d admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:48.837410 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc426b-01d7-4e5d-96e2-b4408e67831d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:48.839596 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bbc426b-01d7-4e5d-96e2-b4408e67831d admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:48.851034 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1187/2358] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:27:48 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:27:48.855772 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a06c4-c2ea-452b-90fb-37184bf4f90f admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:48.865933 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611a06c4-c2ea-452b-90fb-37184bf4f90f admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:48.871039 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da0265-b4d2-4d43-9735-59343a99dd48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:48.871687 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da0265-b4d2-4d43-9735-59343a99dd48 admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:48.871963 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da0265-b4d2-4d43-9735-59343a99dd48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:48.872235 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da0265-b4d2-4d43-9735-59343a99dd48 admin admin] PATH_INFO: `/v3/projects/34ea813e410745c7a211933c00438b1e/users/f6d128eadb114eb58a003bfc06c2ec4a/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:48.887146 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da0265-b4d2-4d43-9735-59343a99dd48 admin admin] RBAC: Authorizing `identity:create_grant(project_id=34ea813e410745c7a211933c00438b1e, user_id=f6d128eadb114eb58a003bfc06c2ec4a, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:48.889907 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2da0265-b4d2-4d43-9735-59343a99dd48 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:48.902586 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1172/2359] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:27:48 2022] PUT /identity/v3/projects/34ea813e410745c7a211933c00438b1e/users/f6d128eadb114eb58a003bfc06c2ec4a/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:27:48.914041 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feadc3fb-6cc3-446c-b398-f40102ca1e89 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:48.914331 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feadc3fb-6cc3-446c-b398-f40102ca1e89 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:48.914609 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feadc3fb-6cc3-446c-b398-f40102ca1e89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:48.942110 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-feadc3fb-6cc3-446c-b398-f40102ca1e89 None None] MFA Rules not processed for user `f6d128eadb114eb58a003bfc06c2ec4a`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:27:48.943335 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-feadc3fb-6cc3-446c-b398-f40102ca1e89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:27:49.010188 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1188/2360] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:27:48 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:27:49.015007 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da0265-b4d2-4d43-9735-59343a99dd48 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:49.077498 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da0265-b4d2-4d43-9735-59343a99dd48 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:49.082101 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f56ba-bca5-4f04-a246-2c2d801d9c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:49.082702 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f56ba-bca5-4f04-a246-2c2d801d9c3d admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:49.082984 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f56ba-bca5-4f04-a246-2c2d801d9c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:49.083262 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c9f56ba-bca5-4f04-a246-2c2d801d9c3d admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:49.083932 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f56ba-bca5-4f04-a246-2c2d801d9c3d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:49.085861 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c9f56ba-bca5-4f04-a246-2c2d801d9c3d admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:49.113729 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1173/2361] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:27:49 2022] POST /identity/v3/projects => generated 367 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:27:49.117853 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feadc3fb-6cc3-446c-b398-f40102ca1e89 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:49.128243 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feadc3fb-6cc3-446c-b398-f40102ca1e89 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:49.183519 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea824e-5b67-499c-9fa1-7b1509b6ccce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:49.184131 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea824e-5b67-499c-9fa1-7b1509b6ccce admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:49.184438 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea824e-5b67-499c-9fa1-7b1509b6ccce admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:49.184713 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ea824e-5b67-499c-9fa1-7b1509b6ccce admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:49.185365 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea824e-5b67-499c-9fa1-7b1509b6ccce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:49.187254 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48ea824e-5b67-499c-9fa1-7b1509b6ccce admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:49.208182 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1189/2362] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:27:49 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:27:49.212585 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f56ba-bca5-4f04-a246-2c2d801d9c3d admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:49.223090 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c9f56ba-bca5-4f04-a246-2c2d801d9c3d admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:49.227685 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ef6ca-a671-426e-a778-0d093ba66f69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:49.228355 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ef6ca-a671-426e-a778-0d093ba66f69 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:49.228633 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ef6ca-a671-426e-a778-0d093ba66f69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:49.228904 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747ef6ca-a671-426e-a778-0d093ba66f69 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:49.230262 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747ef6ca-a671-426e-a778-0d093ba66f69 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:49.231872 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747ef6ca-a671-426e-a778-0d093ba66f69 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:49.242555 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1174/2363] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:27:49.247163 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea824e-5b67-499c-9fa1-7b1509b6ccce admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:49.256978 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48ea824e-5b67-499c-9fa1-7b1509b6ccce admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:49.262090 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a4026-00a8-4b43-a53f-27784839caef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:49.262778 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a4026-00a8-4b43-a53f-27784839caef admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:49.263066 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a4026-00a8-4b43-a53f-27784839caef admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:49.263409 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1a4026-00a8-4b43-a53f-27784839caef admin admin] PATH_INFO: `/v3/projects/081cac2f0e8246a6a567fc8f0d1a5616/users/b9f5ecbf0c1d4f8ba5dae5cdd9fc3415/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:49.278148 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a4026-00a8-4b43-a53f-27784839caef admin admin] RBAC: Authorizing `identity:create_grant(project_id=081cac2f0e8246a6a567fc8f0d1a5616, user_id=b9f5ecbf0c1d4f8ba5dae5cdd9fc3415, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:49.280899 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a1a4026-00a8-4b43-a53f-27784839caef admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:49.293848 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1190/2364] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:27:49 2022] PUT /identity/v3/projects/081cac2f0e8246a6a567fc8f0d1a5616/users/b9f5ecbf0c1d4f8ba5dae5cdd9fc3415/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:27:49.297768 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ef6ca-a671-426e-a778-0d093ba66f69 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:49.308435 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747ef6ca-a671-426e-a778-0d093ba66f69 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:49.354011 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:27:49.367487 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ed4fcb-9a2d-480b-8058-7a2845f050e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:49.368114 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed4fcb-9a2d-480b-8058-7a2845f050e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:49.368451 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed4fcb-9a2d-480b-8058-7a2845f050e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:49.368734 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ed4fcb-9a2d-480b-8058-7a2845f050e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:49.369430 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed4fcb-9a2d-480b-8058-7a2845f050e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:49.371728 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76ed4fcb-9a2d-480b-8058-7a2845f050e4 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:49.381493 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1175/2365] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:27:49 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:27:49.385855 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a4026-00a8-4b43-a53f-27784839caef admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:49.395918 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a1a4026-00a8-4b43-a53f-27784839caef admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:49.400469 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6da9c0-ea3f-4f73-9e88-55a7322b4d5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:49.401126 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6da9c0-ea3f-4f73-9e88-55a7322b4d5d admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:49.401983 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6da9c0-ea3f-4f73-9e88-55a7322b4d5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:49.402489 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6da9c0-ea3f-4f73-9e88-55a7322b4d5d admin admin] PATH_INFO: `/v3/projects/081cac2f0e8246a6a567fc8f0d1a5616/users/b9f5ecbf0c1d4f8ba5dae5cdd9fc3415/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:49.404088 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6da9c0-ea3f-4f73-9e88-55a7322b4d5d admin admin] RBAC: Authorizing `identity:create_grant(project_id=081cac2f0e8246a6a567fc8f0d1a5616, user_id=b9f5ecbf0c1d4f8ba5dae5cdd9fc3415, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:49.406744 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6da9c0-ea3f-4f73-9e88-55a7322b4d5d admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:49.417747 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1191/2366] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:27:49 2022] PUT /identity/v3/projects/081cac2f0e8246a6a567fc8f0d1a5616/users/b9f5ecbf0c1d4f8ba5dae5cdd9fc3415/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:27:49.427841 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc2a73-3ace-4049-9c95-e4764e25c19e None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:49.428125 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc2a73-3ace-4049-9c95-e4764e25c19e None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:49.428442 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67dc2a73-3ace-4049-9c95-e4764e25c19e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:49.457106 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-67dc2a73-3ace-4049-9c95-e4764e25c19e None None] MFA Rules not processed for user `b9f5ecbf0c1d4f8ba5dae5cdd9fc3415`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:27:49.458303 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-67dc2a73-3ace-4049-9c95-e4764e25c19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:27:49.524193 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1176/2367] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:27:49 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:27:49.535910 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6da9c0-ea3f-4f73-9e88-55a7322b4d5d admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:49.537622 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-4e6da9c0-ea3f-4f73-9e88-55a7322b4d5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:27:49.561278 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:INSERT=8,keystone:SELECT=92 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:27:49.598183 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6da9c0-ea3f-4f73-9e88-55a7322b4d5d admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:49.601771 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047f24b-e144-4236-b55c-c6a40942f9b7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:49.602381 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047f24b-e144-4236-b55c-c6a40942f9b7 service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:49.602771 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047f24b-e144-4236-b55c-c6a40942f9b7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:49.603048 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5047f24b-e144-4236-b55c-c6a40942f9b7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:49.613120 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5047f24b-e144-4236-b55c-c6a40942f9b7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:49.614468 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5047f24b-e144-4236-b55c-c6a40942f9b7 service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:49.623864 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1192/2368] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:27:49 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:27:49.668017 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc2a73-3ace-4049-9c95-e4764e25c19e None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:49.669354 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-67dc2a73-3ace-4049-9c95-e4764e25c19e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:27:49.681364 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67dc2a73-3ace-4049-9c95-e4764e25c19e None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:49.685086 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df16911-2168-4a51-9431-d3686e47827f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:49.685691 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df16911-2168-4a51-9431-d3686e47827f service cinder] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:49.685968 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df16911-2168-4a51-9431-d3686e47827f service cinder] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:49.686240 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df16911-2168-4a51-9431-d3686e47827f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:49.741533 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df16911-2168-4a51-9431-d3686e47827f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:49.743278 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df16911-2168-4a51-9431-d3686e47827f service cinder] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:49.752269 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1177/2369] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:27:49 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:27:53.036135 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047f24b-e144-4236-b55c-c6a40942f9b7 service cinder] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:53.101501 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5047f24b-e144-4236-b55c-c6a40942f9b7 service cinder] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:53.106771 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd0ea6-b375-4f5b-ae61-504260b01e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:53.107406 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd0ea6-b375-4f5b-ae61-504260b01e63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:53.107689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd0ea6-b375-4f5b-ae61-504260b01e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:53.107964 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bd0ea6-b375-4f5b-ae61-504260b01e63 admin admin] PATH_INFO: `/v3/users/f6d128eadb114eb58a003bfc06c2ec4a` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:53.109154 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd0ea6-b375-4f5b-ae61-504260b01e63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6d128eadb114eb58a003bfc06c2ec4a)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:53.111057 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bd0ea6-b375-4f5b-ae61-504260b01e63 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:53.160722 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-78bd0ea6-b375-4f5b-ae61-504260b01e63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6d128eadb114eb58a003bfc06c2ec4a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:53.176076 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-78bd0ea6-b375-4f5b-ae61-504260b01e63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6d128eadb114eb58a003bfc06c2ec4a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:53.176843 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-78bd0ea6-b375-4f5b-ae61-504260b01e63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6d128eadb114eb58a003bfc06c2ec4a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:53.177510 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-78bd0ea6-b375-4f5b-ae61-504260b01e63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6d128eadb114eb58a003bfc06c2ec4a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:53.186045 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-78bd0ea6-b375-4f5b-ae61-504260b01e63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6d128eadb114eb58a003bfc06c2ec4a'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:53.199143 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1193/2370] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:27:53 2022] DELETE /identity/v3/users/f6d128eadb114eb58a003bfc06c2ec4a => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:27:53.203703 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7bfe9-ea97-4d0f-a7af-241787100efc None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:53.204175 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7bfe9-ea97-4d0f-a7af-241787100efc None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:53.204281 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc7bfe9-ea97-4d0f-a7af-241787100efc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:53.225604 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-6cc7bfe9-ea97-4d0f-a7af-241787100efc None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:27:53.226816 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-6cc7bfe9-ea97-4d0f-a7af-241787100efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:27:53.292532 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1178/2371] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:27:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:27:53.302609 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd0ea6-b375-4f5b-ae61-504260b01e63 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:53.304098 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-78bd0ea6-b375-4f5b-ae61-504260b01e63 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:27:53.356245 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:27:53.369708 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bd0ea6-b375-4f5b-ae61-504260b01e63 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:53.375318 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564122c8-6c66-48c4-bac7-7310757f53f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:53.376244 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564122c8-6c66-48c4-bac7-7310757f53f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:53.382348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564122c8-6c66-48c4-bac7-7310757f53f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:53.382348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564122c8-6c66-48c4-bac7-7310757f53f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:53.392316 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564122c8-6c66-48c4-bac7-7310757f53f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:53.393925 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564122c8-6c66-48c4-bac7-7310757f53f2 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:53.405139 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1194/2372] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:27:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:27:53.778146 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7bfe9-ea97-4d0f-a7af-241787100efc None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:53.779693 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-6cc7bfe9-ea97-4d0f-a7af-241787100efc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:27:53.792660 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc7bfe9-ea97-4d0f-a7af-241787100efc None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:53.798400 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb3f96-c4e3-4aa5-8e27-a8ea58daf3d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:53.798400 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb3f96-c4e3-4aa5-8e27-a8ea58daf3d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:53.798685 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb3f96-c4e3-4aa5-8e27-a8ea58daf3d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:53.798806 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19cb3f96-c4e3-4aa5-8e27-a8ea58daf3d8 admin admin] PATH_INFO: `/v3/projects/34ea813e410745c7a211933c00438b1e` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:53.799973 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb3f96-c4e3-4aa5-8e27-a8ea58daf3d8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=34ea813e410745c7a211933c00438b1e)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:53.801909 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19cb3f96-c4e3-4aa5-8e27-a8ea58daf3d8 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:53.809282 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:27:53.859097 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-19cb3f96-c4e3-4aa5-8e27-a8ea58daf3d8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '34ea813e410745c7a211933c00438b1e', 'request_id': 'req-19cb3f96-c4e3-4aa5-8e27-a8ea58daf3d8'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:53.865930 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-19cb3f96-c4e3-4aa5-8e27-a8ea58daf3d8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '34ea813e410745c7a211933c00438b1e', 'request_id': 'req-19cb3f96-c4e3-4aa5-8e27-a8ea58daf3d8'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:53.875123 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-19cb3f96-c4e3-4aa5-8e27-a8ea58daf3d8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '34ea813e410745c7a211933c00438b1e', 'request_id': 'req-19cb3f96-c4e3-4aa5-8e27-a8ea58daf3d8'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:53.889570 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-19cb3f96-c4e3-4aa5-8e27-a8ea58daf3d8 admin admin] The token cache is being invalidate because project 34ea813e410745c7a211933c00438b1e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:27:53.889932 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-19cb3f96-c4e3-4aa5-8e27-a8ea58daf3d8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:53.890582 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-19cb3f96-c4e3-4aa5-8e27-a8ea58daf3d8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:53.892095 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1179/2373] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:27:53 2022] DELETE /identity/v3/projects/34ea813e410745c7a211933c00438b1e => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:27:53.896259 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564122c8-6c66-48c4-bac7-7310757f53f2 service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:53.907351 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564122c8-6c66-48c4-bac7-7310757f53f2 service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:53.963381 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd27217-70a8-4f13-aa34-b52964cb9562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:53.964994 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd27217-70a8-4f13-aa34-b52964cb9562 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:53.965267 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd27217-70a8-4f13-aa34-b52964cb9562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:53.965536 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd27217-70a8-4f13-aa34-b52964cb9562 admin admin] PATH_INFO: `/v3/users/b9f5ecbf0c1d4f8ba5dae5cdd9fc3415` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:53.966717 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd27217-70a8-4f13-aa34-b52964cb9562 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b9f5ecbf0c1d4f8ba5dae5cdd9fc3415)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:53.968750 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd27217-70a8-4f13-aa34-b52964cb9562 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:54.024170 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9fd27217-70a8-4f13-aa34-b52964cb9562 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b9f5ecbf0c1d4f8ba5dae5cdd9fc3415'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:54.038371 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9fd27217-70a8-4f13-aa34-b52964cb9562 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b9f5ecbf0c1d4f8ba5dae5cdd9fc3415'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:54.039130 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9fd27217-70a8-4f13-aa34-b52964cb9562 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b9f5ecbf0c1d4f8ba5dae5cdd9fc3415'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:54.039743 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9fd27217-70a8-4f13-aa34-b52964cb9562 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b9f5ecbf0c1d4f8ba5dae5cdd9fc3415'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:54.047892 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9fd27217-70a8-4f13-aa34-b52964cb9562 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b9f5ecbf0c1d4f8ba5dae5cdd9fc3415'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:54.060445 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1195/2374] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:27:53 2022] DELETE /identity/v3/users/b9f5ecbf0c1d4f8ba5dae5cdd9fc3415 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:27:54.394062 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb3f96-c4e3-4aa5-8e27-a8ea58daf3d8 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:54.395808 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-19cb3f96-c4e3-4aa5-8e27-a8ea58daf3d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:27:54.411878 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19cb3f96-c4e3-4aa5-8e27-a8ea58daf3d8 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:54.477689 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-720e499c-8f5f-46b2-b3d2-4e9122692e1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:54.478345 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e499c-8f5f-46b2-b3d2-4e9122692e1b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:54.478627 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e499c-8f5f-46b2-b3d2-4e9122692e1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:54.478905 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720e499c-8f5f-46b2-b3d2-4e9122692e1b admin admin] PATH_INFO: `/v3/projects/081cac2f0e8246a6a567fc8f0d1a5616` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:54.480953 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e499c-8f5f-46b2-b3d2-4e9122692e1b admin admin] RBAC: Authorizing `identity:delete_project(project_id=081cac2f0e8246a6a567fc8f0d1a5616)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:54.482898 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-720e499c-8f5f-46b2-b3d2-4e9122692e1b admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:54.533890 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-720e499c-8f5f-46b2-b3d2-4e9122692e1b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '081cac2f0e8246a6a567fc8f0d1a5616', 'request_id': 'req-720e499c-8f5f-46b2-b3d2-4e9122692e1b'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:54.539237 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-720e499c-8f5f-46b2-b3d2-4e9122692e1b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '081cac2f0e8246a6a567fc8f0d1a5616', 'request_id': 'req-720e499c-8f5f-46b2-b3d2-4e9122692e1b'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:54.547373 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-720e499c-8f5f-46b2-b3d2-4e9122692e1b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '081cac2f0e8246a6a567fc8f0d1a5616', 'request_id': 'req-720e499c-8f5f-46b2-b3d2-4e9122692e1b'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:54.559268 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-720e499c-8f5f-46b2-b3d2-4e9122692e1b admin admin] The token cache is being invalidate because project 081cac2f0e8246a6a567fc8f0d1a5616 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:27:54.559556 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-720e499c-8f5f-46b2-b3d2-4e9122692e1b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:54.560288 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-720e499c-8f5f-46b2-b3d2-4e9122692e1b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:54.562008 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1180/2375] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:27:54 2022] DELETE /identity/v3/projects/081cac2f0e8246a6a567fc8f0d1a5616 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:27:54.566600 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b39e8-0067-4756-adfb-4633247d1a11 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:54.566964 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b39e8-0067-4756-adfb-4633247d1a11 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:54.567268 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0b39e8-0067-4756-adfb-4633247d1a11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:54.588411 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-8b0b39e8-0067-4756-adfb-4633247d1a11 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:27:54.590237 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-8b0b39e8-0067-4756-adfb-4633247d1a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:27:54.652683 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1196/2376] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:27:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:27:54.660501 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6911aec-23ff-431e-ad80-0e06dfab02e5 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:54.660793 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6911aec-23ff-431e-ad80-0e06dfab02e5 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:54.661072 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6911aec-23ff-431e-ad80-0e06dfab02e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:54.682403 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-b6911aec-23ff-431e-ad80-0e06dfab02e5 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:27:54.683933 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-b6911aec-23ff-431e-ad80-0e06dfab02e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:27:54.692096 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1181/2377] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:27:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:27:54.696417 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b39e8-0067-4756-adfb-4633247d1a11 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:54.703144 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:27:54.707426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0b39e8-0067-4756-adfb-4633247d1a11 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:54.715005 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62edfc04-60d6-414c-97d5-86d26f83db1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:54.715797 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edfc04-60d6-414c-97d5-86d26f83db1b admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:54.716255 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edfc04-60d6-414c-97d5-86d26f83db1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:54.716624 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62edfc04-60d6-414c-97d5-86d26f83db1b admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:54.717470 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62edfc04-60d6-414c-97d5-86d26f83db1b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:27:54.717777 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62edfc04-60d6-414c-97d5-86d26f83db1b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:54.719375 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62edfc04-60d6-414c-97d5-86d26f83db1b admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:54.732625 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1197/2378] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:27:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:27:54.737425 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6911aec-23ff-431e-ad80-0e06dfab02e5 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:54.747843 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6911aec-23ff-431e-ad80-0e06dfab02e5 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:54.752775 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec475e-d074-45be-86ed-c3f6e74daf6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:54.753391 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec475e-d074-45be-86ed-c3f6e74daf6c admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:54.753673 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec475e-d074-45be-86ed-c3f6e74daf6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:54.753951 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cec475e-d074-45be-86ed-c3f6e74daf6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:54.754622 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec475e-d074-45be-86ed-c3f6e74daf6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:54.756560 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cec475e-d074-45be-86ed-c3f6e74daf6c admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:54.773733 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:27:54.786567 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1182/2379] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:27:54 2022] POST /identity/v3/projects => generated 393 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:27:54.790662 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62edfc04-60d6-414c-97d5-86d26f83db1b admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:54.801132 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62edfc04-60d6-414c-97d5-86d26f83db1b admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:54.867661 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa874c32-e407-451c-b495-eac09f204d78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:54.868289 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa874c32-e407-451c-b495-eac09f204d78 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:54.868608 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa874c32-e407-451c-b495-eac09f204d78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:54.868876 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa874c32-e407-451c-b495-eac09f204d78 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:54.869555 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa874c32-e407-451c-b495-eac09f204d78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:54.871529 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa874c32-e407-451c-b495-eac09f204d78 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:54.892975 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1198/2380] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:27:54 2022] POST /identity/v3/users => generated 297 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:27:54.897519 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec475e-d074-45be-86ed-c3f6e74daf6c admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:54.910483 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cec475e-d074-45be-86ed-c3f6e74daf6c admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:54.915089 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0d826-53e6-4a32-9ceb-ec3dbae10def admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:54.915695 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0d826-53e6-4a32-9ceb-ec3dbae10def admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:54.915973 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0d826-53e6-4a32-9ceb-ec3dbae10def admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:54.916245 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f0d826-53e6-4a32-9ceb-ec3dbae10def admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:54.917604 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f0d826-53e6-4a32-9ceb-ec3dbae10def admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:54.919191 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f0d826-53e6-4a32-9ceb-ec3dbae10def admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:54.928974 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1183/2381] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:27:54.933714 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa874c32-e407-451c-b495-eac09f204d78 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:54.943717 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa874c32-e407-451c-b495-eac09f204d78 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:54.949076 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38e5f920-bf97-4d42-9225-4574f4e5f40c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:54.949687 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5f920-bf97-4d42-9225-4574f4e5f40c admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:54.949971 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5f920-bf97-4d42-9225-4574f4e5f40c admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:54.950245 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e5f920-bf97-4d42-9225-4574f4e5f40c admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:54.950932 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5f920-bf97-4d42-9225-4574f4e5f40c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:54.952538 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38e5f920-bf97-4d42-9225-4574f4e5f40c admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:54.963319 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1199/2382] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:27:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:27:54.967853 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0d826-53e6-4a32-9ceb-ec3dbae10def admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:54.977654 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f0d826-53e6-4a32-9ceb-ec3dbae10def admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:54.983355 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7300da3-ea35-409e-9907-219f050a3c36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:54.984001 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7300da3-ea35-409e-9907-219f050a3c36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:54.984278 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7300da3-ea35-409e-9907-219f050a3c36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:54.984589 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7300da3-ea35-409e-9907-219f050a3c36 admin admin] PATH_INFO: `/v3/projects/b3ae41d7e41d45948e26ed7bf60d7778/users/5e776b39ed54464589e17cc7ab3fc05c/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:54.999039 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7300da3-ea35-409e-9907-219f050a3c36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3ae41d7e41d45948e26ed7bf60d7778, user_id=5e776b39ed54464589e17cc7ab3fc05c, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:55.001737 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7300da3-ea35-409e-9907-219f050a3c36 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:55.015298 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1184/2383] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:27:54 2022] PUT /identity/v3/projects/b3ae41d7e41d45948e26ed7bf60d7778/users/5e776b39ed54464589e17cc7ab3fc05c/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:27:55.027465 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c44f9d-c8b9-4deb-a081-3e77b7dec2df None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:55.027760 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c44f9d-c8b9-4deb-a081-3e77b7dec2df None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:55.028043 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c44f9d-c8b9-4deb-a081-3e77b7dec2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:55.055227 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-d5c44f9d-c8b9-4deb-a081-3e77b7dec2df None None] MFA Rules not processed for user `5e776b39ed54464589e17cc7ab3fc05c`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:27:55.056471 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-d5c44f9d-c8b9-4deb-a081-3e77b7dec2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:27:55.122801 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1200/2384] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:27:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:27:55.127225 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7300da3-ea35-409e-9907-219f050a3c36 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:55.189213 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7300da3-ea35-409e-9907-219f050a3c36 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:55.193900 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe78b8-64d5-4b85-ba16-626dae13db8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:55.194512 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe78b8-64d5-4b85-ba16-626dae13db8a admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:55.194796 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe78b8-64d5-4b85-ba16-626dae13db8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:55.195072 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbbe78b8-64d5-4b85-ba16-626dae13db8a admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:55.195758 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe78b8-64d5-4b85-ba16-626dae13db8a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:55.197691 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbbe78b8-64d5-4b85-ba16-626dae13db8a admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:55.232166 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1185/2385] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:27:55 2022] POST /identity/v3/projects => generated 391 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:27:55.236170 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c44f9d-c8b9-4deb-a081-3e77b7dec2df None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:55.247244 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c44f9d-c8b9-4deb-a081-3e77b7dec2df None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:55.304995 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be2b8b-fa96-4747-aa87-d8876a8bb095 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:55.305957 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be2b8b-fa96-4747-aa87-d8876a8bb095 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:55.306389 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be2b8b-fa96-4747-aa87-d8876a8bb095 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:55.306840 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90be2b8b-fa96-4747-aa87-d8876a8bb095 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:55.307654 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be2b8b-fa96-4747-aa87-d8876a8bb095 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:55.309886 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90be2b8b-fa96-4747-aa87-d8876a8bb095 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:55.318353 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:27:55.336700 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1201/2386] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:27:55 2022] POST /identity/v3/users => generated 302 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:27:55.344538 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe78b8-64d5-4b85-ba16-626dae13db8a admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:55.363292 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbbe78b8-64d5-4b85-ba16-626dae13db8a admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:55.374634 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0e52b-c91e-4692-9a17-7a84d2bc87ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:55.376086 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0e52b-c91e-4692-9a17-7a84d2bc87ee admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:55.376493 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0e52b-c91e-4692-9a17-7a84d2bc87ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:55.376830 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e0e52b-c91e-4692-9a17-7a84d2bc87ee admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:55.378520 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e0e52b-c91e-4692-9a17-7a84d2bc87ee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:55.380627 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e0e52b-c91e-4692-9a17-7a84d2bc87ee admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:55.398367 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1186/2387] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:27:55.399513 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be2b8b-fa96-4747-aa87-d8876a8bb095 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:55.409729 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90be2b8b-fa96-4747-aa87-d8876a8bb095 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:55.414354 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e59143-317a-473f-91d0-6b4b6bc51617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:55.415035 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e59143-317a-473f-91d0-6b4b6bc51617 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:55.417830 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e59143-317a-473f-91d0-6b4b6bc51617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:55.417830 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e59143-317a-473f-91d0-6b4b6bc51617 admin admin] PATH_INFO: `/v3/projects/82e6c5f1baf54e49a0f076352c5f02f6/users/13974c8c0e9347eda1ebf29155772179/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:55.433429 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e59143-317a-473f-91d0-6b4b6bc51617 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82e6c5f1baf54e49a0f076352c5f02f6, user_id=13974c8c0e9347eda1ebf29155772179, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:55.437185 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84e59143-317a-473f-91d0-6b4b6bc51617 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:55.459699 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1202/2388] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:27:55 2022] PUT /identity/v3/projects/82e6c5f1baf54e49a0f076352c5f02f6/users/13974c8c0e9347eda1ebf29155772179/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:27:55.464557 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0e52b-c91e-4692-9a17-7a84d2bc87ee admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:55.475110 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e0e52b-c91e-4692-9a17-7a84d2bc87ee admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:55.532848 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c921d8-dcc2-4c8e-9e1e-fa3c64d8f332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:55.533470 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c921d8-dcc2-4c8e-9e1e-fa3c64d8f332 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:55.533746 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c921d8-dcc2-4c8e-9e1e-fa3c64d8f332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:55.534013 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c921d8-dcc2-4c8e-9e1e-fa3c64d8f332 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:55.534709 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c921d8-dcc2-4c8e-9e1e-fa3c64d8f332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:55.536354 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c921d8-dcc2-4c8e-9e1e-fa3c64d8f332 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:55.547146 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1187/2389] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:27:55 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:27:55.553405 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e59143-317a-473f-91d0-6b4b6bc51617 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:55.566473 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e59143-317a-473f-91d0-6b4b6bc51617 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:55.575147 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb41d4-67fb-4cd9-9925-97df5af70342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:55.576314 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb41d4-67fb-4cd9-9925-97df5af70342 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:55.576883 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb41d4-67fb-4cd9-9925-97df5af70342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:55.577388 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb41d4-67fb-4cd9-9925-97df5af70342 admin admin] PATH_INFO: `/v3/projects/82e6c5f1baf54e49a0f076352c5f02f6/users/13974c8c0e9347eda1ebf29155772179/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:55.580674 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb41d4-67fb-4cd9-9925-97df5af70342 admin admin] RBAC: Authorizing `identity:create_grant(project_id=82e6c5f1baf54e49a0f076352c5f02f6, user_id=13974c8c0e9347eda1ebf29155772179, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:55.586013 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb41d4-67fb-4cd9-9925-97df5af70342 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:55.613645 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1203/2390] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:27:55 2022] PUT /identity/v3/projects/82e6c5f1baf54e49a0f076352c5f02f6/users/13974c8c0e9347eda1ebf29155772179/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:27:55.615898 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f35477-330c-4d1e-b613-1d97930d6991 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:55.616231 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f35477-330c-4d1e-b613-1d97930d6991 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:55.616621 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f35477-330c-4d1e-b613-1d97930d6991 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:55.646195 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-29f35477-330c-4d1e-b613-1d97930d6991 None None] MFA Rules not processed for user `13974c8c0e9347eda1ebf29155772179`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:27:55.647309 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-29f35477-330c-4d1e-b613-1d97930d6991 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:27:55.665734 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:27:55.722151 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1188/2391] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:27:55 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:27:55.732944 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb41d4-67fb-4cd9-9925-97df5af70342 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:55.734675 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-27fb41d4-67fb-4cd9-9925-97df5af70342 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:27:55.794065 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb41d4-67fb-4cd9-9925-97df5af70342 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:55.797765 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47786530-5018-4603-a295-b890d01a839b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:55.798389 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47786530-5018-4603-a295-b890d01a839b service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:55.798670 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47786530-5018-4603-a295-b890d01a839b service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:55.798945 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47786530-5018-4603-a295-b890d01a839b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:55.808923 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47786530-5018-4603-a295-b890d01a839b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:55.810386 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47786530-5018-4603-a295-b890d01a839b service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:55.821049 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1204/2392] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:27:55 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:27:55.873934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f35477-330c-4d1e-b613-1d97930d6991 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:55.884282 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f35477-330c-4d1e-b613-1d97930d6991 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:55.889035 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a44ce2c-df13-4399-af22-77cfb5dbec39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:55.889651 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44ce2c-df13-4399-af22-77cfb5dbec39 service cinder] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:55.890656 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44ce2c-df13-4399-af22-77cfb5dbec39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:55.890934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a44ce2c-df13-4399-af22-77cfb5dbec39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:55.955811 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44ce2c-df13-4399-af22-77cfb5dbec39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:55.957284 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a44ce2c-df13-4399-af22-77cfb5dbec39 service cinder] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:55.967127 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1189/2393] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:27:55 2022] GET /identity/v3/auth/tokens => generated 3270 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:27:59.336274 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47786530-5018-4603-a295-b890d01a839b service cinder] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:59.397415 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47786530-5018-4603-a295-b890d01a839b service cinder] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:59.402583 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e3123-43f5-40d8-a607-8e3b3d0f0d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:59.403216 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e3123-43f5-40d8-a607-8e3b3d0f0d8a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:59.403498 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e3123-43f5-40d8-a607-8e3b3d0f0d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:59.403777 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-760e3123-43f5-40d8-a607-8e3b3d0f0d8a admin admin] PATH_INFO: `/v3/users/5e776b39ed54464589e17cc7ab3fc05c` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:59.404976 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e3123-43f5-40d8-a607-8e3b3d0f0d8a admin admin] RBAC: Authorizing `identity:delete_user(user_id=5e776b39ed54464589e17cc7ab3fc05c)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:59.406879 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-760e3123-43f5-40d8-a607-8e3b3d0f0d8a admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:59.451454 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-760e3123-43f5-40d8-a607-8e3b3d0f0d8a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5e776b39ed54464589e17cc7ab3fc05c'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:59.458317 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:INSERT=5,keystone:SELECT=87,keystone:DELETE=8 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:27:59.465986 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-760e3123-43f5-40d8-a607-8e3b3d0f0d8a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5e776b39ed54464589e17cc7ab3fc05c'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:59.466932 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-760e3123-43f5-40d8-a607-8e3b3d0f0d8a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5e776b39ed54464589e17cc7ab3fc05c'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:59.467879 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-760e3123-43f5-40d8-a607-8e3b3d0f0d8a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5e776b39ed54464589e17cc7ab3fc05c'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:59.475287 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-760e3123-43f5-40d8-a607-8e3b3d0f0d8a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5e776b39ed54464589e17cc7ab3fc05c'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:27:59.487949 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1205/2394] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:27:59 2022] DELETE /identity/v3/users/5e776b39ed54464589e17cc7ab3fc05c => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:27:59.492628 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f3050-cd6c-4806-a646-97b61c74f213 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:59.493124 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f3050-cd6c-4806-a646-97b61c74f213 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:59.493222 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6f3050-cd6c-4806-a646-97b61c74f213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:59.512435 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-3b6f3050-cd6c-4806-a646-97b61c74f213 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:27:59.513618 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-3b6f3050-cd6c-4806-a646-97b61c74f213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:27:59.571008 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1190/2395] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:27:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:27:59.580723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e3123-43f5-40d8-a607-8e3b3d0f0d8a admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:59.582157 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-760e3123-43f5-40d8-a607-8e3b3d0f0d8a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:27:59.640748 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-760e3123-43f5-40d8-a607-8e3b3d0f0d8a admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:59.644357 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdadeb23-2839-4738-822e-e015a063d1ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:59.644971 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdadeb23-2839-4738-822e-e015a063d1ab service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:59.645249 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdadeb23-2839-4738-822e-e015a063d1ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:59.645520 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdadeb23-2839-4738-822e-e015a063d1ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:59.654342 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdadeb23-2839-4738-822e-e015a063d1ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:59.655743 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdadeb23-2839-4738-822e-e015a063d1ab service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:27:59.664917 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1206/2396] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:27:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:27:59.933185 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f3050-cd6c-4806-a646-97b61c74f213 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:27:59.934645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-3b6f3050-cd6c-4806-a646-97b61c74f213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:27:59.946641 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6f3050-cd6c-4806-a646-97b61c74f213 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:27:59.951284 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be9d00-82ce-4c98-96aa-4f21c14bd0ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:27:59.951896 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be9d00-82ce-4c98-96aa-4f21c14bd0ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:27:59.952173 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be9d00-82ce-4c98-96aa-4f21c14bd0ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:27:59.952481 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4be9d00-82ce-4c98-96aa-4f21c14bd0ee admin admin] PATH_INFO: `/v3/projects/b3ae41d7e41d45948e26ed7bf60d7778` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:27:59.953643 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be9d00-82ce-4c98-96aa-4f21c14bd0ee admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3ae41d7e41d45948e26ed7bf60d7778)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:27:59.955543 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4be9d00-82ce-4c98-96aa-4f21c14bd0ee admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:00.002746 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-c4be9d00-82ce-4c98-96aa-4f21c14bd0ee admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3ae41d7e41d45948e26ed7bf60d7778', 'request_id': 'req-c4be9d00-82ce-4c98-96aa-4f21c14bd0ee'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:00.004018 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:00.009405 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-c4be9d00-82ce-4c98-96aa-4f21c14bd0ee admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3ae41d7e41d45948e26ed7bf60d7778', 'request_id': 'req-c4be9d00-82ce-4c98-96aa-4f21c14bd0ee'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:00.017569 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-c4be9d00-82ce-4c98-96aa-4f21c14bd0ee admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3ae41d7e41d45948e26ed7bf60d7778', 'request_id': 'req-c4be9d00-82ce-4c98-96aa-4f21c14bd0ee'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:00.029609 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-c4be9d00-82ce-4c98-96aa-4f21c14bd0ee admin admin] The token cache is being invalidate because project b3ae41d7e41d45948e26ed7bf60d7778 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:28:00.029928 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-c4be9d00-82ce-4c98-96aa-4f21c14bd0ee admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:00.030521 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-c4be9d00-82ce-4c98-96aa-4f21c14bd0ee admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:00.032032 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1191/2397] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:27:59 2022] DELETE /identity/v3/projects/b3ae41d7e41d45948e26ed7bf60d7778 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:28:00.036003 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdadeb23-2839-4738-822e-e015a063d1ab service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:00.046354 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdadeb23-2839-4738-822e-e015a063d1ab service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:00.108160 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38118698-d2dd-4236-86f1-f968b41d2d11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:00.109132 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38118698-d2dd-4236-86f1-f968b41d2d11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:00.109564 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38118698-d2dd-4236-86f1-f968b41d2d11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:00.109992 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38118698-d2dd-4236-86f1-f968b41d2d11 admin admin] PATH_INFO: `/v3/users/13974c8c0e9347eda1ebf29155772179` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:00.111466 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38118698-d2dd-4236-86f1-f968b41d2d11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13974c8c0e9347eda1ebf29155772179)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:00.113443 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38118698-d2dd-4236-86f1-f968b41d2d11 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:00.162320 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-38118698-d2dd-4236-86f1-f968b41d2d11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13974c8c0e9347eda1ebf29155772179'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:00.175029 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-38118698-d2dd-4236-86f1-f968b41d2d11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13974c8c0e9347eda1ebf29155772179'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:00.175794 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-38118698-d2dd-4236-86f1-f968b41d2d11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13974c8c0e9347eda1ebf29155772179'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:00.176437 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-38118698-d2dd-4236-86f1-f968b41d2d11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13974c8c0e9347eda1ebf29155772179'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:00.188747 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-38118698-d2dd-4236-86f1-f968b41d2d11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13974c8c0e9347eda1ebf29155772179'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:00.194428 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:00.204596 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1207/2398] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:28:00 2022] DELETE /identity/v3/users/13974c8c0e9347eda1ebf29155772179 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:28:00.472100 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be9d00-82ce-4c98-96aa-4f21c14bd0ee admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:00.473624 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-c4be9d00-82ce-4c98-96aa-4f21c14bd0ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:28:00.487670 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4be9d00-82ce-4c98-96aa-4f21c14bd0ee admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:00.544154 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c71d706-7b33-4eda-8abe-d074a2541a21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:00.544848 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71d706-7b33-4eda-8abe-d074a2541a21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:00.545084 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71d706-7b33-4eda-8abe-d074a2541a21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:00.545356 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c71d706-7b33-4eda-8abe-d074a2541a21 admin admin] PATH_INFO: `/v3/projects/82e6c5f1baf54e49a0f076352c5f02f6` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:00.546501 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c71d706-7b33-4eda-8abe-d074a2541a21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=82e6c5f1baf54e49a0f076352c5f02f6)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:00.548426 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c71d706-7b33-4eda-8abe-d074a2541a21 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:00.594402 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-2c71d706-7b33-4eda-8abe-d074a2541a21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '82e6c5f1baf54e49a0f076352c5f02f6', 'request_id': 'req-2c71d706-7b33-4eda-8abe-d074a2541a21'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:00.599781 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-2c71d706-7b33-4eda-8abe-d074a2541a21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '82e6c5f1baf54e49a0f076352c5f02f6', 'request_id': 'req-2c71d706-7b33-4eda-8abe-d074a2541a21'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:00.610629 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-2c71d706-7b33-4eda-8abe-d074a2541a21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '82e6c5f1baf54e49a0f076352c5f02f6', 'request_id': 'req-2c71d706-7b33-4eda-8abe-d074a2541a21'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:00.622716 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-2c71d706-7b33-4eda-8abe-d074a2541a21 admin admin] The token cache is being invalidate because project 82e6c5f1baf54e49a0f076352c5f02f6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:28:00.623006 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-2c71d706-7b33-4eda-8abe-d074a2541a21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:00.623640 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-2c71d706-7b33-4eda-8abe-d074a2541a21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:00.625182 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1192/2399] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:28:00 2022] DELETE /identity/v3/projects/82e6c5f1baf54e49a0f076352c5f02f6 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:28:00.630022 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ddbd6-9c03-4042-b800-d3439deab120 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:00.630516 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ddbd6-9c03-4042-b800-d3439deab120 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:00.630617 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9ddbd6-9c03-4042-b800-d3439deab120 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:00.651315 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-bb9ddbd6-9c03-4042-b800-d3439deab120 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:28:00.652544 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-bb9ddbd6-9c03-4042-b800-d3439deab120 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:28:00.711067 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1208/2400] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:28:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:28:00.720547 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab548dc-c83d-4d40-89f0-9199f2b28435 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:00.720832 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab548dc-c83d-4d40-89f0-9199f2b28435 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:00.721103 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eab548dc-c83d-4d40-89f0-9199f2b28435 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:00.740060 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-eab548dc-c83d-4d40-89f0-9199f2b28435 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:28:00.741283 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-eab548dc-c83d-4d40-89f0-9199f2b28435 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:28:00.749794 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1193/2401] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:28:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:28:00.753899 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ddbd6-9c03-4042-b800-d3439deab120 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:00.764662 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9ddbd6-9c03-4042-b800-d3439deab120 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:00.769360 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fddb3e6-d548-4a1b-82f9-4b949f5a2d8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:00.769968 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddb3e6-d548-4a1b-82f9-4b949f5a2d8c admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:00.770245 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddb3e6-d548-4a1b-82f9-4b949f5a2d8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:00.770516 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fddb3e6-d548-4a1b-82f9-4b949f5a2d8c admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:00.771207 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fddb3e6-d548-4a1b-82f9-4b949f5a2d8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:28:00.771533 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fddb3e6-d548-4a1b-82f9-4b949f5a2d8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:00.773145 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fddb3e6-d548-4a1b-82f9-4b949f5a2d8c admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:00.784916 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1209/2402] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:28:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:28:00.789069 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab548dc-c83d-4d40-89f0-9199f2b28435 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:00.798256 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eab548dc-c83d-4d40-89f0-9199f2b28435 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:00.802759 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09410f-28f4-448c-abb0-8bc939af19c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:00.803351 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09410f-28f4-448c-abb0-8bc939af19c4 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:00.803627 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09410f-28f4-448c-abb0-8bc939af19c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:00.803897 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf09410f-28f4-448c-abb0-8bc939af19c4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:00.804579 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09410f-28f4-448c-abb0-8bc939af19c4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:00.806463 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf09410f-28f4-448c-abb0-8bc939af19c4 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:00.833565 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1194/2403] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:28:00 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:28:00.837902 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fddb3e6-d548-4a1b-82f9-4b949f5a2d8c admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:00.848712 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fddb3e6-d548-4a1b-82f9-4b949f5a2d8c admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:00.905648 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b592c4-14f6-4e2f-a9a7-5e77613d0f05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:00.906180 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b592c4-14f6-4e2f-a9a7-5e77613d0f05 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:00.906459 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b592c4-14f6-4e2f-a9a7-5e77613d0f05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:00.906735 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b592c4-14f6-4e2f-a9a7-5e77613d0f05 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:00.907399 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b592c4-14f6-4e2f-a9a7-5e77613d0f05 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:00.909318 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b592c4-14f6-4e2f-a9a7-5e77613d0f05 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:00.930087 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1210/2404] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:28:00 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:28:00.934585 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09410f-28f4-448c-abb0-8bc939af19c4 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:00.945271 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf09410f-28f4-448c-abb0-8bc939af19c4 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:00.950098 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b2444-3721-4510-a1f8-6ee87bd85960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:00.950705 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b2444-3721-4510-a1f8-6ee87bd85960 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:00.950991 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b2444-3721-4510-a1f8-6ee87bd85960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:00.951268 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864b2444-3721-4510-a1f8-6ee87bd85960 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:00.951964 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b2444-3721-4510-a1f8-6ee87bd85960 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:00.953590 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864b2444-3721-4510-a1f8-6ee87bd85960 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:00.964265 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1195/2405] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:28:00.968220 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b592c4-14f6-4e2f-a9a7-5e77613d0f05 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:00.978433 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b592c4-14f6-4e2f-a9a7-5e77613d0f05 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:00.984103 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138f867-ac06-47af-b928-9a24a8817801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:00.984953 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138f867-ac06-47af-b928-9a24a8817801 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:00.985270 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138f867-ac06-47af-b928-9a24a8817801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:00.985559 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138f867-ac06-47af-b928-9a24a8817801 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:00.986436 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138f867-ac06-47af-b928-9a24a8817801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:00.988147 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138f867-ac06-47af-b928-9a24a8817801 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:01.000014 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1211/2406] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:28:00 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:28:01.004153 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b2444-3721-4510-a1f8-6ee87bd85960 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:01.014831 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864b2444-3721-4510-a1f8-6ee87bd85960 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:01.019487 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19228237-12c1-498b-b149-6009177e3363 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:01.020139 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19228237-12c1-498b-b149-6009177e3363 admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:01.020471 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19228237-12c1-498b-b149-6009177e3363 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:01.020769 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19228237-12c1-498b-b149-6009177e3363 admin admin] PATH_INFO: `/v3/projects/d18678d663d14373ab78a6a552f4e35b/users/7bdd65dacdfa40f29a9c8c47575b0859/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:01.036108 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19228237-12c1-498b-b149-6009177e3363 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d18678d663d14373ab78a6a552f4e35b, user_id=7bdd65dacdfa40f29a9c8c47575b0859, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:01.038780 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19228237-12c1-498b-b149-6009177e3363 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:01.052381 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1196/2407] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:28:01 2022] PUT /identity/v3/projects/d18678d663d14373ab78a6a552f4e35b/users/7bdd65dacdfa40f29a9c8c47575b0859/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:28:01.063352 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d510dbe-407e-4247-b7e2-518abec6085c None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:01.063644 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d510dbe-407e-4247-b7e2-518abec6085c None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:01.063923 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d510dbe-407e-4247-b7e2-518abec6085c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:01.093905 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-0d510dbe-407e-4247-b7e2-518abec6085c None None] MFA Rules not processed for user `7bdd65dacdfa40f29a9c8c47575b0859`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:28:01.095150 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-0d510dbe-407e-4247-b7e2-518abec6085c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:28:01.145369 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:01.164143 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1212/2408] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:28:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:28:01.169076 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19228237-12c1-498b-b149-6009177e3363 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:01.174604 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:01.235701 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19228237-12c1-498b-b149-6009177e3363 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:01.240395 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df43866-2406-4441-9b0d-7a35d7fcbe16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:01.241009 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df43866-2406-4441-9b0d-7a35d7fcbe16 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:01.241291 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df43866-2406-4441-9b0d-7a35d7fcbe16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:01.241567 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8df43866-2406-4441-9b0d-7a35d7fcbe16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:01.242360 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df43866-2406-4441-9b0d-7a35d7fcbe16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:01.244269 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8df43866-2406-4441-9b0d-7a35d7fcbe16 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:01.273797 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1197/2409] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:28:01 2022] POST /identity/v3/projects => generated 383 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:28:01.278458 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d510dbe-407e-4247-b7e2-518abec6085c None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:01.289320 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d510dbe-407e-4247-b7e2-518abec6085c None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:01.349317 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca66e5-b7b2-4312-97db-efa564dfb644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:01.349940 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca66e5-b7b2-4312-97db-efa564dfb644 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:01.350216 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca66e5-b7b2-4312-97db-efa564dfb644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:01.350490 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca66e5-b7b2-4312-97db-efa564dfb644 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:01.351152 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca66e5-b7b2-4312-97db-efa564dfb644 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:01.353085 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca66e5-b7b2-4312-97db-efa564dfb644 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:01.381113 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1213/2410] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:28:01 2022] POST /identity/v3/users => generated 298 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:28:01.385893 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df43866-2406-4441-9b0d-7a35d7fcbe16 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:01.396058 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8df43866-2406-4441-9b0d-7a35d7fcbe16 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:01.400586 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add7111-56ee-4a88-aa9e-53d7fda6c6c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:01.401189 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add7111-56ee-4a88-aa9e-53d7fda6c6c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:01.401467 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add7111-56ee-4a88-aa9e-53d7fda6c6c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:01.401742 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7add7111-56ee-4a88-aa9e-53d7fda6c6c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:01.402428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add7111-56ee-4a88-aa9e-53d7fda6c6c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:01.404016 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7add7111-56ee-4a88-aa9e-53d7fda6c6c6 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:01.414354 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1198/2411] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:28:01.418433 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca66e5-b7b2-4312-97db-efa564dfb644 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:01.428415 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca66e5-b7b2-4312-97db-efa564dfb644 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:01.433762 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9ae19-94c7-45c9-8275-7e5715a2aacd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:01.434416 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9ae19-94c7-45c9-8275-7e5715a2aacd admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:01.434697 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9ae19-94c7-45c9-8275-7e5715a2aacd admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:01.434971 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa9ae19-94c7-45c9-8275-7e5715a2aacd admin admin] PATH_INFO: `/v3/projects/3f4e67fcbeb0451780ce80aa5fd12262/users/db94f46ad10a4a7f8451bc3fac34c58f/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:01.450628 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9ae19-94c7-45c9-8275-7e5715a2aacd admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f4e67fcbeb0451780ce80aa5fd12262, user_id=db94f46ad10a4a7f8451bc3fac34c58f, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:01.453335 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa9ae19-94c7-45c9-8275-7e5715a2aacd admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:01.467926 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1214/2412] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:28:01 2022] PUT /identity/v3/projects/3f4e67fcbeb0451780ce80aa5fd12262/users/db94f46ad10a4a7f8451bc3fac34c58f/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:28:01.471736 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add7111-56ee-4a88-aa9e-53d7fda6c6c6 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:01.482276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7add7111-56ee-4a88-aa9e-53d7fda6c6c6 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:01.538477 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63d6c8f-ff52-4a7f-9c3f-301fc1cfce35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:01.539084 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d6c8f-ff52-4a7f-9c3f-301fc1cfce35 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:01.539368 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d6c8f-ff52-4a7f-9c3f-301fc1cfce35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:01.539642 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d6c8f-ff52-4a7f-9c3f-301fc1cfce35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:01.540356 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d6c8f-ff52-4a7f-9c3f-301fc1cfce35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:01.542213 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63d6c8f-ff52-4a7f-9c3f-301fc1cfce35 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:01.551863 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1199/2413] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:28:01 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:28:01.556148 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9ae19-94c7-45c9-8275-7e5715a2aacd admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:01.567299 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa9ae19-94c7-45c9-8275-7e5715a2aacd admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:01.571798 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f40ea-9631-4e8e-a7ee-ec6ab28de121 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:01.573076 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f40ea-9631-4e8e-a7ee-ec6ab28de121 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:01.573952 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f40ea-9631-4e8e-a7ee-ec6ab28de121 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:01.574233 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52f40ea-9631-4e8e-a7ee-ec6ab28de121 admin admin] PATH_INFO: `/v3/projects/3f4e67fcbeb0451780ce80aa5fd12262/users/db94f46ad10a4a7f8451bc3fac34c58f/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:01.576184 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f40ea-9631-4e8e-a7ee-ec6ab28de121 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3f4e67fcbeb0451780ce80aa5fd12262, user_id=db94f46ad10a4a7f8451bc3fac34c58f, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:01.578848 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52f40ea-9631-4e8e-a7ee-ec6ab28de121 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:01.589866 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1215/2414] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:28:01 2022] PUT /identity/v3/projects/3f4e67fcbeb0451780ce80aa5fd12262/users/db94f46ad10a4a7f8451bc3fac34c58f/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:28:01.599974 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe216d-e5bd-4584-9d95-a75f694c672d None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:01.600358 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe216d-e5bd-4584-9d95-a75f694c672d None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:01.600648 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbe216d-e5bd-4584-9d95-a75f694c672d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:01.630598 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-6dbe216d-e5bd-4584-9d95-a75f694c672d None None] MFA Rules not processed for user `db94f46ad10a4a7f8451bc3fac34c58f`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:28:01.631784 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-6dbe216d-e5bd-4584-9d95-a75f694c672d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:28:01.694866 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:01.699539 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1200/2415] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:28:01 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:28:01.710246 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f40ea-9631-4e8e-a7ee-ec6ab28de121 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:01.712188 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-f52f40ea-9631-4e8e-a7ee-ec6ab28de121 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:28:01.768072 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52f40ea-9631-4e8e-a7ee-ec6ab28de121 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:01.772068 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e9ee3-b5b5-4e04-8e0e-c6eec0495c04 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:01.772710 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e9ee3-b5b5-4e04-8e0e-c6eec0495c04 service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:01.772989 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e9ee3-b5b5-4e04-8e0e-c6eec0495c04 service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:01.773261 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e29e9ee3-b5b5-4e04-8e0e-c6eec0495c04 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:01.782074 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e9ee3-b5b5-4e04-8e0e-c6eec0495c04 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:01.783481 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e29e9ee3-b5b5-4e04-8e0e-c6eec0495c04 service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:01.793108 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1216/2416] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:28:01 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:28:01.895304 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe216d-e5bd-4584-9d95-a75f694c672d None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:01.905067 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbe216d-e5bd-4584-9d95-a75f694c672d None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:01.908661 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf66428-c458-41da-b1bd-ede056fc9fd4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:01.909271 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf66428-c458-41da-b1bd-ede056fc9fd4 service cinder] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:01.909552 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf66428-c458-41da-b1bd-ede056fc9fd4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:01.909832 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf66428-c458-41da-b1bd-ede056fc9fd4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:01.966021 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf66428-c458-41da-b1bd-ede056fc9fd4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:01.967372 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf66428-c458-41da-b1bd-ede056fc9fd4 service cinder] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:01.976339 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1201/2417] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:28:01 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:28:04.554907 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e9ee3-b5b5-4e04-8e0e-c6eec0495c04 service cinder] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:04.602666 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:04.620099 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e29e9ee3-b5b5-4e04-8e0e-c6eec0495c04 service cinder] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:04.624705 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3bb38-c834-4052-8e4e-3f926cb460ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:04.625351 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3bb38-c834-4052-8e4e-3f926cb460ab admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:04.625636 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3bb38-c834-4052-8e4e-3f926cb460ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:04.625913 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b3bb38-c834-4052-8e4e-3f926cb460ab admin admin] PATH_INFO: `/v3/users/7bdd65dacdfa40f29a9c8c47575b0859` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:04.627085 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3bb38-c834-4052-8e4e-3f926cb460ab admin admin] RBAC: Authorizing `identity:delete_user(user_id=7bdd65dacdfa40f29a9c8c47575b0859)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:04.629039 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b3bb38-c834-4052-8e4e-3f926cb460ab admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:04.674941 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c8b3bb38-c834-4052-8e4e-3f926cb460ab admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7bdd65dacdfa40f29a9c8c47575b0859'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:04.687128 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c8b3bb38-c834-4052-8e4e-3f926cb460ab admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7bdd65dacdfa40f29a9c8c47575b0859'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:04.687782 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c8b3bb38-c834-4052-8e4e-3f926cb460ab admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7bdd65dacdfa40f29a9c8c47575b0859'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:04.688479 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c8b3bb38-c834-4052-8e4e-3f926cb460ab admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7bdd65dacdfa40f29a9c8c47575b0859'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:04.695812 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-c8b3bb38-c834-4052-8e4e-3f926cb460ab admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7bdd65dacdfa40f29a9c8c47575b0859'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:04.708146 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1217/2418] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:28:04 2022] DELETE /identity/v3/users/7bdd65dacdfa40f29a9c8c47575b0859 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:28:04.713513 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314f71e-a830-4935-a8db-8d7030c50fed None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:04.713983 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314f71e-a830-4935-a8db-8d7030c50fed None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:04.714077 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3314f71e-a830-4935-a8db-8d7030c50fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:04.733862 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-3314f71e-a830-4935-a8db-8d7030c50fed None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:28:04.735080 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-3314f71e-a830-4935-a8db-8d7030c50fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:28:04.796630 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1202/2419] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:28:04 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:28:04.806315 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3bb38-c834-4052-8e4e-3f926cb460ab admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:04.807742 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-c8b3bb38-c834-4052-8e4e-3f926cb460ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:28:04.870031 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b3bb38-c834-4052-8e4e-3f926cb460ab admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:04.873796 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11da38-5aa9-4b1b-a51b-41b0dea70dab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:04.874415 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11da38-5aa9-4b1b-a51b-41b0dea70dab service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:04.874690 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11da38-5aa9-4b1b-a51b-41b0dea70dab service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:04.874957 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef11da38-5aa9-4b1b-a51b-41b0dea70dab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:04.884238 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11da38-5aa9-4b1b-a51b-41b0dea70dab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:04.885795 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef11da38-5aa9-4b1b-a51b-41b0dea70dab service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:04.895298 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1218/2420] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:28:04 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:28:05.163596 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314f71e-a830-4935-a8db-8d7030c50fed None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:05.165140 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-3314f71e-a830-4935-a8db-8d7030c50fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:28:05.177179 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3314f71e-a830-4935-a8db-8d7030c50fed None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:05.182214 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fead4c-7301-4d1b-a547-b52cb0150646 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:05.182858 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fead4c-7301-4d1b-a547-b52cb0150646 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:05.183138 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fead4c-7301-4d1b-a547-b52cb0150646 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:05.183417 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44fead4c-7301-4d1b-a547-b52cb0150646 admin admin] PATH_INFO: `/v3/projects/d18678d663d14373ab78a6a552f4e35b` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:05.184907 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fead4c-7301-4d1b-a547-b52cb0150646 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d18678d663d14373ab78a6a552f4e35b)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:05.187027 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44fead4c-7301-4d1b-a547-b52cb0150646 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:05.233350 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-44fead4c-7301-4d1b-a547-b52cb0150646 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd18678d663d14373ab78a6a552f4e35b', 'request_id': 'req-44fead4c-7301-4d1b-a547-b52cb0150646'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:05.238868 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-44fead4c-7301-4d1b-a547-b52cb0150646 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd18678d663d14373ab78a6a552f4e35b', 'request_id': 'req-44fead4c-7301-4d1b-a547-b52cb0150646'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:05.247292 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-44fead4c-7301-4d1b-a547-b52cb0150646 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd18678d663d14373ab78a6a552f4e35b', 'request_id': 'req-44fead4c-7301-4d1b-a547-b52cb0150646'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:05.258224 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-44fead4c-7301-4d1b-a547-b52cb0150646 admin admin] The token cache is being invalidate because project d18678d663d14373ab78a6a552f4e35b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:28:05.258510 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-44fead4c-7301-4d1b-a547-b52cb0150646 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:05.259128 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-44fead4c-7301-4d1b-a547-b52cb0150646 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:05.261292 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1203/2421] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:28:05 2022] DELETE /identity/v3/projects/d18678d663d14373ab78a6a552f4e35b => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:28:05.265272 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11da38-5aa9-4b1b-a51b-41b0dea70dab service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:05.274763 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef11da38-5aa9-4b1b-a51b-41b0dea70dab service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:05.331001 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15950aea-3fb9-40b1-bf16-7f722041d70b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:05.331628 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15950aea-3fb9-40b1-bf16-7f722041d70b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:05.331907 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15950aea-3fb9-40b1-bf16-7f722041d70b admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:05.332180 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15950aea-3fb9-40b1-bf16-7f722041d70b admin admin] PATH_INFO: `/v3/users/db94f46ad10a4a7f8451bc3fac34c58f` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:05.333358 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15950aea-3fb9-40b1-bf16-7f722041d70b admin admin] RBAC: Authorizing `identity:delete_user(user_id=db94f46ad10a4a7f8451bc3fac34c58f)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:05.335270 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15950aea-3fb9-40b1-bf16-7f722041d70b admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:05.345476 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:05.382680 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-15950aea-3fb9-40b1-bf16-7f722041d70b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db94f46ad10a4a7f8451bc3fac34c58f'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:05.395464 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-15950aea-3fb9-40b1-bf16-7f722041d70b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db94f46ad10a4a7f8451bc3fac34c58f'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:05.396152 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-15950aea-3fb9-40b1-bf16-7f722041d70b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db94f46ad10a4a7f8451bc3fac34c58f'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:05.396785 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-15950aea-3fb9-40b1-bf16-7f722041d70b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db94f46ad10a4a7f8451bc3fac34c58f'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:05.404090 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-15950aea-3fb9-40b1-bf16-7f722041d70b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db94f46ad10a4a7f8451bc3fac34c58f'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:05.416016 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1219/2422] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:28:05 2022] DELETE /identity/v3/users/db94f46ad10a4a7f8451bc3fac34c58f => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:28:05.687333 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fead4c-7301-4d1b-a547-b52cb0150646 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:05.689078 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-44fead4c-7301-4d1b-a547-b52cb0150646 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:28:05.705153 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44fead4c-7301-4d1b-a547-b52cb0150646 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:05.724815 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:05.765646 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77654ac7-01fc-435d-b4a3-4014eb67405b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:05.766212 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77654ac7-01fc-435d-b4a3-4014eb67405b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:05.766488 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77654ac7-01fc-435d-b4a3-4014eb67405b admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:05.766759 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77654ac7-01fc-435d-b4a3-4014eb67405b admin admin] PATH_INFO: `/v3/projects/3f4e67fcbeb0451780ce80aa5fd12262` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:05.767905 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77654ac7-01fc-435d-b4a3-4014eb67405b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3f4e67fcbeb0451780ce80aa5fd12262)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:05.769844 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77654ac7-01fc-435d-b4a3-4014eb67405b admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:05.815715 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-77654ac7-01fc-435d-b4a3-4014eb67405b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3f4e67fcbeb0451780ce80aa5fd12262', 'request_id': 'req-77654ac7-01fc-435d-b4a3-4014eb67405b'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:05.821105 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-77654ac7-01fc-435d-b4a3-4014eb67405b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3f4e67fcbeb0451780ce80aa5fd12262', 'request_id': 'req-77654ac7-01fc-435d-b4a3-4014eb67405b'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:05.828972 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-77654ac7-01fc-435d-b4a3-4014eb67405b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3f4e67fcbeb0451780ce80aa5fd12262', 'request_id': 'req-77654ac7-01fc-435d-b4a3-4014eb67405b'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:05.840969 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-77654ac7-01fc-435d-b4a3-4014eb67405b admin admin] The token cache is being invalidate because project 3f4e67fcbeb0451780ce80aa5fd12262 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:28:05.841249 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-77654ac7-01fc-435d-b4a3-4014eb67405b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:05.841893 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-77654ac7-01fc-435d-b4a3-4014eb67405b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:05.843393 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1204/2423] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:28:05 2022] DELETE /identity/v3/projects/3f4e67fcbeb0451780ce80aa5fd12262 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:28:05.849229 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66617133-ade4-493f-9566-ab2bf217d363 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:05.849682 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66617133-ade4-493f-9566-ab2bf217d363 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:05.849779 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66617133-ade4-493f-9566-ab2bf217d363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:05.870009 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-66617133-ade4-493f-9566-ab2bf217d363 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:28:05.871208 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-66617133-ade4-493f-9566-ab2bf217d363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:28:05.929161 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1220/2424] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:28:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:28:05.938030 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fade2-3296-4045-a085-63a9b77c8c9a None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:05.938319 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fade2-3296-4045-a085-63a9b77c8c9a None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:05.938599 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051fade2-3296-4045-a085-63a9b77c8c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:05.965557 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-051fade2-3296-4045-a085-63a9b77c8c9a None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:28:05.966779 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-051fade2-3296-4045-a085-63a9b77c8c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:28:05.974835 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1205/2425] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:28:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:28:05.979844 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66617133-ade4-493f-9566-ab2bf217d363 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:05.989949 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66617133-ade4-493f-9566-ab2bf217d363 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:05.994853 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4114f0f-7aef-42be-b943-b87761b95b70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:05.995501 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4114f0f-7aef-42be-b943-b87761b95b70 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:05.995781 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4114f0f-7aef-42be-b943-b87761b95b70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:05.996055 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4114f0f-7aef-42be-b943-b87761b95b70 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:05.996913 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4114f0f-7aef-42be-b943-b87761b95b70 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:28:05.997221 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4114f0f-7aef-42be-b943-b87761b95b70 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:05.998807 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4114f0f-7aef-42be-b943-b87761b95b70 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:06.011075 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1221/2426] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:28:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:28:06.015388 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fade2-3296-4045-a085-63a9b77c8c9a None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:06.025929 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051fade2-3296-4045-a085-63a9b77c8c9a None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:06.030638 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eccf288-2306-4315-9254-83cebfce117c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:06.031252 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eccf288-2306-4315-9254-83cebfce117c admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:06.031530 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eccf288-2306-4315-9254-83cebfce117c admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:06.031802 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eccf288-2306-4315-9254-83cebfce117c admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:06.032496 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eccf288-2306-4315-9254-83cebfce117c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:06.034391 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eccf288-2306-4315-9254-83cebfce117c admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:06.062058 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1206/2427] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:28:06 2022] POST /identity/v3/projects => generated 375 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:28:06.066213 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4114f0f-7aef-42be-b943-b87761b95b70 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:06.076208 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4114f0f-7aef-42be-b943-b87761b95b70 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:06.133557 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113a33a-cfdf-4683-b845-d983dec4683a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:06.134165 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113a33a-cfdf-4683-b845-d983dec4683a admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:06.134442 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113a33a-cfdf-4683-b845-d983dec4683a admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:06.134743 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7113a33a-cfdf-4683-b845-d983dec4683a admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:06.135424 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113a33a-cfdf-4683-b845-d983dec4683a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:06.137339 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7113a33a-cfdf-4683-b845-d983dec4683a admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:06.158167 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1222/2428] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:28:06 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:28:06.162295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eccf288-2306-4315-9254-83cebfce117c admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:06.173706 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eccf288-2306-4315-9254-83cebfce117c admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:06.178263 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e4fe5-99c7-4de1-abbc-2a74d6023c9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:06.178861 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e4fe5-99c7-4de1-abbc-2a74d6023c9f admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:06.179139 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e4fe5-99c7-4de1-abbc-2a74d6023c9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:06.179413 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a5e4fe5-99c7-4de1-abbc-2a74d6023c9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:06.180105 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5e4fe5-99c7-4de1-abbc-2a74d6023c9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:06.181745 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a5e4fe5-99c7-4de1-abbc-2a74d6023c9f admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:06.192667 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1207/2429] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:28:06.196504 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113a33a-cfdf-4683-b845-d983dec4683a admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:06.203235 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:06.207217 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7113a33a-cfdf-4683-b845-d983dec4683a admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:06.214321 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-503b5017-ed95-472f-9c59-45c48f8d0663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:06.215111 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b5017-ed95-472f-9c59-45c48f8d0663 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:06.215452 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b5017-ed95-472f-9c59-45c48f8d0663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:06.215925 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-503b5017-ed95-472f-9c59-45c48f8d0663 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:06.216650 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503b5017-ed95-472f-9c59-45c48f8d0663 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:06.218281 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-503b5017-ed95-472f-9c59-45c48f8d0663 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:06.230118 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1223/2430] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:28:06.234245 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e4fe5-99c7-4de1-abbc-2a74d6023c9f admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:06.243957 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a5e4fe5-99c7-4de1-abbc-2a74d6023c9f admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:06.249362 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a71710-7044-438f-aa22-f18bcf8d81fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:06.250007 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a71710-7044-438f-aa22-f18bcf8d81fd admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:06.250285 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a71710-7044-438f-aa22-f18bcf8d81fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:06.250555 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a71710-7044-438f-aa22-f18bcf8d81fd admin admin] PATH_INFO: `/v3/projects/16b2c1b0d1874364b832489c3cb9f68b/users/682a8c3e468c43eca0f363f4112052fd/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:06.265918 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a71710-7044-438f-aa22-f18bcf8d81fd admin admin] RBAC: Authorizing `identity:create_grant(project_id=16b2c1b0d1874364b832489c3cb9f68b, user_id=682a8c3e468c43eca0f363f4112052fd, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:06.268583 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a71710-7044-438f-aa22-f18bcf8d81fd admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:06.281152 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1208/2431] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:28:06 2022] PUT /identity/v3/projects/16b2c1b0d1874364b832489c3cb9f68b/users/682a8c3e468c43eca0f363f4112052fd/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:28:06.293129 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474a0fb-1c7a-4de3-8c4d-67b6bf8ae710 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:06.293417 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474a0fb-1c7a-4de3-8c4d-67b6bf8ae710 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:06.293720 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4474a0fb-1c7a-4de3-8c4d-67b6bf8ae710 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:06.321360 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-4474a0fb-1c7a-4de3-8c4d-67b6bf8ae710 None None] MFA Rules not processed for user `682a8c3e468c43eca0f363f4112052fd`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:28:06.323045 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-4474a0fb-1c7a-4de3-8c4d-67b6bf8ae710 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:28:06.390279 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1224/2432] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:28:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:28:06.394776 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a71710-7044-438f-aa22-f18bcf8d81fd admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:06.444140 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:06.460454 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a71710-7044-438f-aa22-f18bcf8d81fd admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:06.465635 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31388a8a-aacd-4271-b713-f1bf39adb31b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:06.466253 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31388a8a-aacd-4271-b713-f1bf39adb31b admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:06.466559 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31388a8a-aacd-4271-b713-f1bf39adb31b admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:06.466837 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31388a8a-aacd-4271-b713-f1bf39adb31b admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:06.467511 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31388a8a-aacd-4271-b713-f1bf39adb31b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:06.469455 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31388a8a-aacd-4271-b713-f1bf39adb31b admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:06.497841 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1209/2433] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:28:06 2022] POST /identity/v3/projects => generated 377 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:28:06.501864 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474a0fb-1c7a-4de3-8c4d-67b6bf8ae710 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:06.513002 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4474a0fb-1c7a-4de3-8c4d-67b6bf8ae710 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:06.571528 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fead2b-a4d4-4039-ae4d-1ad7e1f72694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:06.572155 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fead2b-a4d4-4039-ae4d-1ad7e1f72694 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:06.573101 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fead2b-a4d4-4039-ae4d-1ad7e1f72694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:06.573389 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16fead2b-a4d4-4039-ae4d-1ad7e1f72694 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:06.574074 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fead2b-a4d4-4039-ae4d-1ad7e1f72694 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:06.575975 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16fead2b-a4d4-4039-ae4d-1ad7e1f72694 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:06.602092 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1225/2434] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:28:06 2022] POST /identity/v3/users => generated 289 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:28:06.604176 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31388a8a-aacd-4271-b713-f1bf39adb31b admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:06.617113 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31388a8a-aacd-4271-b713-f1bf39adb31b admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:06.622527 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e69569-b408-4bf5-a9df-741d4b36ec8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:06.623140 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e69569-b408-4bf5-a9df-741d4b36ec8c admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:06.623428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e69569-b408-4bf5-a9df-741d4b36ec8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:06.623762 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4e69569-b408-4bf5-a9df-741d4b36ec8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:06.624832 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e69569-b408-4bf5-a9df-741d4b36ec8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:06.626979 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4e69569-b408-4bf5-a9df-741d4b36ec8c admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:06.639207 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1210/2435] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:28:06.643331 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fead2b-a4d4-4039-ae4d-1ad7e1f72694 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:06.655004 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16fead2b-a4d4-4039-ae4d-1ad7e1f72694 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:06.659660 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6916679d-3cbc-4d3a-8cd6-040f51db0152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:06.660272 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916679d-3cbc-4d3a-8cd6-040f51db0152 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:06.660589 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916679d-3cbc-4d3a-8cd6-040f51db0152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:06.660864 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6916679d-3cbc-4d3a-8cd6-040f51db0152 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:06.661555 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6916679d-3cbc-4d3a-8cd6-040f51db0152 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:06.663164 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6916679d-3cbc-4d3a-8cd6-040f51db0152 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:06.674454 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1226/2436] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:28:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:28:06.678534 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e69569-b408-4bf5-a9df-741d4b36ec8c admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:06.689110 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4e69569-b408-4bf5-a9df-741d4b36ec8c admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:06.693759 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d9f62-8918-4c53-b981-593fe887c3fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:06.694425 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d9f62-8918-4c53-b981-593fe887c3fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:06.694705 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d9f62-8918-4c53-b981-593fe887c3fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:06.694980 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473d9f62-8918-4c53-b981-593fe887c3fe admin admin] PATH_INFO: `/v3/projects/1dea148394bf4e1c9f9c96395f39d29e/users/c9ca3c9f9b844f42b04b801354802fb9/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:06.710814 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d9f62-8918-4c53-b981-593fe887c3fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=1dea148394bf4e1c9f9c96395f39d29e, user_id=c9ca3c9f9b844f42b04b801354802fb9, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:06.714602 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473d9f62-8918-4c53-b981-593fe887c3fe admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:06.727326 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1211/2437] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:28:06 2022] PUT /identity/v3/projects/1dea148394bf4e1c9f9c96395f39d29e/users/c9ca3c9f9b844f42b04b801354802fb9/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:28:06.738765 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab213c0-4191-43fd-9d6c-087b65c23f70 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:06.739058 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab213c0-4191-43fd-9d6c-087b65c23f70 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:06.739339 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab213c0-4191-43fd-9d6c-087b65c23f70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:06.769807 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-dab213c0-4191-43fd-9d6c-087b65c23f70 None None] MFA Rules not processed for user `c9ca3c9f9b844f42b04b801354802fb9`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:28:06.771091 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-dab213c0-4191-43fd-9d6c-087b65c23f70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:28:06.818433 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:06.836925 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1227/2438] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:28:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:28:06.841564 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d9f62-8918-4c53-b981-593fe887c3fe admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:06.905740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473d9f62-8918-4c53-b981-593fe887c3fe admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:06.910838 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6b5a0-056b-484f-a6bb-a00b1798a585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:06.911451 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6b5a0-056b-484f-a6bb-a00b1798a585 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:06.911739 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6b5a0-056b-484f-a6bb-a00b1798a585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:06.912041 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6b5a0-056b-484f-a6bb-a00b1798a585 admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:06.912752 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e6b5a0-056b-484f-a6bb-a00b1798a585 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:06.914644 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e6b5a0-056b-484f-a6bb-a00b1798a585 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:06.941383 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1212/2439] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:28:06 2022] POST /identity/v3/projects => generated 377 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:28:06.945428 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab213c0-4191-43fd-9d6c-087b65c23f70 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:06.957106 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab213c0-4191-43fd-9d6c-087b65c23f70 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:07.013273 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cceeae-6666-460a-8f62-53dd9ccdf47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:07.013880 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cceeae-6666-460a-8f62-53dd9ccdf47e admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:07.014159 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cceeae-6666-460a-8f62-53dd9ccdf47e admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:07.014428 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cceeae-6666-460a-8f62-53dd9ccdf47e admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:07.015082 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cceeae-6666-460a-8f62-53dd9ccdf47e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:07.017003 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cceeae-6666-460a-8f62-53dd9ccdf47e admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:07.037249 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1228/2440] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:28:06 2022] POST /identity/v3/users => generated 295 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:28:07.041860 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6b5a0-056b-484f-a6bb-a00b1798a585 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:07.052056 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6b5a0-056b-484f-a6bb-a00b1798a585 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:07.057193 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837cc59e-2d7c-422d-9377-3a2127e3baa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:07.057795 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837cc59e-2d7c-422d-9377-3a2127e3baa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:07.058074 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837cc59e-2d7c-422d-9377-3a2127e3baa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:07.058344 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837cc59e-2d7c-422d-9377-3a2127e3baa9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:07.059028 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837cc59e-2d7c-422d-9377-3a2127e3baa9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:07.060652 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837cc59e-2d7c-422d-9377-3a2127e3baa9 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:07.071352 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1213/2441] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:28:07.075898 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cceeae-6666-460a-8f62-53dd9ccdf47e admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:07.086963 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cceeae-6666-460a-8f62-53dd9ccdf47e admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:07.092753 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d5887-e4ee-4c53-a16b-b7f43fb161b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:07.093466 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d5887-e4ee-4c53-a16b-b7f43fb161b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:07.093745 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d5887-e4ee-4c53-a16b-b7f43fb161b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:07.094024 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722d5887-e4ee-4c53-a16b-b7f43fb161b7 admin admin] PATH_INFO: `/v3/projects/0d904dfc676b49608cfd7865990c4ffd/users/384e67d347cc42ec85fb297488ae0ed9/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:07.109289 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722d5887-e4ee-4c53-a16b-b7f43fb161b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d904dfc676b49608cfd7865990c4ffd, user_id=384e67d347cc42ec85fb297488ae0ed9, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:07.111934 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722d5887-e4ee-4c53-a16b-b7f43fb161b7 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:07.128212 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1229/2442] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:28:07 2022] PUT /identity/v3/projects/0d904dfc676b49608cfd7865990c4ffd/users/384e67d347cc42ec85fb297488ae0ed9/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:28:07.132510 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837cc59e-2d7c-422d-9377-3a2127e3baa9 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:07.143993 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837cc59e-2d7c-422d-9377-3a2127e3baa9 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:07.216344 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7136189f-6ee1-4eca-82cb-3e885036e4a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:07.217146 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136189f-6ee1-4eca-82cb-3e885036e4a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:07.217530 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136189f-6ee1-4eca-82cb-3e885036e4a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:07.217897 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7136189f-6ee1-4eca-82cb-3e885036e4a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:07.219483 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7136189f-6ee1-4eca-82cb-3e885036e4a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:07.221108 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7136189f-6ee1-4eca-82cb-3e885036e4a8 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:07.231769 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1214/2443] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:28:07 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:28:07.236065 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d5887-e4ee-4c53-a16b-b7f43fb161b7 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:07.251223 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722d5887-e4ee-4c53-a16b-b7f43fb161b7 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:07.257492 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda4c5a-3c47-4837-a98c-1646bf3d757b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:07.258199 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda4c5a-3c47-4837-a98c-1646bf3d757b admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:07.258479 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda4c5a-3c47-4837-a98c-1646bf3d757b admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:07.258760 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebda4c5a-3c47-4837-a98c-1646bf3d757b admin admin] PATH_INFO: `/v3/projects/0d904dfc676b49608cfd7865990c4ffd/users/384e67d347cc42ec85fb297488ae0ed9/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:07.264514 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda4c5a-3c47-4837-a98c-1646bf3d757b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d904dfc676b49608cfd7865990c4ffd, user_id=384e67d347cc42ec85fb297488ae0ed9, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:07.267331 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebda4c5a-3c47-4837-a98c-1646bf3d757b admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:07.279459 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1230/2444] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:28:07 2022] PUT /identity/v3/projects/0d904dfc676b49608cfd7865990c4ffd/users/384e67d347cc42ec85fb297488ae0ed9/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:28:07.289976 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa171af8-a7a0-49ff-ac27-f0b9981bb651 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:07.290374 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa171af8-a7a0-49ff-ac27-f0b9981bb651 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:07.290843 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa171af8-a7a0-49ff-ac27-f0b9981bb651 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:07.313385 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:07.325634 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-fa171af8-a7a0-49ff-ac27-f0b9981bb651 None None] MFA Rules not processed for user `384e67d347cc42ec85fb297488ae0ed9`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:28:07.326812 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-fa171af8-a7a0-49ff-ac27-f0b9981bb651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:28:07.394488 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1215/2445] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:28:07 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:28:07.406123 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda4c5a-3c47-4837-a98c-1646bf3d757b admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:07.407868 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-ebda4c5a-3c47-4837-a98c-1646bf3d757b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:28:07.466042 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebda4c5a-3c47-4837-a98c-1646bf3d757b admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:07.469603 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412f3bc-06c2-4aa8-bc99-dd8bb0d6f1f7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:07.470209 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412f3bc-06c2-4aa8-bc99-dd8bb0d6f1f7 service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:07.470488 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412f3bc-06c2-4aa8-bc99-dd8bb0d6f1f7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:07.470759 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412f3bc-06c2-4aa8-bc99-dd8bb0d6f1f7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:07.524722 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8412f3bc-06c2-4aa8-bc99-dd8bb0d6f1f7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:07.526143 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8412f3bc-06c2-4aa8-bc99-dd8bb0d6f1f7 service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:07.529641 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:07.538017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1231/2446] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:28:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:28:09.047212 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa171af8-a7a0-49ff-ac27-f0b9981bb651 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:09.048642 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-fa171af8-a7a0-49ff-ac27-f0b9981bb651 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:28:09.060874 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa171af8-a7a0-49ff-ac27-f0b9981bb651 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:09.064418 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cba7fd-1e7f-4a80-86d6-1b791461e1ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:09.065023 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cba7fd-1e7f-4a80-86d6-1b791461e1ea service cinder] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:09.065300 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cba7fd-1e7f-4a80-86d6-1b791461e1ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:09.065570 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7cba7fd-1e7f-4a80-86d6-1b791461e1ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:09.121113 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cba7fd-1e7f-4a80-86d6-1b791461e1ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:09.122703 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7cba7fd-1e7f-4a80-86d6-1b791461e1ea service cinder] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:09.131518 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1216/2447] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:28:09 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:28:09.663234 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412f3bc-06c2-4aa8-bc99-dd8bb0d6f1f7 service cinder] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:09.671815 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8412f3bc-06c2-4aa8-bc99-dd8bb0d6f1f7 service cinder] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:09.675423 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4add97-74e3-4717-ae8a-9e9c0fcbaa96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:09.676034 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4add97-74e3-4717-ae8a-9e9c0fcbaa96 service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:09.676317 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4add97-74e3-4717-ae8a-9e9c0fcbaa96 service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:09.676619 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a4add97-74e3-4717-ae8a-9e9c0fcbaa96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:09.685436 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4add97-74e3-4717-ae8a-9e9c0fcbaa96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:09.686857 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a4add97-74e3-4717-ae8a-9e9c0fcbaa96 service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:09.696232 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1232/2448] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:28:09 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 33 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:28:10.977740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cba7fd-1e7f-4a80-86d6-1b791461e1ea service cinder] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:10.979238 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-b7cba7fd-1e7f-4a80-86d6-1b791461e1ea service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:28:11.041378 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7cba7fd-1e7f-4a80-86d6-1b791461e1ea service cinder] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:11.048755 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807da5ba-9dd5-4bf9-98b7-66bf0e84a847 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:11.049375 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807da5ba-9dd5-4bf9-98b7-66bf0e84a847 service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:11.049656 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807da5ba-9dd5-4bf9-98b7-66bf0e84a847 service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:11.049928 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807da5ba-9dd5-4bf9-98b7-66bf0e84a847 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:11.051694 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-807da5ba-9dd5-4bf9-98b7-66bf0e84a847 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:28:11.114138 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:11.132963 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807da5ba-9dd5-4bf9-98b7-66bf0e84a847 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:11.134402 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807da5ba-9dd5-4bf9-98b7-66bf0e84a847 service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:11.144780 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1217/2449] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:28:10 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:28:13.619698 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4add97-74e3-4717-ae8a-9e9c0fcbaa96 service cinder] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:13.684981 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a4add97-74e3-4717-ae8a-9e9c0fcbaa96 service cinder] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:13.688425 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ceddc-153a-446e-b226-b154ce7415a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:13.689102 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ceddc-153a-446e-b226-b154ce7415a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:13.689520 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ceddc-153a-446e-b226-b154ce7415a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:13.689801 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8ceddc-153a-446e-b226-b154ce7415a9 admin admin] PATH_INFO: `/v3/users/682a8c3e468c43eca0f363f4112052fd` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:13.690997 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ceddc-153a-446e-b226-b154ce7415a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=682a8c3e468c43eca0f363f4112052fd)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:13.692980 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f8ceddc-153a-446e-b226-b154ce7415a9 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:13.749392 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-3f8ceddc-153a-446e-b226-b154ce7415a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '682a8c3e468c43eca0f363f4112052fd'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:13.761500 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-3f8ceddc-153a-446e-b226-b154ce7415a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '682a8c3e468c43eca0f363f4112052fd'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:13.762689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-3f8ceddc-153a-446e-b226-b154ce7415a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '682a8c3e468c43eca0f363f4112052fd'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:13.763460 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-3f8ceddc-153a-446e-b226-b154ce7415a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '682a8c3e468c43eca0f363f4112052fd'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:13.772313 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-3f8ceddc-153a-446e-b226-b154ce7415a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '682a8c3e468c43eca0f363f4112052fd'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:13.785162 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1233/2450] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:28:13 2022] DELETE /identity/v3/users/682a8c3e468c43eca0f363f4112052fd => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:28:13.789742 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fa301-445f-44ad-952c-05adb9e350dd None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:13.790201 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fa301-445f-44ad-952c-05adb9e350dd None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:13.790326 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fa301-445f-44ad-952c-05adb9e350dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:13.809866 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-4d9fa301-445f-44ad-952c-05adb9e350dd None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:28:13.811168 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-4d9fa301-445f-44ad-952c-05adb9e350dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:28:13.885759 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1218/2451] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:28:13 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:28:13.896180 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ceddc-153a-446e-b226-b154ce7415a9 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:13.897633 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-3f8ceddc-153a-446e-b226-b154ce7415a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:28:13.962934 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8ceddc-153a-446e-b226-b154ce7415a9 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:13.967405 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922868c1-4d2e-4d57-a44c-4bcbfd7cd1f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:13.968029 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922868c1-4d2e-4d57-a44c-4bcbfd7cd1f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:13.968311 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922868c1-4d2e-4d57-a44c-4bcbfd7cd1f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:13.968615 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-922868c1-4d2e-4d57-a44c-4bcbfd7cd1f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:13.978007 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922868c1-4d2e-4d57-a44c-4bcbfd7cd1f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:13.979452 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-922868c1-4d2e-4d57-a44c-4bcbfd7cd1f8 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:13.989975 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1234/2452] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:28:13 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:28:14.275210 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fa301-445f-44ad-952c-05adb9e350dd None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:14.276875 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-4d9fa301-445f-44ad-952c-05adb9e350dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:28:14.289650 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9fa301-445f-44ad-952c-05adb9e350dd None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:14.294758 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2526b4d8-b91d-4746-9cd3-bd46bcecdeeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:14.295609 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526b4d8-b91d-4746-9cd3-bd46bcecdeeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:14.295980 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526b4d8-b91d-4746-9cd3-bd46bcecdeeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:14.296394 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2526b4d8-b91d-4746-9cd3-bd46bcecdeeb admin admin] PATH_INFO: `/v3/projects/16b2c1b0d1874364b832489c3cb9f68b` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:14.297761 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2526b4d8-b91d-4746-9cd3-bd46bcecdeeb admin admin] RBAC: Authorizing `identity:delete_project(project_id=16b2c1b0d1874364b832489c3cb9f68b)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:14.299828 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2526b4d8-b91d-4746-9cd3-bd46bcecdeeb admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:14.347647 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-2526b4d8-b91d-4746-9cd3-bd46bcecdeeb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16b2c1b0d1874364b832489c3cb9f68b', 'request_id': 'req-2526b4d8-b91d-4746-9cd3-bd46bcecdeeb'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:14.353035 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-2526b4d8-b91d-4746-9cd3-bd46bcecdeeb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16b2c1b0d1874364b832489c3cb9f68b', 'request_id': 'req-2526b4d8-b91d-4746-9cd3-bd46bcecdeeb'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:14.360419 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-2526b4d8-b91d-4746-9cd3-bd46bcecdeeb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16b2c1b0d1874364b832489c3cb9f68b', 'request_id': 'req-2526b4d8-b91d-4746-9cd3-bd46bcecdeeb'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:14.371325 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-2526b4d8-b91d-4746-9cd3-bd46bcecdeeb admin admin] The token cache is being invalidate because project 16b2c1b0d1874364b832489c3cb9f68b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:28:14.371668 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-2526b4d8-b91d-4746-9cd3-bd46bcecdeeb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:14.372342 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-2526b4d8-b91d-4746-9cd3-bd46bcecdeeb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:14.373837 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1219/2453] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:28:14 2022] DELETE /identity/v3/projects/16b2c1b0d1874364b832489c3cb9f68b => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:28:14.377875 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922868c1-4d2e-4d57-a44c-4bcbfd7cd1f8 service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:14.388520 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-922868c1-4d2e-4d57-a44c-4bcbfd7cd1f8 service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:14.392006 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:14.448459 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef1f86-34fc-4b87-8670-c3f4a99998d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:14.449720 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef1f86-34fc-4b87-8670-c3f4a99998d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:14.450026 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef1f86-34fc-4b87-8670-c3f4a99998d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:14.450322 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20ef1f86-34fc-4b87-8670-c3f4a99998d2 admin admin] PATH_INFO: `/v3/users/c9ca3c9f9b844f42b04b801354802fb9` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:14.451494 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef1f86-34fc-4b87-8670-c3f4a99998d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9ca3c9f9b844f42b04b801354802fb9)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:14.453435 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20ef1f86-34fc-4b87-8670-c3f4a99998d2 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:14.499650 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-20ef1f86-34fc-4b87-8670-c3f4a99998d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9ca3c9f9b844f42b04b801354802fb9'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:14.511460 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-20ef1f86-34fc-4b87-8670-c3f4a99998d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9ca3c9f9b844f42b04b801354802fb9'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:14.512752 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-20ef1f86-34fc-4b87-8670-c3f4a99998d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9ca3c9f9b844f42b04b801354802fb9'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:14.513305 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-20ef1f86-34fc-4b87-8670-c3f4a99998d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9ca3c9f9b844f42b04b801354802fb9'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:14.519931 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-20ef1f86-34fc-4b87-8670-c3f4a99998d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9ca3c9f9b844f42b04b801354802fb9'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:14.532190 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1235/2454] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:28:14 2022] DELETE /identity/v3/users/c9ca3c9f9b844f42b04b801354802fb9 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:28:14.808010 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2526b4d8-b91d-4746-9cd3-bd46bcecdeeb admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:14.810185 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-2526b4d8-b91d-4746-9cd3-bd46bcecdeeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:28:14.823436 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2526b4d8-b91d-4746-9cd3-bd46bcecdeeb admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:14.889201 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e045701-4eb3-4a8d-98f0-c4afcab0202f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:14.889841 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e045701-4eb3-4a8d-98f0-c4afcab0202f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:14.890118 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e045701-4eb3-4a8d-98f0-c4afcab0202f admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:14.890388 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e045701-4eb3-4a8d-98f0-c4afcab0202f admin admin] PATH_INFO: `/v3/projects/1dea148394bf4e1c9f9c96395f39d29e` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:14.891564 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e045701-4eb3-4a8d-98f0-c4afcab0202f admin admin] RBAC: Authorizing `identity:delete_project(project_id=1dea148394bf4e1c9f9c96395f39d29e)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:14.893511 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e045701-4eb3-4a8d-98f0-c4afcab0202f admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:14.901633 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:14.945857 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-7e045701-4eb3-4a8d-98f0-c4afcab0202f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1dea148394bf4e1c9f9c96395f39d29e', 'request_id': 'req-7e045701-4eb3-4a8d-98f0-c4afcab0202f'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:14.951633 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-7e045701-4eb3-4a8d-98f0-c4afcab0202f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1dea148394bf4e1c9f9c96395f39d29e', 'request_id': 'req-7e045701-4eb3-4a8d-98f0-c4afcab0202f'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:14.958525 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-7e045701-4eb3-4a8d-98f0-c4afcab0202f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1dea148394bf4e1c9f9c96395f39d29e', 'request_id': 'req-7e045701-4eb3-4a8d-98f0-c4afcab0202f'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:14.970240 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-7e045701-4eb3-4a8d-98f0-c4afcab0202f admin admin] The token cache is being invalidate because project 1dea148394bf4e1c9f9c96395f39d29e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:28:14.970529 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-7e045701-4eb3-4a8d-98f0-c4afcab0202f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:14.971158 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-7e045701-4eb3-4a8d-98f0-c4afcab0202f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:14.972705 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1220/2455] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:28:14 2022] DELETE /identity/v3/projects/1dea148394bf4e1c9f9c96395f39d29e => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:28:14.976650 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef1f86-34fc-4b87-8670-c3f4a99998d2 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:14.978032 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-20ef1f86-34fc-4b87-8670-c3f4a99998d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:28:14.991551 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20ef1f86-34fc-4b87-8670-c3f4a99998d2 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:15.046600 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff052423-4f25-44cc-95b9-d03e360a59ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:15.047231 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff052423-4f25-44cc-95b9-d03e360a59ee admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:15.047510 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff052423-4f25-44cc-95b9-d03e360a59ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:15.047784 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff052423-4f25-44cc-95b9-d03e360a59ee admin admin] PATH_INFO: `/v3/users/384e67d347cc42ec85fb297488ae0ed9` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:15.048945 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff052423-4f25-44cc-95b9-d03e360a59ee admin admin] RBAC: Authorizing `identity:delete_user(user_id=384e67d347cc42ec85fb297488ae0ed9)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:15.050896 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff052423-4f25-44cc-95b9-d03e360a59ee admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:15.079006 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:15.097944 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-ff052423-4f25-44cc-95b9-d03e360a59ee admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '384e67d347cc42ec85fb297488ae0ed9'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:15.110558 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-ff052423-4f25-44cc-95b9-d03e360a59ee admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '384e67d347cc42ec85fb297488ae0ed9'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:15.111249 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-ff052423-4f25-44cc-95b9-d03e360a59ee admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '384e67d347cc42ec85fb297488ae0ed9'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:15.111867 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-ff052423-4f25-44cc-95b9-d03e360a59ee admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '384e67d347cc42ec85fb297488ae0ed9'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:15.119743 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-ff052423-4f25-44cc-95b9-d03e360a59ee admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '384e67d347cc42ec85fb297488ae0ed9'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:15.132866 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1236/2456] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:28:14 2022] DELETE /identity/v3/users/384e67d347cc42ec85fb297488ae0ed9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:28:15.415689 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e045701-4eb3-4a8d-98f0-c4afcab0202f admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:15.417560 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-7e045701-4eb3-4a8d-98f0-c4afcab0202f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:28:15.432744 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e045701-4eb3-4a8d-98f0-c4afcab0202f admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:15.496557 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92632e9-fcee-40a2-95d4-c7b506c942e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:15.497302 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92632e9-fcee-40a2-95d4-c7b506c942e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:15.497587 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92632e9-fcee-40a2-95d4-c7b506c942e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:15.497863 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92632e9-fcee-40a2-95d4-c7b506c942e5 admin admin] PATH_INFO: `/v3/projects/0d904dfc676b49608cfd7865990c4ffd` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:15.499053 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92632e9-fcee-40a2-95d4-c7b506c942e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d904dfc676b49608cfd7865990c4ffd)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:15.501027 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c92632e9-fcee-40a2-95d4-c7b506c942e5 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:15.552415 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-c92632e9-fcee-40a2-95d4-c7b506c942e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d904dfc676b49608cfd7865990c4ffd', 'request_id': 'req-c92632e9-fcee-40a2-95d4-c7b506c942e5'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:15.559364 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-c92632e9-fcee-40a2-95d4-c7b506c942e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d904dfc676b49608cfd7865990c4ffd', 'request_id': 'req-c92632e9-fcee-40a2-95d4-c7b506c942e5'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:15.567084 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-c92632e9-fcee-40a2-95d4-c7b506c942e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d904dfc676b49608cfd7865990c4ffd', 'request_id': 'req-c92632e9-fcee-40a2-95d4-c7b506c942e5'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:15.579024 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-c92632e9-fcee-40a2-95d4-c7b506c942e5 admin admin] The token cache is being invalidate because project 0d904dfc676b49608cfd7865990c4ffd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:28:15.579307 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-c92632e9-fcee-40a2-95d4-c7b506c942e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:15.580006 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-c92632e9-fcee-40a2-95d4-c7b506c942e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:28:15.581784 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1221/2457] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:28:15 2022] DELETE /identity/v3/projects/0d904dfc676b49608cfd7865990c4ffd => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:28:15.587312 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a80db-7507-4f71-8c00-4b0765185974 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:15.587489 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a80db-7507-4f71-8c00-4b0765185974 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:15.587768 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c08a80db-7507-4f71-8c00-4b0765185974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:15.610279 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-c08a80db-7507-4f71-8c00-4b0765185974 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:28:15.611484 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-c08a80db-7507-4f71-8c00-4b0765185974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:28:15.672262 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1237/2458] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:28:15.680116 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08a84f-22cc-4748-bc2f-05cf14784007 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:15.680438 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08a84f-22cc-4748-bc2f-05cf14784007 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:15.681072 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f08a84f-22cc-4748-bc2f-05cf14784007 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:15.701426 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-4f08a84f-22cc-4748-bc2f-05cf14784007 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:28:15.702616 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-4f08a84f-22cc-4748-bc2f-05cf14784007 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:28:15.712039 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1222/2459] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:28:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:28:15.716081 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a80db-7507-4f71-8c00-4b0765185974 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:15.725800 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c08a80db-7507-4f71-8c00-4b0765185974 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:15.730525 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a421e81-09fb-43b9-a389-0ef0b3d45ab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:15.731040 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a421e81-09fb-43b9-a389-0ef0b3d45ab6 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:15.731320 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a421e81-09fb-43b9-a389-0ef0b3d45ab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:15.731594 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a421e81-09fb-43b9-a389-0ef0b3d45ab6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:15.732530 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a421e81-09fb-43b9-a389-0ef0b3d45ab6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:28:15.732621 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a421e81-09fb-43b9-a389-0ef0b3d45ab6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:15.734200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a421e81-09fb-43b9-a389-0ef0b3d45ab6 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:15.746180 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1238/2460] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:28:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:28:15.750693 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08a84f-22cc-4748-bc2f-05cf14784007 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:15.759947 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f08a84f-22cc-4748-bc2f-05cf14784007 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:15.765199 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c11a8-2251-41b8-822a-72b5fb5ffa36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:15.765797 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c11a8-2251-41b8-822a-72b5fb5ffa36 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:15.766075 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c11a8-2251-41b8-822a-72b5fb5ffa36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:15.766348 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-633c11a8-2251-41b8-822a-72b5fb5ffa36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:15.767015 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c11a8-2251-41b8-822a-72b5fb5ffa36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:15.768930 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-633c11a8-2251-41b8-822a-72b5fb5ffa36 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:15.789856 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:15.804232 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1223/2461] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:28:15 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:28:15.807399 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a421e81-09fb-43b9-a389-0ef0b3d45ab6 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:15.817713 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a421e81-09fb-43b9-a389-0ef0b3d45ab6 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:15.875925 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d476455-874e-4d02-9ba3-1f43deb49700 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:15.876581 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d476455-874e-4d02-9ba3-1f43deb49700 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:15.876864 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d476455-874e-4d02-9ba3-1f43deb49700 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:15.877141 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d476455-874e-4d02-9ba3-1f43deb49700 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:15.877800 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d476455-874e-4d02-9ba3-1f43deb49700 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:15.879702 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d476455-874e-4d02-9ba3-1f43deb49700 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:15.900645 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1239/2462] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:28:15 2022] POST /identity/v3/users => generated 292 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:28:15.905323 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c11a8-2251-41b8-822a-72b5fb5ffa36 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:15.915690 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-633c11a8-2251-41b8-822a-72b5fb5ffa36 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:15.920731 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae36c9-ec27-46ff-ba05-140eae21819f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:15.921334 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae36c9-ec27-46ff-ba05-140eae21819f admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:15.921613 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae36c9-ec27-46ff-ba05-140eae21819f admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:15.921887 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdae36c9-ec27-46ff-ba05-140eae21819f admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:15.922575 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae36c9-ec27-46ff-ba05-140eae21819f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:15.924192 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdae36c9-ec27-46ff-ba05-140eae21819f admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:15.934238 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1224/2463] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:28:15.938033 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d476455-874e-4d02-9ba3-1f43deb49700 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:15.948485 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d476455-874e-4d02-9ba3-1f43deb49700 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:15.954648 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8166e542-6a77-4063-94db-3b7e93038127 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:15.955291 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166e542-6a77-4063-94db-3b7e93038127 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:15.955559 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166e542-6a77-4063-94db-3b7e93038127 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:15.955858 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8166e542-6a77-4063-94db-3b7e93038127 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:15.956721 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8166e542-6a77-4063-94db-3b7e93038127 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:15.958348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8166e542-6a77-4063-94db-3b7e93038127 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:15.969788 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1240/2464] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:28:15 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:28:15.973925 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae36c9-ec27-46ff-ba05-140eae21819f admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:15.983782 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdae36c9-ec27-46ff-ba05-140eae21819f admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:15.988245 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10942dba-1719-4d2c-8ef4-34159a6c4da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:15.988919 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10942dba-1719-4d2c-8ef4-34159a6c4da7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:15.989197 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10942dba-1719-4d2c-8ef4-34159a6c4da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:15.989471 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10942dba-1719-4d2c-8ef4-34159a6c4da7 admin admin] PATH_INFO: `/v3/projects/8aeb435284914740b100d506c74bad6b/users/bf4c0ebf69394f49abfb31e297dafccf/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:16.004088 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10942dba-1719-4d2c-8ef4-34159a6c4da7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aeb435284914740b100d506c74bad6b, user_id=bf4c0ebf69394f49abfb31e297dafccf, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:16.006767 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10942dba-1719-4d2c-8ef4-34159a6c4da7 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:16.020301 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1225/2465] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:28:15 2022] PUT /identity/v3/projects/8aeb435284914740b100d506c74bad6b/users/bf4c0ebf69394f49abfb31e297dafccf/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:28:16.025541 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286d7d9-0eba-4195-b8fd-70be48c08ae9 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:16.026023 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286d7d9-0eba-4195-b8fd-70be48c08ae9 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:16.026127 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5286d7d9-0eba-4195-b8fd-70be48c08ae9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:16.045813 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-5286d7d9-0eba-4195-b8fd-70be48c08ae9 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:28:16.047033 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-5286d7d9-0eba-4195-b8fd-70be48c08ae9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:28:16.051885 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:16.116347 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1241/2466] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:28:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:28:16.126920 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10942dba-1719-4d2c-8ef4-34159a6c4da7 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:16.128637 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-10942dba-1719-4d2c-8ef4-34159a6c4da7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:28:16.187425 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10942dba-1719-4d2c-8ef4-34159a6c4da7 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:16.191055 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0e0cd-9265-4c2f-9e3f-5a62ea5ac917 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:16.191719 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0e0cd-9265-4c2f-9e3f-5a62ea5ac917 service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:16.191997 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0e0cd-9265-4c2f-9e3f-5a62ea5ac917 service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:16.192270 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea0e0cd-9265-4c2f-9e3f-5a62ea5ac917 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:16.202357 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea0e0cd-9265-4c2f-9e3f-5a62ea5ac917 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:16.203782 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea0e0cd-9265-4c2f-9e3f-5a62ea5ac917 service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:16.213259 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1226/2467] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:28:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:28:16.902012 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad4e55-95d9-4efe-8431-447c2c9eb5cc None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:16.902792 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad4e55-95d9-4efe-8431-447c2c9eb5cc None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:16.903088 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ad4e55-95d9-4efe-8431-447c2c9eb5cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:16.930760 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-81ad4e55-95d9-4efe-8431-447c2c9eb5cc None None] MFA Rules not processed for user `bf4c0ebf69394f49abfb31e297dafccf`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:28:16.931988 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-81ad4e55-95d9-4efe-8431-447c2c9eb5cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:28:16.997726 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1242/2468] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:28:16 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:28:17.008215 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0e0cd-9265-4c2f-9e3f-5a62ea5ac917 service neutron] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:17.009627 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-6ea0e0cd-9265-4c2f-9e3f-5a62ea5ac917 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:28:17.066287 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea0e0cd-9265-4c2f-9e3f-5a62ea5ac917 service neutron] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:17.069769 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193ad2c-d510-439c-b959-44f3e9f11906 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:17.070367 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193ad2c-d510-439c-b959-44f3e9f11906 service cinder] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:17.070644 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193ad2c-d510-439c-b959-44f3e9f11906 service cinder] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:17.070914 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a193ad2c-d510-439c-b959-44f3e9f11906 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:17.078956 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a193ad2c-d510-439c-b959-44f3e9f11906 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:17.080399 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a193ad2c-d510-439c-b959-44f3e9f11906 service cinder] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:17.089214 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1227/2469] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:28:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:28:18.438079 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f1ee6-627f-4f91-87c4-b6203ce2fc8e None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:18.438600 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f1ee6-627f-4f91-87c4-b6203ce2fc8e None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:18.438741 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258f1ee6-627f-4f91-87c4-b6203ce2fc8e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:18.459282 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-258f1ee6-627f-4f91-87c4-b6203ce2fc8e None None] MFA Rules not processed for user `bf4c0ebf69394f49abfb31e297dafccf`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:28:18.460466 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-258f1ee6-627f-4f91-87c4-b6203ce2fc8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:28:18.468118 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1243/2470] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:28:18 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:28:27.085054 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=68,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:28.454054 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=57 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:31.399228 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193ad2c-d510-439c-b959-44f3e9f11906 service cinder] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:28:31.400756 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-a193ad2c-d510-439c-b959-44f3e9f11906 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:28:31.557959 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a193ad2c-d510-439c-b959-44f3e9f11906 service cinder] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:28:31.564269 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0bd83d2-2165-4daf-a7fb-d4c75bc362ef service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e84ea976b5914aea94c4d8f805139daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:28:31.564913 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd83d2-2165-4daf-a7fb-d4c75bc362ef service placement] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:31.565192 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd83d2-2165-4daf-a7fb-d4c75bc362ef service placement] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:31.565464 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0bd83d2-2165-4daf-a7fb-d4c75bc362ef service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:31.567379 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-d0bd83d2-2165-4daf-a7fb-d4c75bc362ef service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:28:31.579803 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bd83d2-2165-4daf-a7fb-d4c75bc362ef service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:28:31.581449 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0bd83d2-2165-4daf-a7fb-d4c75bc362ef service placement] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:28:31.592745 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1228/2471] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:28:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:28:34.857268 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f6a06-ac15-4ba9-b040-d2a072e4932a None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:28:34.857722 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f6a06-ac15-4ba9-b040-d2a072e4932a None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:28:34.857722 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2f6a06-ac15-4ba9-b040-d2a072e4932a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:28:34.880039 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-0c2f6a06-ac15-4ba9-b040-d2a072e4932a None None] MFA Rules not processed for user `600f51be8202427fb3691db566ed2ff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:28:34.881282 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-0c2f6a06-ac15-4ba9-b040-d2a072e4932a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:28:34.937519 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1244/2472] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:28:34 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:28:41.588133 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=63 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:28:44.930618 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=25 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:15.530866 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f8825-d0d3-4c25-8d19-03e90a13ce83 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:15.531402 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f8825-d0d3-4c25-8d19-03e90a13ce83 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:15.531402 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905f8825-d0d3-4c25-8d19-03e90a13ce83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:15.570149 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-905f8825-d0d3-4c25-8d19-03e90a13ce83 None None] MFA Rules not processed for user `36970f0778384576b599cd7217b5084d`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:15.571490 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-905f8825-d0d3-4c25-8d19-03e90a13ce83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:15.640737 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1229/2473] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Aug 5 02:29:15 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:29:15.688728 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f6a06-ac15-4ba9-b040-d2a072e4932a None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:15.690720 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-0c2f6a06-ac15-4ba9-b040-d2a072e4932a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:15.760790 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2f6a06-ac15-4ba9-b040-d2a072e4932a None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:15.765571 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01058f82-a44f-4d2c-ae1b-6d7a5fee920a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f03233b0ee3540cdb5105f6603cfdff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:15.766182 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01058f82-a44f-4d2c-ae1b-6d7a5fee920a service swift] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:15.766459 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01058f82-a44f-4d2c-ae1b-6d7a5fee920a service swift] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:15.766728 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01058f82-a44f-4d2c-ae1b-6d7a5fee920a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:15.775224 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01058f82-a44f-4d2c-ae1b-6d7a5fee920a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:15.776954 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01058f82-a44f-4d2c-ae1b-6d7a5fee920a service swift] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:15.785406 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1245/2474] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Aug 5 02:29:15 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 02:29:25.633886 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=32 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:25.781578 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=32 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:32.133594 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089eea87-20a6-47fd-bf04-2dc1f135c83e None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:32.134178 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089eea87-20a6-47fd-bf04-2dc1f135c83e None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:32.134178 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089eea87-20a6-47fd-bf04-2dc1f135c83e None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:32.135551 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1230/2475] 10.222.0.15 () {54 vars in 921 bytes} [Fri Aug 5 02:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:32.141791 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fb6b2-7dae-4817-b3d8-133f10aa60e0 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:32.142229 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fb6b2-7dae-4817-b3d8-133f10aa60e0 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:32.142333 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460fb6b2-7dae-4817-b3d8-133f10aa60e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:32.188966 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-460fb6b2-7dae-4817-b3d8-133f10aa60e0 None None] MFA Rules not processed for user `4b5c0958604b436daa44b1f67c9dec26`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:32.190203 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-460fb6b2-7dae-4817-b3d8-133f10aa60e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:32.270030 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1246/2476] 10.222.0.15 () {58 vars in 1018 bytes} [Fri Aug 5 02:29:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:29:32.280953 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089eea87-20a6-47fd-bf04-2dc1f135c83e None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:32.282659 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-089eea87-20a6-47fd-bf04-2dc1f135c83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:32.339409 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089eea87-20a6-47fd-bf04-2dc1f135c83e None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:32.342991 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee1e7f-171a-4791-aa36-76513e162364 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c09080c507f4c35b81d482cfbaa6a88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:32.343591 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee1e7f-171a-4791-aa36-76513e162364 service glance] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:32.343871 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee1e7f-171a-4791-aa36-76513e162364 service glance] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:32.344142 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee1e7f-171a-4791-aa36-76513e162364 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:32.355424 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee1e7f-171a-4791-aa36-76513e162364 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:32.356940 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee1e7f-171a-4791-aa36-76513e162364 service glance] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:32.369109 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1231/2477] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:29:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:29:32.452971 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e9f01-76a7-4cb0-a789-157c85582b26 None None] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:32.453255 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e9f01-76a7-4cb0-a789-157c85582b26 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:32.453530 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e9f01-76a7-4cb0-a789-157c85582b26 None None] PATH_INFO: `/` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:32.454902 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1247/2478] 10.222.0.15 () {54 vars in 921 bytes} [Fri Aug 5 02:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:32.460032 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bd947-6089-4057-8f80-5677f574a39a None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:32.460388 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bd947-6089-4057-8f80-5677f574a39a None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:32.460641 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-796bd947-6089-4057-8f80-5677f574a39a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:32.493865 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-796bd947-6089-4057-8f80-5677f574a39a None None] MFA Rules not processed for user `f81daf3da9b34e7380c61005019a53bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:32.495066 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-796bd947-6089-4057-8f80-5677f574a39a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:32.511351 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1232/2479] 10.222.0.15 () {58 vars in 1018 bytes} [Fri Aug 5 02:29:32 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:29:32.523771 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e9f01-76a7-4cb0-a789-157c85582b26 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:32.525566 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-8b4e9f01-76a7-4cb0-a789-157c85582b26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:32.539456 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e9f01-76a7-4cb0-a789-157c85582b26 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:32.542894 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ced081f-8825-4aec-bfa2-1c9cb3ef0ad8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:32.543501 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced081f-8825-4aec-bfa2-1c9cb3ef0ad8 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:32.543811 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced081f-8825-4aec-bfa2-1c9cb3ef0ad8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:32.544035 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ced081f-8825-4aec-bfa2-1c9cb3ef0ad8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:32.552499 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ced081f-8825-4aec-bfa2-1c9cb3ef0ad8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:32.553930 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ced081f-8825-4aec-bfa2-1c9cb3ef0ad8 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:32.562300 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1248/2480] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:29:32 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:29:32.646306 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92b584-06b0-49af-94a8-4e8c46e7d724 None None] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:32.646596 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92b584-06b0-49af-94a8-4e8c46e7d724 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:32.646873 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e92b584-06b0-49af-94a8-4e8c46e7d724 None None] PATH_INFO: `/` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:32.648261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1233/2481] 10.222.0.15 () {54 vars in 921 bytes} [Fri Aug 5 02:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 05 02:29:32.653195 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e42c4-69f3-413c-a79c-ecc2bca92c74 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:32.653488 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e42c4-69f3-413c-a79c-ecc2bca92c74 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:32.653770 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385e42c4-69f3-413c-a79c-ecc2bca92c74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:32.673837 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-385e42c4-69f3-413c-a79c-ecc2bca92c74 None None] MFA Rules not processed for user `4b5c0958604b436daa44b1f67c9dec26`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:32.675050 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-385e42c4-69f3-413c-a79c-ecc2bca92c74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:32.684349 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1249/2482] 10.222.0.15 () {58 vars in 1018 bytes} [Fri Aug 5 02:29:32 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:29:32.694704 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92b584-06b0-49af-94a8-4e8c46e7d724 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:32.706286 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e92b584-06b0-49af-94a8-4e8c46e7d724 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:32.709876 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eff0bd-837e-4588-8f1f-78778ab73f18 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:32.710476 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eff0bd-837e-4588-8f1f-78778ab73f18 service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:32.710759 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eff0bd-837e-4588-8f1f-78778ab73f18 service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:32.711035 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90eff0bd-837e-4588-8f1f-78778ab73f18 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:32.722065 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eff0bd-837e-4588-8f1f-78778ab73f18 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:32.723490 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90eff0bd-837e-4588-8f1f-78778ab73f18 service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:32.734110 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1234/2483] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:29:32 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:29:35.002522 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf3f13-2cef-481f-8f5f-008134536d6c None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:35.002995 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf3f13-2cef-481f-8f5f-008134536d6c None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:35.003105 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08bf3f13-2cef-481f-8f5f-008134536d6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:35.030569 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-08bf3f13-2cef-481f-8f5f-008134536d6c None None] MFA Rules not processed for user `36970f0778384576b599cd7217b5084d`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:35.031783 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-08bf3f13-2cef-481f-8f5f-008134536d6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:35.040959 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1250/2484] 10.222.0.15 () {58 vars in 1009 bytes} [Fri Aug 5 02:29:35 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:29:35.053263 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eff0bd-837e-4588-8f1f-78778ab73f18 service neutron] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:29:35.065383 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90eff0bd-837e-4588-8f1f-78778ab73f18 service neutron] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:29:35.070296 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2063acb4-eff7-408c-86b7-28e04126accb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f03233b0ee3540cdb5105f6603cfdff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:29:35.070891 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063acb4-eff7-408c-86b7-28e04126accb service swift] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:35.071173 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063acb4-eff7-408c-86b7-28e04126accb service swift] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:35.071449 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2063acb4-eff7-408c-86b7-28e04126accb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:35.079321 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2063acb4-eff7-408c-86b7-28e04126accb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:29:35.081539 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2063acb4-eff7-408c-86b7-28e04126accb service swift] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:29:35.090153 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1235/2485] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Aug 5 02:29:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 02:29:45.024371 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=56 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:45.087263 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=50 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:29:49.498791 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e709a1-a2ec-4251-aed7-ddd7b06fd6bd None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:29:49.499324 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e709a1-a2ec-4251-aed7-ddd7b06fd6bd None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:29:49.499324 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e709a1-a2ec-4251-aed7-ddd7b06fd6bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:29:49.520570 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-e0e709a1-a2ec-4251-aed7-ddd7b06fd6bd None None] MFA Rules not processed for user `bf4c0ebf69394f49abfb31e297dafccf`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:29:49.521874 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-e0e709a1-a2ec-4251-aed7-ddd7b06fd6bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:29:49.529045 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1251/2486] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:29:49 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:29:59.514747 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:02.575960 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1dba6-c040-411f-babc-012832eca109 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:02.576475 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1dba6-c040-411f-babc-012832eca109 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:02.576607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d1dba6-c040-411f-babc-012832eca109 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:02.596896 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-72d1dba6-c040-411f-babc-012832eca109 None None] MFA Rules not processed for user `36970f0778384576b599cd7217b5084d`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:02.598102 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-72d1dba6-c040-411f-babc-012832eca109 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:02.605607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1236/2487] 10.222.0.15 () {58 vars in 967 bytes} [Fri Aug 5 02:30:02 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:30:02.617824 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e709a1-a2ec-4251-aed7-ddd7b06fd6bd None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:02.630178 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e709a1-a2ec-4251-aed7-ddd7b06fd6bd None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:02.635704 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227dfc8-3d39-40b4-b498-133908cf8fba service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f03233b0ee3540cdb5105f6603cfdff5', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:02.636362 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227dfc8-3d39-40b4-b498-133908cf8fba service swift] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:02.636652 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227dfc8-3d39-40b4-b498-133908cf8fba service swift] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:02.636929 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2227dfc8-3d39-40b4-b498-133908cf8fba service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:02.644985 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2227dfc8-3d39-40b4-b498-133908cf8fba service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:02.646556 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2227dfc8-3d39-40b4-b498-133908cf8fba service swift] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:02.655440 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1252/2488] 10.222.0.15 () {60 vars in 1384 bytes} [Fri Aug 5 02:30:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 05 02:30:12.592110 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=3 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:12.652145 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=6 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:14.124457 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1dba6-c040-411f-babc-012832eca109 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:14.133684 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d1dba6-c040-411f-babc-012832eca109 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:14.138036 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ba55a-67d0-4e88-8945-a44f90741274 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:14.138631 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ba55a-67d0-4e88-8945-a44f90741274 service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:14.138907 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ba55a-67d0-4e88-8945-a44f90741274 service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:14.139180 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675ba55a-67d0-4e88-8945-a44f90741274 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:14.140934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-675ba55a-67d0-4e88-8945-a44f90741274 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:14.175449 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ba55a-67d0-4e88-8945-a44f90741274 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:14.176916 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-675ba55a-67d0-4e88-8945-a44f90741274 service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:14.196257 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1237/2489] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:30:14 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:30:17.435490 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227dfc8-3d39-40b4-b498-133908cf8fba service swift] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:17.437624 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-2227dfc8-3d39-40b4-b498-133908cf8fba service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:17.453775 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2227dfc8-3d39-40b4-b498-133908cf8fba service swift] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:17.458718 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1bb780f-ed2e-4b4a-a2e5-c0bab9254e3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:17.459360 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb780f-ed2e-4b4a-a2e5-c0bab9254e3b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:17.459638 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb780f-ed2e-4b4a-a2e5-c0bab9254e3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:17.459913 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1bb780f-ed2e-4b4a-a2e5-c0bab9254e3b admin admin] PATH_INFO: `/v3/users/64280d0c3da14f329b6fc21228d92288` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:17.479373 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb780f-ed2e-4b4a-a2e5-c0bab9254e3b admin admin] RBAC: Authorizing `identity:delete_user(user_id=64280d0c3da14f329b6fc21228d92288)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:17.481341 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1bb780f-ed2e-4b4a-a2e5-c0bab9254e3b admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:17.528760 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-d1bb780f-ed2e-4b4a-a2e5-c0bab9254e3b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64280d0c3da14f329b6fc21228d92288'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:17.540995 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-d1bb780f-ed2e-4b4a-a2e5-c0bab9254e3b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64280d0c3da14f329b6fc21228d92288'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:17.541671 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-d1bb780f-ed2e-4b4a-a2e5-c0bab9254e3b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64280d0c3da14f329b6fc21228d92288'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:17.542293 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-d1bb780f-ed2e-4b4a-a2e5-c0bab9254e3b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64280d0c3da14f329b6fc21228d92288'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:17.550208 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-d1bb780f-ed2e-4b4a-a2e5-c0bab9254e3b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64280d0c3da14f329b6fc21228d92288'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:17.563872 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1253/2490] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:30:17 2022] DELETE /identity/v3/users/64280d0c3da14f329b6fc21228d92288 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:30:17.736638 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ba55a-67d0-4e88-8945-a44f90741274 service neutron] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:17.748117 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675ba55a-67d0-4e88-8945-a44f90741274 service neutron] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:17.804730 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c43b93-17b7-4b12-848a-31f1cad81291 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:17.805367 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c43b93-17b7-4b12-848a-31f1cad81291 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:17.805651 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c43b93-17b7-4b12-848a-31f1cad81291 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:17.805929 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c43b93-17b7-4b12-848a-31f1cad81291 admin admin] PATH_INFO: `/v3/projects/ce1ac0db26e648bba79191b3ad8a260b` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:17.816944 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c43b93-17b7-4b12-848a-31f1cad81291 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ce1ac0db26e648bba79191b3ad8a260b)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:17.818876 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c43b93-17b7-4b12-848a-31f1cad81291 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:17.873555 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-33c43b93-17b7-4b12-848a-31f1cad81291 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ce1ac0db26e648bba79191b3ad8a260b', 'request_id': 'req-33c43b93-17b7-4b12-848a-31f1cad81291'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:17.878948 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-33c43b93-17b7-4b12-848a-31f1cad81291 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ce1ac0db26e648bba79191b3ad8a260b', 'request_id': 'req-33c43b93-17b7-4b12-848a-31f1cad81291'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:17.886662 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-33c43b93-17b7-4b12-848a-31f1cad81291 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ce1ac0db26e648bba79191b3ad8a260b', 'request_id': 'req-33c43b93-17b7-4b12-848a-31f1cad81291'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:17.898368 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-33c43b93-17b7-4b12-848a-31f1cad81291 admin admin] The token cache is being invalidate because project ce1ac0db26e648bba79191b3ad8a260b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:30:17.898649 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-33c43b93-17b7-4b12-848a-31f1cad81291 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:17.899289 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-33c43b93-17b7-4b12-848a-31f1cad81291 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:17.900803 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1238/2491] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:30:17 2022] DELETE /identity/v3/projects/ce1ac0db26e648bba79191b3ad8a260b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:30:17.905768 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67908757-e675-415b-87cc-1c9be628db12 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:17.906084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67908757-e675-415b-87cc-1c9be628db12 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:17.906362 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67908757-e675-415b-87cc-1c9be628db12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:17.953780 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-67908757-e675-415b-87cc-1c9be628db12 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:17.954978 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-67908757-e675-415b-87cc-1c9be628db12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:18.012407 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1254/2492] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:30:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:30:18.020547 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93915ca-945d-47db-b493-9f9c20637210 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:18.020836 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93915ca-945d-47db-b493-9f9c20637210 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:18.021115 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93915ca-945d-47db-b493-9f9c20637210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:18.040123 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-f93915ca-945d-47db-b493-9f9c20637210 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:18.041362 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-f93915ca-945d-47db-b493-9f9c20637210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:18.049832 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1239/2493] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:30:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:30:18.053851 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67908757-e675-415b-87cc-1c9be628db12 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:18.063963 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67908757-e675-415b-87cc-1c9be628db12 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:18.068487 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34856390-a2f3-44f6-b64b-bbab48f93919 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:18.069099 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34856390-a2f3-44f6-b64b-bbab48f93919 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:18.069375 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34856390-a2f3-44f6-b64b-bbab48f93919 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:18.069644 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34856390-a2f3-44f6-b64b-bbab48f93919 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:18.070332 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34856390-a2f3-44f6-b64b-bbab48f93919 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:18.070634 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34856390-a2f3-44f6-b64b-bbab48f93919 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:18.072192 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34856390-a2f3-44f6-b64b-bbab48f93919 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:18.083702 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1255/2494] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:30:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:30:18.088003 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93915ca-945d-47db-b493-9f9c20637210 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:18.097271 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93915ca-945d-47db-b493-9f9c20637210 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:18.101922 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645d302-7612-472e-936d-4b5c9c5fafb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:18.102522 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645d302-7612-472e-936d-4b5c9c5fafb1 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:18.102805 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645d302-7612-472e-936d-4b5c9c5fafb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:18.103081 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9645d302-7612-472e-936d-4b5c9c5fafb1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:18.103738 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9645d302-7612-472e-936d-4b5c9c5fafb1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:18.106240 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9645d302-7612-472e-936d-4b5c9c5fafb1 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:18.147839 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1240/2495] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:30:18 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:30:18.149263 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34856390-a2f3-44f6-b64b-bbab48f93919 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:18.159103 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34856390-a2f3-44f6-b64b-bbab48f93919 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:18.183523 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:18.218509 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977a8b6-c564-4854-90c6-a4eb03039073 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:18.219122 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977a8b6-c564-4854-90c6-a4eb03039073 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:18.219404 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977a8b6-c564-4854-90c6-a4eb03039073 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:18.219686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1977a8b6-c564-4854-90c6-a4eb03039073 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:18.220382 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1977a8b6-c564-4854-90c6-a4eb03039073 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:18.222279 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1977a8b6-c564-4854-90c6-a4eb03039073 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:18.241972 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1256/2496] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:30:18 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:30:18.246572 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645d302-7612-472e-936d-4b5c9c5fafb1 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:18.251901 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:18.258183 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9645d302-7612-472e-936d-4b5c9c5fafb1 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:18.264098 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3655c3-66c7-4203-beb1-4ecb0b8e5046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:18.264728 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3655c3-66c7-4203-beb1-4ecb0b8e5046 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:18.265008 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3655c3-66c7-4203-beb1-4ecb0b8e5046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:18.265279 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3655c3-66c7-4203-beb1-4ecb0b8e5046 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:18.265968 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3655c3-66c7-4203-beb1-4ecb0b8e5046 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:18.267540 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d3655c3-66c7-4203-beb1-4ecb0b8e5046 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:18.279182 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1241/2497] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:30:18.283269 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977a8b6-c564-4854-90c6-a4eb03039073 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:18.293352 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1977a8b6-c564-4854-90c6-a4eb03039073 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:18.297979 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6661764-911f-4a04-9e36-1e0fb3097559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:18.298589 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6661764-911f-4a04-9e36-1e0fb3097559 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:18.298865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6661764-911f-4a04-9e36-1e0fb3097559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:18.299136 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6661764-911f-4a04-9e36-1e0fb3097559 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:18.299824 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6661764-911f-4a04-9e36-1e0fb3097559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:18.301438 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6661764-911f-4a04-9e36-1e0fb3097559 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:18.313574 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1257/2498] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:30:18.317637 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3655c3-66c7-4203-beb1-4ecb0b8e5046 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:18.329329 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3655c3-66c7-4203-beb1-4ecb0b8e5046 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:18.334222 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc5ca0d-9a29-4c40-9aa3-b415a995714b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:18.335012 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5ca0d-9a29-4c40-9aa3-b415a995714b admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:18.335295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5ca0d-9a29-4c40-9aa3-b415a995714b admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:18.335573 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc5ca0d-9a29-4c40-9aa3-b415a995714b admin admin] PATH_INFO: `/v3/projects/5caeb95074f34054855d423c92ae0ee4/users/cd1e8ed6f9c3423786367cc5809bb555/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:18.351383 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc5ca0d-9a29-4c40-9aa3-b415a995714b admin admin] RBAC: Authorizing `identity:create_grant(project_id=5caeb95074f34054855d423c92ae0ee4, user_id=cd1e8ed6f9c3423786367cc5809bb555, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:18.354064 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc5ca0d-9a29-4c40-9aa3-b415a995714b admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:18.367120 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1242/2499] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:30:18 2022] PUT /identity/v3/projects/5caeb95074f34054855d423c92ae0ee4/users/cd1e8ed6f9c3423786367cc5809bb555/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:30:18.379075 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c88980-ae09-41f3-b2dd-80eef94579e0 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:18.379360 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c88980-ae09-41f3-b2dd-80eef94579e0 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:18.379629 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4c88980-ae09-41f3-b2dd-80eef94579e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:18.407692 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-c4c88980-ae09-41f3-b2dd-80eef94579e0 None None] MFA Rules not processed for user `cd1e8ed6f9c3423786367cc5809bb555`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:18.408865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-c4c88980-ae09-41f3-b2dd-80eef94579e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:18.471151 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1258/2500] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:30:18 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:30:18.482487 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc5ca0d-9a29-4c40-9aa3-b415a995714b admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:18.484150 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-ddc5ca0d-9a29-4c40-9aa3-b415a995714b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:18.557062 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc5ca0d-9a29-4c40-9aa3-b415a995714b admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:18.563030 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846f30e-1531-4089-9bdb-b887bb050d93 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:18.563629 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846f30e-1531-4089-9bdb-b887bb050d93 service nova] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:18.563911 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846f30e-1531-4089-9bdb-b887bb050d93 service nova] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:18.564179 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c846f30e-1531-4089-9bdb-b887bb050d93 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:18.571678 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c846f30e-1531-4089-9bdb-b887bb050d93 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:18.573808 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c846f30e-1531-4089-9bdb-b887bb050d93 service nova] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:18.582374 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1243/2501] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:30:18 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:30:18.663196 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c88980-ae09-41f3-b2dd-80eef94579e0 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:18.664572 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-c4c88980-ae09-41f3-b2dd-80eef94579e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:18.741810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4c88980-ae09-41f3-b2dd-80eef94579e0 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:18.746020 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8a63f-024d-470d-b13b-ed5c9c08fafd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:18.746638 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8a63f-024d-470d-b13b-ed5c9c08fafd service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:18.746920 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8a63f-024d-470d-b13b-ed5c9c08fafd service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:18.747194 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92b8a63f-024d-470d-b13b-ed5c9c08fafd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:18.748993 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-92b8a63f-024d-470d-b13b-ed5c9c08fafd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:18.762986 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b8a63f-024d-470d-b13b-ed5c9c08fafd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:18.764421 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92b8a63f-024d-470d-b13b-ed5c9c08fafd service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:18.775365 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1259/2502] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:30:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:30:18.842349 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846f30e-1531-4089-9bdb-b887bb050d93 service nova] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:18.844316 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-c846f30e-1531-4089-9bdb-b887bb050d93 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:18.856146 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c846f30e-1531-4089-9bdb-b887bb050d93 service nova] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:18.859671 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae780e11-d4fb-4d5d-9fb7-b852af749ace service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:18.860292 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae780e11-d4fb-4d5d-9fb7-b852af749ace service cinder] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:18.860603 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae780e11-d4fb-4d5d-9fb7-b852af749ace service cinder] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:18.860876 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae780e11-d4fb-4d5d-9fb7-b852af749ace service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:18.862596 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-ae780e11-d4fb-4d5d-9fb7-b852af749ace service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:18.876779 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae780e11-d4fb-4d5d-9fb7-b852af749ace service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:18.878208 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae780e11-d4fb-4d5d-9fb7-b852af749ace service cinder] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:18.890164 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1244/2503] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:30:18 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:30:18.973991 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8a63f-024d-470d-b13b-ed5c9c08fafd service cinder] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:18.993295 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:19.036539 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92b8a63f-024d-470d-b13b-ed5c9c08fafd service cinder] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:19.041192 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68914106-f49b-4382-b199-90ac6a9435fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:19.042411 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68914106-f49b-4382-b199-90ac6a9435fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:19.042795 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68914106-f49b-4382-b199-90ac6a9435fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:19.043074 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68914106-f49b-4382-b199-90ac6a9435fb admin admin] PATH_INFO: `/v3/users/cd1e8ed6f9c3423786367cc5809bb555` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:19.044244 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68914106-f49b-4382-b199-90ac6a9435fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd1e8ed6f9c3423786367cc5809bb555)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:19.046188 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68914106-f49b-4382-b199-90ac6a9435fb admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:19.092972 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-68914106-f49b-4382-b199-90ac6a9435fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd1e8ed6f9c3423786367cc5809bb555'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:19.105477 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-68914106-f49b-4382-b199-90ac6a9435fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd1e8ed6f9c3423786367cc5809bb555'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:19.106224 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-68914106-f49b-4382-b199-90ac6a9435fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd1e8ed6f9c3423786367cc5809bb555'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:19.106827 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-68914106-f49b-4382-b199-90ac6a9435fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd1e8ed6f9c3423786367cc5809bb555'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:19.113588 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-68914106-f49b-4382-b199-90ac6a9435fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd1e8ed6f9c3423786367cc5809bb555'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:19.125755 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1260/2504] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:30:18 2022] DELETE /identity/v3/users/cd1e8ed6f9c3423786367cc5809bb555 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:30:19.130218 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c970a-46dd-4870-b02a-96ef5dac13a1 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:19.130569 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c970a-46dd-4870-b02a-96ef5dac13a1 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:19.130850 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403c970a-46dd-4870-b02a-96ef5dac13a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:19.149333 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-403c970a-46dd-4870-b02a-96ef5dac13a1 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:19.150513 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-403c970a-46dd-4870-b02a-96ef5dac13a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:19.207628 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1245/2505] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:30:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:30:19.218071 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68914106-f49b-4382-b199-90ac6a9435fb admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:19.219466 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-68914106-f49b-4382-b199-90ac6a9435fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:19.275684 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68914106-f49b-4382-b199-90ac6a9435fb admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:19.279273 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6262cb-8ab8-415b-97c0-2de0e79c40ee service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:19.279850 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6262cb-8ab8-415b-97c0-2de0e79c40ee service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:19.280146 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6262cb-8ab8-415b-97c0-2de0e79c40ee service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:19.280451 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6262cb-8ab8-415b-97c0-2de0e79c40ee service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:19.289174 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6262cb-8ab8-415b-97c0-2de0e79c40ee service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:19.290575 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6262cb-8ab8-415b-97c0-2de0e79c40ee service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:19.299713 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1261/2506] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:30:19 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:30:19.565738 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c970a-46dd-4870-b02a-96ef5dac13a1 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:19.567266 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-403c970a-46dd-4870-b02a-96ef5dac13a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:19.581249 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403c970a-46dd-4870-b02a-96ef5dac13a1 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:19.585745 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c539b6-7a0b-4409-90d6-1bc0204a6dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:19.586379 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c539b6-7a0b-4409-90d6-1bc0204a6dc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:19.587396 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c539b6-7a0b-4409-90d6-1bc0204a6dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:19.587823 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c539b6-7a0b-4409-90d6-1bc0204a6dc7 admin admin] PATH_INFO: `/v3/projects/5caeb95074f34054855d423c92ae0ee4` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:19.589170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c539b6-7a0b-4409-90d6-1bc0204a6dc7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5caeb95074f34054855d423c92ae0ee4)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:19.591043 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2c539b6-7a0b-4409-90d6-1bc0204a6dc7 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:19.630385 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:19.640986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-f2c539b6-7a0b-4409-90d6-1bc0204a6dc7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5caeb95074f34054855d423c92ae0ee4', 'request_id': 'req-f2c539b6-7a0b-4409-90d6-1bc0204a6dc7'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:19.646397 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-f2c539b6-7a0b-4409-90d6-1bc0204a6dc7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5caeb95074f34054855d423c92ae0ee4', 'request_id': 'req-f2c539b6-7a0b-4409-90d6-1bc0204a6dc7'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:19.652774 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-f2c539b6-7a0b-4409-90d6-1bc0204a6dc7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5caeb95074f34054855d423c92ae0ee4', 'request_id': 'req-f2c539b6-7a0b-4409-90d6-1bc0204a6dc7'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:19.663772 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-f2c539b6-7a0b-4409-90d6-1bc0204a6dc7 admin admin] The token cache is being invalidate because project 5caeb95074f34054855d423c92ae0ee4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:30:19.664058 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-f2c539b6-7a0b-4409-90d6-1bc0204a6dc7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:19.664699 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-f2c539b6-7a0b-4409-90d6-1bc0204a6dc7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:19.666213 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1246/2507] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:30:19 2022] DELETE /identity/v3/projects/5caeb95074f34054855d423c92ae0ee4 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:30:19.671756 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb15a48-46e6-4f58-9580-18037866a934 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:19.672213 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb15a48-46e6-4f58-9580-18037866a934 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:19.672341 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb15a48-46e6-4f58-9580-18037866a934 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:19.691799 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-3bb15a48-46e6-4f58-9580-18037866a934 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:19.693019 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-3bb15a48-46e6-4f58-9580-18037866a934 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:19.725741 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:19.754362 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1262/2508] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:30:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:30:19.761954 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f11f68-1fbd-4242-a346-4ab28a3337fc None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:19.762244 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f11f68-1fbd-4242-a346-4ab28a3337fc None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:19.762528 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f11f68-1fbd-4242-a346-4ab28a3337fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:19.782172 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-b9f11f68-1fbd-4242-a346-4ab28a3337fc None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:19.783378 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-b9f11f68-1fbd-4242-a346-4ab28a3337fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:19.791163 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1247/2509] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:30:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:30:19.795940 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb15a48-46e6-4f58-9580-18037866a934 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:19.805662 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bb15a48-46e6-4f58-9580-18037866a934 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:19.810516 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ebcd04-a9a9-4ae4-88e9-48e77da00fae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:19.811118 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ebcd04-a9a9-4ae4-88e9-48e77da00fae admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:19.811396 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ebcd04-a9a9-4ae4-88e9-48e77da00fae admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:19.811667 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9ebcd04-a9a9-4ae4-88e9-48e77da00fae admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:19.812387 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ebcd04-a9a9-4ae4-88e9-48e77da00fae admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:19.812694 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ebcd04-a9a9-4ae4-88e9-48e77da00fae admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:19.814264 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9ebcd04-a9a9-4ae4-88e9-48e77da00fae admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:19.825864 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1263/2510] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:30:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:19.829997 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f11f68-1fbd-4242-a346-4ab28a3337fc None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:19.840305 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f11f68-1fbd-4242-a346-4ab28a3337fc None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:19.845062 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff08f5-eb38-4a77-9f60-06d3af5c5040 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:19.845673 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff08f5-eb38-4a77-9f60-06d3af5c5040 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:19.845956 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff08f5-eb38-4a77-9f60-06d3af5c5040 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:19.846233 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edff08f5-eb38-4a77-9f60-06d3af5c5040 admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:19.846929 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edff08f5-eb38-4a77-9f60-06d3af5c5040 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:19.848860 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edff08f5-eb38-4a77-9f60-06d3af5c5040 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:19.876633 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1248/2511] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:30:19 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:30:19.880942 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ebcd04-a9a9-4ae4-88e9-48e77da00fae admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:19.891184 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9ebcd04-a9a9-4ae4-88e9-48e77da00fae admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:19.951338 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a962f2-4241-4668-854c-7534e5cc4042 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:19.951951 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a962f2-4241-4668-854c-7534e5cc4042 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:19.952229 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a962f2-4241-4668-854c-7534e5cc4042 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:19.952531 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a962f2-4241-4668-854c-7534e5cc4042 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:19.953185 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a962f2-4241-4668-854c-7534e5cc4042 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:19.955069 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a962f2-4241-4668-854c-7534e5cc4042 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:19.976238 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1264/2512] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:30:19 2022] POST /identity/v3/users => generated 287 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:30:19.981223 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff08f5-eb38-4a77-9f60-06d3af5c5040 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:19.991526 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edff08f5-eb38-4a77-9f60-06d3af5c5040 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:19.996272 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9413a58-5896-4a03-b50a-957801d9e1b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:19.996917 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9413a58-5896-4a03-b50a-957801d9e1b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:19.997192 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9413a58-5896-4a03-b50a-957801d9e1b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:19.997467 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9413a58-5896-4a03-b50a-957801d9e1b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:19.998158 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9413a58-5896-4a03-b50a-957801d9e1b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:19.999744 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9413a58-5896-4a03-b50a-957801d9e1b0 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:20.009541 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1249/2513] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:30:20.013493 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a962f2-4241-4668-854c-7534e5cc4042 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:20.023248 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a962f2-4241-4668-854c-7534e5cc4042 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:20.028478 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07c3e14a-9336-4eef-ae24-fcf65dcd1e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:20.029082 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3e14a-9336-4eef-ae24-fcf65dcd1e14 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:20.029361 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3e14a-9336-4eef-ae24-fcf65dcd1e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:20.029632 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07c3e14a-9336-4eef-ae24-fcf65dcd1e14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:20.030315 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c3e14a-9336-4eef-ae24-fcf65dcd1e14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:20.031871 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07c3e14a-9336-4eef-ae24-fcf65dcd1e14 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:20.042950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1265/2514] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:30:20.046973 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9413a58-5896-4a03-b50a-957801d9e1b0 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:20.056854 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9413a58-5896-4a03-b50a-957801d9e1b0 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:20.061426 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa339c02-26bb-46d7-8598-dacc32d2e6fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:20.062073 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa339c02-26bb-46d7-8598-dacc32d2e6fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:20.062362 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa339c02-26bb-46d7-8598-dacc32d2e6fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:20.062642 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa339c02-26bb-46d7-8598-dacc32d2e6fc admin admin] PATH_INFO: `/v3/projects/b37e4671445a4b95813f47341088acc6/users/9f7f32d3cdce4160abac2e4c61cce2f5/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:20.077735 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa339c02-26bb-46d7-8598-dacc32d2e6fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=b37e4671445a4b95813f47341088acc6, user_id=9f7f32d3cdce4160abac2e4c61cce2f5, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:20.080382 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa339c02-26bb-46d7-8598-dacc32d2e6fc admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:20.093280 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1250/2515] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:30:20 2022] PUT /identity/v3/projects/b37e4671445a4b95813f47341088acc6/users/9f7f32d3cdce4160abac2e4c61cce2f5/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:30:20.104866 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe495ecc-fa44-4559-8f7d-a0de74dadc99 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:20.105175 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe495ecc-fa44-4559-8f7d-a0de74dadc99 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:20.105455 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe495ecc-fa44-4559-8f7d-a0de74dadc99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:20.132520 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-fe495ecc-fa44-4559-8f7d-a0de74dadc99 None None] MFA Rules not processed for user `9f7f32d3cdce4160abac2e4c61cce2f5`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:20.133714 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-fe495ecc-fa44-4559-8f7d-a0de74dadc99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:20.198706 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1266/2516] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:30:20 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:30:20.203395 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa339c02-26bb-46d7-8598-dacc32d2e6fc admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:20.266985 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa339c02-26bb-46d7-8598-dacc32d2e6fc admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:20.271544 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81276405-27b7-4686-840e-e37d0080bd12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:20.272161 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81276405-27b7-4686-840e-e37d0080bd12 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:20.272466 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81276405-27b7-4686-840e-e37d0080bd12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:20.272741 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81276405-27b7-4686-840e-e37d0080bd12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:20.273408 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81276405-27b7-4686-840e-e37d0080bd12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:20.275294 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81276405-27b7-4686-840e-e37d0080bd12 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:20.301517 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1251/2517] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:30:20 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:30:20.305390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe495ecc-fa44-4559-8f7d-a0de74dadc99 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:20.316040 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe495ecc-fa44-4559-8f7d-a0de74dadc99 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:20.349390 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:20.374460 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dcb27c-dbc6-4b27-9f59-7445031e8e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:20.375069 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dcb27c-dbc6-4b27-9f59-7445031e8e49 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:20.375348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dcb27c-dbc6-4b27-9f59-7445031e8e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:20.375619 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dcb27c-dbc6-4b27-9f59-7445031e8e49 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:20.376272 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dcb27c-dbc6-4b27-9f59-7445031e8e49 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:20.378217 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dcb27c-dbc6-4b27-9f59-7445031e8e49 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:20.399395 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1267/2518] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:30:20 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:30:20.404212 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81276405-27b7-4686-840e-e37d0080bd12 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:20.414445 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81276405-27b7-4686-840e-e37d0080bd12 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:20.419077 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8449c-914a-4d95-9825-7b3e78d12de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:20.419687 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8449c-914a-4d95-9825-7b3e78d12de3 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:20.419971 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8449c-914a-4d95-9825-7b3e78d12de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:20.420249 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c8449c-914a-4d95-9825-7b3e78d12de3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:20.420974 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8449c-914a-4d95-9825-7b3e78d12de3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:20.422658 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c8449c-914a-4d95-9825-7b3e78d12de3 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:20.433408 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1252/2519] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:30:20.437257 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dcb27c-dbc6-4b27-9f59-7445031e8e49 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:20.447013 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dcb27c-dbc6-4b27-9f59-7445031e8e49 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:20.452033 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52708612-eca8-4dd6-8b6a-ae2f7c054c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:20.452752 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52708612-eca8-4dd6-8b6a-ae2f7c054c3b admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:20.453030 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52708612-eca8-4dd6-8b6a-ae2f7c054c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:20.453302 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52708612-eca8-4dd6-8b6a-ae2f7c054c3b admin admin] PATH_INFO: `/v3/projects/3dd08c27f9b24dd085d6d3cf5bcb6cb1/users/41b3d48d6500494c9bbb902140f7f15a/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:20.468593 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52708612-eca8-4dd6-8b6a-ae2f7c054c3b admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dd08c27f9b24dd085d6d3cf5bcb6cb1, user_id=41b3d48d6500494c9bbb902140f7f15a, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:20.471279 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52708612-eca8-4dd6-8b6a-ae2f7c054c3b admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:20.485448 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1268/2520] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:30:20 2022] PUT /identity/v3/projects/3dd08c27f9b24dd085d6d3cf5bcb6cb1/users/41b3d48d6500494c9bbb902140f7f15a/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:30:20.489318 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8449c-914a-4d95-9825-7b3e78d12de3 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:20.500124 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c8449c-914a-4d95-9825-7b3e78d12de3 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:20.531381 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:20.560018 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0edf66-0163-4e3b-a3ec-f2319d46dabb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:20.560669 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0edf66-0163-4e3b-a3ec-f2319d46dabb admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:20.560953 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0edf66-0163-4e3b-a3ec-f2319d46dabb admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:20.561225 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0edf66-0163-4e3b-a3ec-f2319d46dabb admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:20.561908 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0edf66-0163-4e3b-a3ec-f2319d46dabb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:20.563508 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0edf66-0163-4e3b-a3ec-f2319d46dabb admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:20.572909 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1253/2521] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:30:20.577679 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52708612-eca8-4dd6-8b6a-ae2f7c054c3b admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:20.587991 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52708612-eca8-4dd6-8b6a-ae2f7c054c3b admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:20.592642 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7177f-9f74-47c1-9012-0b3924ed56bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:20.593298 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7177f-9f74-47c1-9012-0b3924ed56bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:20.593578 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7177f-9f74-47c1-9012-0b3924ed56bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:20.593852 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d7177f-9f74-47c1-9012-0b3924ed56bb admin admin] PATH_INFO: `/v3/projects/3dd08c27f9b24dd085d6d3cf5bcb6cb1/users/41b3d48d6500494c9bbb902140f7f15a/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:20.595765 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d7177f-9f74-47c1-9012-0b3924ed56bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=3dd08c27f9b24dd085d6d3cf5bcb6cb1, user_id=41b3d48d6500494c9bbb902140f7f15a, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:20.598395 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d7177f-9f74-47c1-9012-0b3924ed56bb admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:20.608280 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1269/2522] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:30:20 2022] PUT /identity/v3/projects/3dd08c27f9b24dd085d6d3cf5bcb6cb1/users/41b3d48d6500494c9bbb902140f7f15a/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:30:20.618321 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697a23c-aa8f-49c2-812d-4a2ea47728ad None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:20.618615 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697a23c-aa8f-49c2-812d-4a2ea47728ad None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:20.618910 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b697a23c-aa8f-49c2-812d-4a2ea47728ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:20.648186 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-b697a23c-aa8f-49c2-812d-4a2ea47728ad None None] MFA Rules not processed for user `41b3d48d6500494c9bbb902140f7f15a`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:20.649422 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-b697a23c-aa8f-49c2-812d-4a2ea47728ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:20.715827 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1254/2523] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:30:20 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:30:20.726941 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7177f-9f74-47c1-9012-0b3924ed56bb admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:20.728742 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-98d7177f-9f74-47c1-9012-0b3924ed56bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:20.789197 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d7177f-9f74-47c1-9012-0b3924ed56bb admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:20.793963 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5cb9cab-b466-4211-9516-d072f2580844 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:20.794584 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb9cab-b466-4211-9516-d072f2580844 service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:20.794867 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb9cab-b466-4211-9516-d072f2580844 service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:20.795140 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5cb9cab-b466-4211-9516-d072f2580844 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:20.804203 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb9cab-b466-4211-9516-d072f2580844 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:20.805652 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5cb9cab-b466-4211-9516-d072f2580844 service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:20.815563 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1270/2524] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:30:20 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:30:21.202930 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697a23c-aa8f-49c2-812d-4a2ea47728ad None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:21.265285 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b697a23c-aa8f-49c2-812d-4a2ea47728ad None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:21.269694 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fab6e0-02dc-4fd9-8dc5-0d0158bdc170 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:21.270315 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fab6e0-02dc-4fd9-8dc5-0d0158bdc170 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:21.270593 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fab6e0-02dc-4fd9-8dc5-0d0158bdc170 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:21.270871 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fab6e0-02dc-4fd9-8dc5-0d0158bdc170 admin admin] PATH_INFO: `/v3/users/9f7f32d3cdce4160abac2e4c61cce2f5` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:21.271999 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fab6e0-02dc-4fd9-8dc5-0d0158bdc170 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9f7f32d3cdce4160abac2e4c61cce2f5)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:21.273933 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fab6e0-02dc-4fd9-8dc5-0d0158bdc170 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:21.318565 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-a0fab6e0-02dc-4fd9-8dc5-0d0158bdc170 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9f7f32d3cdce4160abac2e4c61cce2f5'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:21.326232 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:21.332811 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-a0fab6e0-02dc-4fd9-8dc5-0d0158bdc170 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9f7f32d3cdce4160abac2e4c61cce2f5'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:21.333502 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-a0fab6e0-02dc-4fd9-8dc5-0d0158bdc170 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9f7f32d3cdce4160abac2e4c61cce2f5'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:21.334270 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-a0fab6e0-02dc-4fd9-8dc5-0d0158bdc170 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9f7f32d3cdce4160abac2e4c61cce2f5'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:21.341813 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-a0fab6e0-02dc-4fd9-8dc5-0d0158bdc170 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9f7f32d3cdce4160abac2e4c61cce2f5'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:21.353761 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1255/2525] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:30:21 2022] DELETE /identity/v3/users/9f7f32d3cdce4160abac2e4c61cce2f5 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:30:21.358756 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845597e-5334-4a39-9afa-eec0199fbf92 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:21.359067 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845597e-5334-4a39-9afa-eec0199fbf92 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:21.359338 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4845597e-5334-4a39-9afa-eec0199fbf92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:21.379054 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-4845597e-5334-4a39-9afa-eec0199fbf92 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:21.380239 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-4845597e-5334-4a39-9afa-eec0199fbf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:21.440038 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1271/2526] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:30:21 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:30:21.450352 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fab6e0-02dc-4fd9-8dc5-0d0158bdc170 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:21.452176 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-a0fab6e0-02dc-4fd9-8dc5-0d0158bdc170 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:21.509289 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fab6e0-02dc-4fd9-8dc5-0d0158bdc170 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:21.514105 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7d96c-2381-4bf7-8e07-9d1af2badae9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:21.514716 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7d96c-2381-4bf7-8e07-9d1af2badae9 service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:21.514998 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7d96c-2381-4bf7-8e07-9d1af2badae9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:21.515273 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afe7d96c-2381-4bf7-8e07-9d1af2badae9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:21.524193 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7d96c-2381-4bf7-8e07-9d1af2badae9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:21.525663 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afe7d96c-2381-4bf7-8e07-9d1af2badae9 service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:21.535547 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1256/2527] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:30:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:30:21.807872 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845597e-5334-4a39-9afa-eec0199fbf92 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:21.809700 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-4845597e-5334-4a39-9afa-eec0199fbf92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:21.828170 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4845597e-5334-4a39-9afa-eec0199fbf92 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:21.833777 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605057b7-d5d7-4f57-bfe6-892d7bab8d1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:21.834799 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605057b7-d5d7-4f57-bfe6-892d7bab8d1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:21.834799 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605057b7-d5d7-4f57-bfe6-892d7bab8d1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:21.835149 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-605057b7-d5d7-4f57-bfe6-892d7bab8d1d admin admin] PATH_INFO: `/v3/projects/b37e4671445a4b95813f47341088acc6` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:21.836482 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605057b7-d5d7-4f57-bfe6-892d7bab8d1d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b37e4671445a4b95813f47341088acc6)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:21.838761 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-605057b7-d5d7-4f57-bfe6-892d7bab8d1d admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:21.869994 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:21.888410 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-605057b7-d5d7-4f57-bfe6-892d7bab8d1d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b37e4671445a4b95813f47341088acc6', 'request_id': 'req-605057b7-d5d7-4f57-bfe6-892d7bab8d1d'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:21.893880 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-605057b7-d5d7-4f57-bfe6-892d7bab8d1d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b37e4671445a4b95813f47341088acc6', 'request_id': 'req-605057b7-d5d7-4f57-bfe6-892d7bab8d1d'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:21.901108 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-605057b7-d5d7-4f57-bfe6-892d7bab8d1d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b37e4671445a4b95813f47341088acc6', 'request_id': 'req-605057b7-d5d7-4f57-bfe6-892d7bab8d1d'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:21.912603 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-605057b7-d5d7-4f57-bfe6-892d7bab8d1d admin admin] The token cache is being invalidate because project b37e4671445a4b95813f47341088acc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:30:21.912910 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-605057b7-d5d7-4f57-bfe6-892d7bab8d1d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:21.913554 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-605057b7-d5d7-4f57-bfe6-892d7bab8d1d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:21.915075 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1272/2528] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:30:21 2022] DELETE /identity/v3/projects/b37e4671445a4b95813f47341088acc6 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:30:21.919691 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7d96c-2381-4bf7-8e07-9d1af2badae9 service neutron] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:21.930227 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afe7d96c-2381-4bf7-8e07-9d1af2badae9 service neutron] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:21.986942 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55326b2d-5a03-49bb-8d1b-a6ebc8507570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:21.987645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55326b2d-5a03-49bb-8d1b-a6ebc8507570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:21.987844 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55326b2d-5a03-49bb-8d1b-a6ebc8507570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:21.988116 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55326b2d-5a03-49bb-8d1b-a6ebc8507570 admin admin] PATH_INFO: `/v3/users/41b3d48d6500494c9bbb902140f7f15a` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:21.989290 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55326b2d-5a03-49bb-8d1b-a6ebc8507570 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41b3d48d6500494c9bbb902140f7f15a)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:21.991199 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55326b2d-5a03-49bb-8d1b-a6ebc8507570 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:22.039549 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-55326b2d-5a03-49bb-8d1b-a6ebc8507570 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41b3d48d6500494c9bbb902140f7f15a'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:22.051867 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-55326b2d-5a03-49bb-8d1b-a6ebc8507570 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41b3d48d6500494c9bbb902140f7f15a'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:22.052595 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-55326b2d-5a03-49bb-8d1b-a6ebc8507570 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41b3d48d6500494c9bbb902140f7f15a'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:22.053202 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-55326b2d-5a03-49bb-8d1b-a6ebc8507570 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41b3d48d6500494c9bbb902140f7f15a'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:22.061153 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-55326b2d-5a03-49bb-8d1b-a6ebc8507570 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41b3d48d6500494c9bbb902140f7f15a'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:22.066764 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:22.075910 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1257/2529] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:30:21 2022] DELETE /identity/v3/users/41b3d48d6500494c9bbb902140f7f15a => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:30:22.362711 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605057b7-d5d7-4f57-bfe6-892d7bab8d1d admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:22.364138 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-605057b7-d5d7-4f57-bfe6-892d7bab8d1d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:22.380031 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-605057b7-d5d7-4f57-bfe6-892d7bab8d1d admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:22.438959 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df60d1b5-d91d-42cb-95e5-ebeddbba98f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:22.439599 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60d1b5-d91d-42cb-95e5-ebeddbba98f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:22.439877 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60d1b5-d91d-42cb-95e5-ebeddbba98f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:22.440148 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df60d1b5-d91d-42cb-95e5-ebeddbba98f4 admin admin] PATH_INFO: `/v3/projects/3dd08c27f9b24dd085d6d3cf5bcb6cb1` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:22.441323 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df60d1b5-d91d-42cb-95e5-ebeddbba98f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3dd08c27f9b24dd085d6d3cf5bcb6cb1)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:22.443201 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df60d1b5-d91d-42cb-95e5-ebeddbba98f4 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:22.488167 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-df60d1b5-d91d-42cb-95e5-ebeddbba98f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3dd08c27f9b24dd085d6d3cf5bcb6cb1', 'request_id': 'req-df60d1b5-d91d-42cb-95e5-ebeddbba98f4'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:22.493642 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-df60d1b5-d91d-42cb-95e5-ebeddbba98f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3dd08c27f9b24dd085d6d3cf5bcb6cb1', 'request_id': 'req-df60d1b5-d91d-42cb-95e5-ebeddbba98f4'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:22.501555 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-df60d1b5-d91d-42cb-95e5-ebeddbba98f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3dd08c27f9b24dd085d6d3cf5bcb6cb1', 'request_id': 'req-df60d1b5-d91d-42cb-95e5-ebeddbba98f4'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:22.512311 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-df60d1b5-d91d-42cb-95e5-ebeddbba98f4 admin admin] The token cache is being invalidate because project 3dd08c27f9b24dd085d6d3cf5bcb6cb1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:30:22.512627 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-df60d1b5-d91d-42cb-95e5-ebeddbba98f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:22.513245 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-df60d1b5-d91d-42cb-95e5-ebeddbba98f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:22.514741 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1273/2530] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:30:22 2022] DELETE /identity/v3/projects/3dd08c27f9b24dd085d6d3cf5bcb6cb1 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:30:22.519519 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fd905-73fe-4c38-bd8d-4c4fc5a1bdc8 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:22.520000 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fd905-73fe-4c38-bd8d-4c4fc5a1bdc8 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:22.520112 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-596fd905-73fe-4c38-bd8d-4c4fc5a1bdc8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:22.542236 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-596fd905-73fe-4c38-bd8d-4c4fc5a1bdc8 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:22.544552 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-596fd905-73fe-4c38-bd8d-4c4fc5a1bdc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:22.611537 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1258/2531] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:30:22.620169 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26bdb91-3b09-41d2-9102-17dc56cf3bed None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:22.620585 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26bdb91-3b09-41d2-9102-17dc56cf3bed None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:22.620865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d26bdb91-3b09-41d2-9102-17dc56cf3bed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:22.647734 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-d26bdb91-3b09-41d2-9102-17dc56cf3bed None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:22.648889 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-d26bdb91-3b09-41d2-9102-17dc56cf3bed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:22.657388 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1274/2532] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:30:22 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:30:22.661720 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596fd905-73fe-4c38-bd8d-4c4fc5a1bdc8 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:22.672427 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-596fd905-73fe-4c38-bd8d-4c4fc5a1bdc8 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:22.677617 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b051f-6d33-4abb-8b6c-a3f685bc9b77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:22.678422 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b051f-6d33-4abb-8b6c-a3f685bc9b77 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:22.678704 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b051f-6d33-4abb-8b6c-a3f685bc9b77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:22.678986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9b051f-6d33-4abb-8b6c-a3f685bc9b77 admin admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:22.679687 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b051f-6d33-4abb-8b6c-a3f685bc9b77 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:22.679992 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b051f-6d33-4abb-8b6c-a3f685bc9b77 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:22.681684 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9b051f-6d33-4abb-8b6c-a3f685bc9b77 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:22.697934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1259/2533] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:30:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:22.699042 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26bdb91-3b09-41d2-9102-17dc56cf3bed None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:22.708902 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d26bdb91-3b09-41d2-9102-17dc56cf3bed None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:22.714082 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b819c-e29c-4f76-bfa3-d17d0a98fabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:22.714708 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b819c-e29c-4f76-bfa3-d17d0a98fabd admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:22.714989 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b819c-e29c-4f76-bfa3-d17d0a98fabd admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:22.715759 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484b819c-e29c-4f76-bfa3-d17d0a98fabd admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:22.716697 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b819c-e29c-4f76-bfa3-d17d0a98fabd admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:22.718598 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484b819c-e29c-4f76-bfa3-d17d0a98fabd admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:22.755381 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1275/2534] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:30:22 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:30:22.758008 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b051f-6d33-4abb-8b6c-a3f685bc9b77 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:22.768743 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9b051f-6d33-4abb-8b6c-a3f685bc9b77 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:22.826024 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f78cd-1163-420e-bb85-cf49ab951539 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:22.826637 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f78cd-1163-420e-bb85-cf49ab951539 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:22.826919 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f78cd-1163-420e-bb85-cf49ab951539 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:22.827189 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969f78cd-1163-420e-bb85-cf49ab951539 admin admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:22.827880 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969f78cd-1163-420e-bb85-cf49ab951539 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:22.829839 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969f78cd-1163-420e-bb85-cf49ab951539 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:22.852048 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1260/2535] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:30:22 2022] POST /identity/v3/users => generated 290 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:30:22.857013 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b819c-e29c-4f76-bfa3-d17d0a98fabd admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:22.867144 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484b819c-e29c-4f76-bfa3-d17d0a98fabd admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:22.872245 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e992b7c8-9664-4fb4-8ce1-881fc8d9f999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:22.872897 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992b7c8-9664-4fb4-8ce1-881fc8d9f999 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:22.873181 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992b7c8-9664-4fb4-8ce1-881fc8d9f999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:22.873454 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e992b7c8-9664-4fb4-8ce1-881fc8d9f999 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:22.874148 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e992b7c8-9664-4fb4-8ce1-881fc8d9f999 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:22.875719 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e992b7c8-9664-4fb4-8ce1-881fc8d9f999 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:22.885588 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1276/2536] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:30:22.889680 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f78cd-1163-420e-bb85-cf49ab951539 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:22.899732 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969f78cd-1163-420e-bb85-cf49ab951539 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:22.905578 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882b31b5-e8ee-4c5b-85f6-ef9bab05523b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:22.906187 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b31b5-e8ee-4c5b-85f6-ef9bab05523b admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:22.906471 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b31b5-e8ee-4c5b-85f6-ef9bab05523b admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:22.906747 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882b31b5-e8ee-4c5b-85f6-ef9bab05523b admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:22.907518 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b31b5-e8ee-4c5b-85f6-ef9bab05523b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:22.909217 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882b31b5-e8ee-4c5b-85f6-ef9bab05523b admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:22.920520 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1261/2537] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:30:22 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:30:22.924906 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e992b7c8-9664-4fb4-8ce1-881fc8d9f999 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:22.942652 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e992b7c8-9664-4fb4-8ce1-881fc8d9f999 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:22.943713 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:22.949150 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6709650-945e-44aa-8a60-2b6da9d4b5e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:22.949879 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6709650-945e-44aa-8a60-2b6da9d4b5e0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:22.950466 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6709650-945e-44aa-8a60-2b6da9d4b5e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:22.950678 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6709650-945e-44aa-8a60-2b6da9d4b5e0 admin admin] PATH_INFO: `/v3/projects/7e52479b67a14064ac6286b8fd6f7599/users/7e8349ad1b254c02bce34a45b9445914/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:22.969793 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6709650-945e-44aa-8a60-2b6da9d4b5e0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e52479b67a14064ac6286b8fd6f7599, user_id=7e8349ad1b254c02bce34a45b9445914, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:22.972366 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6709650-945e-44aa-8a60-2b6da9d4b5e0 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:22.987511 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1277/2538] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:30:22 2022] PUT /identity/v3/projects/7e52479b67a14064ac6286b8fd6f7599/users/7e8349ad1b254c02bce34a45b9445914/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:30:22.998933 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d173633-0e96-48bb-8984-b34728e3ba08 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:22.999217 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d173633-0e96-48bb-8984-b34728e3ba08 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:22.999496 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d173633-0e96-48bb-8984-b34728e3ba08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:23.027419 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-0d173633-0e96-48bb-8984-b34728e3ba08 None None] MFA Rules not processed for user `7e8349ad1b254c02bce34a45b9445914`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:23.029169 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-0d173633-0e96-48bb-8984-b34728e3ba08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:23.078283 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:23.097502 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1262/2539] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:30:22 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:30:23.102078 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6709650-945e-44aa-8a60-2b6da9d4b5e0 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:23.166027 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6709650-945e-44aa-8a60-2b6da9d4b5e0 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:23.171304 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac66c0-1759-47af-aec6-5234bf1bcf36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:23.171931 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac66c0-1759-47af-aec6-5234bf1bcf36 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:23.172303 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac66c0-1759-47af-aec6-5234bf1bcf36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:23.172529 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ac66c0-1759-47af-aec6-5234bf1bcf36 admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:23.173203 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac66c0-1759-47af-aec6-5234bf1bcf36 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:23.175105 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19ac66c0-1759-47af-aec6-5234bf1bcf36 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:23.203072 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1278/2540] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:30:23 2022] POST /identity/v3/projects => generated 381 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:30:23.207293 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d173633-0e96-48bb-8984-b34728e3ba08 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:23.220498 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d173633-0e96-48bb-8984-b34728e3ba08 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:23.275567 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c47a16-eccb-4ddd-b9fd-655e6c3852f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:23.276245 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c47a16-eccb-4ddd-b9fd-655e6c3852f6 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:23.276552 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c47a16-eccb-4ddd-b9fd-655e6c3852f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:23.276825 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c47a16-eccb-4ddd-b9fd-655e6c3852f6 admin admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:23.277491 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c47a16-eccb-4ddd-b9fd-655e6c3852f6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:23.279473 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c47a16-eccb-4ddd-b9fd-655e6c3852f6 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:23.300210 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1263/2541] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:30:23 2022] POST /identity/v3/users => generated 297 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:30:23.304217 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac66c0-1759-47af-aec6-5234bf1bcf36 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:23.315043 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ac66c0-1759-47af-aec6-5234bf1bcf36 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:23.319559 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351028d1-2674-496f-bd05-ada27c3ae6a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:23.320148 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351028d1-2674-496f-bd05-ada27c3ae6a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:23.320461 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351028d1-2674-496f-bd05-ada27c3ae6a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:23.320737 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351028d1-2674-496f-bd05-ada27c3ae6a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:23.321421 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351028d1-2674-496f-bd05-ada27c3ae6a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:23.323038 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351028d1-2674-496f-bd05-ada27c3ae6a8 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:23.335727 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1279/2542] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:30:23.340249 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c47a16-eccb-4ddd-b9fd-655e6c3852f6 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:23.350100 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c47a16-eccb-4ddd-b9fd-655e6c3852f6 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:23.354588 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c88bc-1c4f-4f88-a22d-a128576c30a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:23.355234 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c88bc-1c4f-4f88-a22d-a128576c30a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:23.355510 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c88bc-1c4f-4f88-a22d-a128576c30a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:23.356343 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b59c88bc-1c4f-4f88-a22d-a128576c30a7 admin admin] PATH_INFO: `/v3/projects/30980d411371424b99b8e15819c011dc/users/40d7074605b7469b8ed655c1173d3944/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:23.371347 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c88bc-1c4f-4f88-a22d-a128576c30a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30980d411371424b99b8e15819c011dc, user_id=40d7074605b7469b8ed655c1173d3944, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:23.374997 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b59c88bc-1c4f-4f88-a22d-a128576c30a7 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:23.387922 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1264/2543] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:30:23 2022] PUT /identity/v3/projects/30980d411371424b99b8e15819c011dc/users/40d7074605b7469b8ed655c1173d3944/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:30:23.391823 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351028d1-2674-496f-bd05-ada27c3ae6a8 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:23.402219 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351028d1-2674-496f-bd05-ada27c3ae6a8 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:23.460671 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f19efd0-f4b8-47fe-9334-05f214035221 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:23.461287 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19efd0-f4b8-47fe-9334-05f214035221 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:23.461570 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19efd0-f4b8-47fe-9334-05f214035221 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:23.462100 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f19efd0-f4b8-47fe-9334-05f214035221 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:23.462783 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19efd0-f4b8-47fe-9334-05f214035221 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:23.464386 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f19efd0-f4b8-47fe-9334-05f214035221 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:23.474457 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1280/2544] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:30:23 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:30:23.478593 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c88bc-1c4f-4f88-a22d-a128576c30a7 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:23.489412 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b59c88bc-1c4f-4f88-a22d-a128576c30a7 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:23.493938 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed38e35-980d-4f83-8322-ebb7fd5e0c00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:23.494588 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed38e35-980d-4f83-8322-ebb7fd5e0c00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:23.494869 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed38e35-980d-4f83-8322-ebb7fd5e0c00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:23.495144 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed38e35-980d-4f83-8322-ebb7fd5e0c00 admin admin] PATH_INFO: `/v3/projects/30980d411371424b99b8e15819c011dc/users/40d7074605b7469b8ed655c1173d3944/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:23.497189 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed38e35-980d-4f83-8322-ebb7fd5e0c00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30980d411371424b99b8e15819c011dc, user_id=40d7074605b7469b8ed655c1173d3944, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:23.499811 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed38e35-980d-4f83-8322-ebb7fd5e0c00 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:23.510118 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1265/2545] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:30:23 2022] PUT /identity/v3/projects/30980d411371424b99b8e15819c011dc/users/40d7074605b7469b8ed655c1173d3944/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:30:23.520033 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fae3c-aa9c-43a4-8c4d-fc4f95aaf899 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:23.520318 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fae3c-aa9c-43a4-8c4d-fc4f95aaf899 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:23.520620 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4fae3c-aa9c-43a4-8c4d-fc4f95aaf899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:23.549055 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-cf4fae3c-aa9c-43a4-8c4d-fc4f95aaf899 None None] MFA Rules not processed for user `40d7074605b7469b8ed655c1173d3944`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:23.550291 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-cf4fae3c-aa9c-43a4-8c4d-fc4f95aaf899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:23.589878 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:23.618701 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1281/2546] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:30:23 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:30:23.630129 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed38e35-980d-4f83-8322-ebb7fd5e0c00 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:23.631852 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-6ed38e35-980d-4f83-8322-ebb7fd5e0c00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:23.689425 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed38e35-980d-4f83-8322-ebb7fd5e0c00 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:23.693076 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f56c04-c8b9-45a0-8816-19c185848dd0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:23.693682 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f56c04-c8b9-45a0-8816-19c185848dd0 service cinder] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:23.693961 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f56c04-c8b9-45a0-8816-19c185848dd0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:23.694236 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f56c04-c8b9-45a0-8816-19c185848dd0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:23.703124 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f56c04-c8b9-45a0-8816-19c185848dd0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:23.704570 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f56c04-c8b9-45a0-8816-19c185848dd0 service cinder] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:23.714037 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1266/2547] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:30:23 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:30:24.096932 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4fae3c-aa9c-43a4-8c4d-fc4f95aaf899 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:24.158490 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4fae3c-aa9c-43a4-8c4d-fc4f95aaf899 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:24.162960 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd928cd3-58e8-45fc-b3c8-121b62f06b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:24.163592 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd928cd3-58e8-45fc-b3c8-121b62f06b56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:24.163867 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd928cd3-58e8-45fc-b3c8-121b62f06b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:24.164138 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd928cd3-58e8-45fc-b3c8-121b62f06b56 admin admin] PATH_INFO: `/v3/users/7e8349ad1b254c02bce34a45b9445914` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:24.165313 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd928cd3-58e8-45fc-b3c8-121b62f06b56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7e8349ad1b254c02bce34a45b9445914)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:24.167221 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd928cd3-58e8-45fc-b3c8-121b62f06b56 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:24.220882 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-bd928cd3-58e8-45fc-b3c8-121b62f06b56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7e8349ad1b254c02bce34a45b9445914'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:24.232919 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-bd928cd3-58e8-45fc-b3c8-121b62f06b56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7e8349ad1b254c02bce34a45b9445914'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:24.233598 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-bd928cd3-58e8-45fc-b3c8-121b62f06b56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7e8349ad1b254c02bce34a45b9445914'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:24.234236 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-bd928cd3-58e8-45fc-b3c8-121b62f06b56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7e8349ad1b254c02bce34a45b9445914'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:24.242029 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-bd928cd3-58e8-45fc-b3c8-121b62f06b56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7e8349ad1b254c02bce34a45b9445914'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:24.254683 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1282/2548] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:30:24 2022] DELETE /identity/v3/users/7e8349ad1b254c02bce34a45b9445914 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:30:24.259093 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a56d8-5b03-44dd-92d9-82bee43a8b5a None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:24.259381 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a56d8-5b03-44dd-92d9-82bee43a8b5a None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:24.259655 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d29a56d8-5b03-44dd-92d9-82bee43a8b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:24.279179 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-d29a56d8-5b03-44dd-92d9-82bee43a8b5a None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:24.280425 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-d29a56d8-5b03-44dd-92d9-82bee43a8b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:24.321076 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:24.340670 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1267/2549] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:30:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:30:24.350405 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd928cd3-58e8-45fc-b3c8-121b62f06b56 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:24.351793 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-bd928cd3-58e8-45fc-b3c8-121b62f06b56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:24.408739 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd928cd3-58e8-45fc-b3c8-121b62f06b56 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:24.412400 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3995d-7e78-4af9-9330-2b0959b20d62 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:24.413025 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3995d-7e78-4af9-9330-2b0959b20d62 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:24.413303 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3995d-7e78-4af9-9330-2b0959b20d62 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:24.413578 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11c3995d-7e78-4af9-9330-2b0959b20d62 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:24.423630 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c3995d-7e78-4af9-9330-2b0959b20d62 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:24.425063 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11c3995d-7e78-4af9-9330-2b0959b20d62 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:24.428910 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:24.436607 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1283/2550] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:30:24 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:30:24.705996 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a56d8-5b03-44dd-92d9-82bee43a8b5a None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:24.708139 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-d29a56d8-5b03-44dd-92d9-82bee43a8b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:24.722272 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d29a56d8-5b03-44dd-92d9-82bee43a8b5a None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:24.726865 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5d40c-aab3-4bb1-8f52-ce8a9957e845 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:24.727507 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5d40c-aab3-4bb1-8f52-ce8a9957e845 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:24.727790 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5d40c-aab3-4bb1-8f52-ce8a9957e845 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:24.728086 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e5d40c-aab3-4bb1-8f52-ce8a9957e845 admin admin] PATH_INFO: `/v3/projects/7e52479b67a14064ac6286b8fd6f7599` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:24.729256 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e5d40c-aab3-4bb1-8f52-ce8a9957e845 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e52479b67a14064ac6286b8fd6f7599)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:24.732317 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e5d40c-aab3-4bb1-8f52-ce8a9957e845 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:24.780189 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-55e5d40c-aab3-4bb1-8f52-ce8a9957e845 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e52479b67a14064ac6286b8fd6f7599', 'request_id': 'req-55e5d40c-aab3-4bb1-8f52-ce8a9957e845'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:24.785860 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-55e5d40c-aab3-4bb1-8f52-ce8a9957e845 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e52479b67a14064ac6286b8fd6f7599', 'request_id': 'req-55e5d40c-aab3-4bb1-8f52-ce8a9957e845'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:24.793100 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-55e5d40c-aab3-4bb1-8f52-ce8a9957e845 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e52479b67a14064ac6286b8fd6f7599', 'request_id': 'req-55e5d40c-aab3-4bb1-8f52-ce8a9957e845'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:24.805027 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-55e5d40c-aab3-4bb1-8f52-ce8a9957e845 admin admin] The token cache is being invalidate because project 7e52479b67a14064ac6286b8fd6f7599 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:30:24.805320 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-55e5d40c-aab3-4bb1-8f52-ce8a9957e845 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:24.805975 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-55e5d40c-aab3-4bb1-8f52-ce8a9957e845 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:24.807494 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1268/2551] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:30:24 2022] DELETE /identity/v3/projects/7e52479b67a14064ac6286b8fd6f7599 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:30:24.812532 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3995d-7e78-4af9-9330-2b0959b20d62 service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:24.822590 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11c3995d-7e78-4af9-9330-2b0959b20d62 service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:24.880210 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8141aca6-b8e1-4d87-b153-872ad3301993 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:24.880872 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141aca6-b8e1-4d87-b153-872ad3301993 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:24.881147 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141aca6-b8e1-4d87-b153-872ad3301993 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:24.881415 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8141aca6-b8e1-4d87-b153-872ad3301993 admin admin] PATH_INFO: `/v3/users/40d7074605b7469b8ed655c1173d3944` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:24.882561 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141aca6-b8e1-4d87-b153-872ad3301993 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40d7074605b7469b8ed655c1173d3944)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:24.884492 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8141aca6-b8e1-4d87-b153-872ad3301993 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:24.931066 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-8141aca6-b8e1-4d87-b153-872ad3301993 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40d7074605b7469b8ed655c1173d3944'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:24.943583 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-8141aca6-b8e1-4d87-b153-872ad3301993 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40d7074605b7469b8ed655c1173d3944'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:24.944263 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-8141aca6-b8e1-4d87-b153-872ad3301993 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40d7074605b7469b8ed655c1173d3944'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:24.944912 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-8141aca6-b8e1-4d87-b153-872ad3301993 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40d7074605b7469b8ed655c1173d3944'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:24.952575 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-8141aca6-b8e1-4d87-b153-872ad3301993 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40d7074605b7469b8ed655c1173d3944'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:24.965062 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1284/2552] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:30:24 2022] DELETE /identity/v3/users/40d7074605b7469b8ed655c1173d3944 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:30:25.251440 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5d40c-aab3-4bb1-8f52-ce8a9957e845 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:25.252920 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-55e5d40c-aab3-4bb1-8f52-ce8a9957e845 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:25.270249 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e5d40c-aab3-4bb1-8f52-ce8a9957e845 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:25.332578 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa506ca9-bf7a-4b0d-9efd-3d497b58ae84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:25.333168 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa506ca9-bf7a-4b0d-9efd-3d497b58ae84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:25.333452 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa506ca9-bf7a-4b0d-9efd-3d497b58ae84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:25.333731 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa506ca9-bf7a-4b0d-9efd-3d497b58ae84 admin admin] PATH_INFO: `/v3/projects/30980d411371424b99b8e15819c011dc` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:25.334876 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa506ca9-bf7a-4b0d-9efd-3d497b58ae84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=30980d411371424b99b8e15819c011dc)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:25.337068 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa506ca9-bf7a-4b0d-9efd-3d497b58ae84 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:25.389154 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-aa506ca9-bf7a-4b0d-9efd-3d497b58ae84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30980d411371424b99b8e15819c011dc', 'request_id': 'req-aa506ca9-bf7a-4b0d-9efd-3d497b58ae84'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:25.394724 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-aa506ca9-bf7a-4b0d-9efd-3d497b58ae84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30980d411371424b99b8e15819c011dc', 'request_id': 'req-aa506ca9-bf7a-4b0d-9efd-3d497b58ae84'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:25.403376 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-aa506ca9-bf7a-4b0d-9efd-3d497b58ae84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30980d411371424b99b8e15819c011dc', 'request_id': 'req-aa506ca9-bf7a-4b0d-9efd-3d497b58ae84'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:25.410994 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:25.415494 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-aa506ca9-bf7a-4b0d-9efd-3d497b58ae84 admin admin] The token cache is being invalidate because project 30980d411371424b99b8e15819c011dc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:30:25.415955 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-aa506ca9-bf7a-4b0d-9efd-3d497b58ae84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:25.417193 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-aa506ca9-bf7a-4b0d-9efd-3d497b58ae84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:25.419666 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1269/2553] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:30:25 2022] DELETE /identity/v3/projects/30980d411371424b99b8e15819c011dc => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:30:25.424560 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f12205-d038-4680-98e7-614326628507 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:25.425029 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f12205-d038-4680-98e7-614326628507 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:25.425144 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f12205-d038-4680-98e7-614326628507 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:25.445133 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-e0f12205-d038-4680-98e7-614326628507 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:25.446338 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-e0f12205-d038-4680-98e7-614326628507 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:25.507126 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1285/2554] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:30:25.514997 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95baff70-3355-4370-b625-d2743b673c6c None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:25.515286 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95baff70-3355-4370-b625-d2743b673c6c None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:25.515562 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95baff70-3355-4370-b625-d2743b673c6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:25.535469 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-95baff70-3355-4370-b625-d2743b673c6c None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:25.536708 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-95baff70-3355-4370-b625-d2743b673c6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:25.545159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1270/2555] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:30:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:30:25.549389 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f12205-d038-4680-98e7-614326628507 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:25.559769 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f12205-d038-4680-98e7-614326628507 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:25.564656 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52cd934-0cfb-424f-9e9f-ca520d1491a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:25.565283 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52cd934-0cfb-424f-9e9f-ca520d1491a5 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:25.565565 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52cd934-0cfb-424f-9e9f-ca520d1491a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:25.565841 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52cd934-0cfb-424f-9e9f-ca520d1491a5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:25.566555 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52cd934-0cfb-424f-9e9f-ca520d1491a5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:25.566863 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52cd934-0cfb-424f-9e9f-ca520d1491a5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:25.568490 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52cd934-0cfb-424f-9e9f-ca520d1491a5 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:25.581418 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1286/2556] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:30:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:25.585735 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95baff70-3355-4370-b625-d2743b673c6c None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:25.595619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95baff70-3355-4370-b625-d2743b673c6c None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:25.600212 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14989098-c6da-42ca-a86b-65ce6bf56f55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:25.600853 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14989098-c6da-42ca-a86b-65ce6bf56f55 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:25.601133 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14989098-c6da-42ca-a86b-65ce6bf56f55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:25.601433 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14989098-c6da-42ca-a86b-65ce6bf56f55 admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:25.602122 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14989098-c6da-42ca-a86b-65ce6bf56f55 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:25.604020 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14989098-c6da-42ca-a86b-65ce6bf56f55 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:25.632993 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1271/2557] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:30:25 2022] POST /identity/v3/projects => generated 385 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:30:25.637156 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52cd934-0cfb-424f-9e9f-ca520d1491a5 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:25.643457 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:25.647697 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52cd934-0cfb-424f-9e9f-ca520d1491a5 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:25.705477 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3480ccd-6692-4548-8989-4f748705f2d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:25.706093 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3480ccd-6692-4548-8989-4f748705f2d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:25.706372 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3480ccd-6692-4548-8989-4f748705f2d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:25.706646 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3480ccd-6692-4548-8989-4f748705f2d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:25.707301 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3480ccd-6692-4548-8989-4f748705f2d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:25.709234 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3480ccd-6692-4548-8989-4f748705f2d9 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:25.734665 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1287/2558] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:30:25 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:30:25.735821 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14989098-c6da-42ca-a86b-65ce6bf56f55 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:25.746197 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14989098-c6da-42ca-a86b-65ce6bf56f55 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:25.750950 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc242297-620c-4da5-8af9-70a277fa108c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:25.751558 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc242297-620c-4da5-8af9-70a277fa108c admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:25.751845 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc242297-620c-4da5-8af9-70a277fa108c admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:25.752124 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc242297-620c-4da5-8af9-70a277fa108c admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:25.752860 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc242297-620c-4da5-8af9-70a277fa108c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:25.754453 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc242297-620c-4da5-8af9-70a277fa108c admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:25.764651 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1272/2559] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:30:25.768454 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3480ccd-6692-4548-8989-4f748705f2d9 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:25.778847 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3480ccd-6692-4548-8989-4f748705f2d9 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:25.784226 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a0a4d3-8f22-4f98-9437-90ac0a33af79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:25.784893 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a0a4d3-8f22-4f98-9437-90ac0a33af79 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:25.785170 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a0a4d3-8f22-4f98-9437-90ac0a33af79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:25.785462 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a0a4d3-8f22-4f98-9437-90ac0a33af79 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:25.786136 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a0a4d3-8f22-4f98-9437-90ac0a33af79 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:25.787701 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a0a4d3-8f22-4f98-9437-90ac0a33af79 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:25.799312 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1288/2560] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:30:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:30:25.803662 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc242297-620c-4da5-8af9-70a277fa108c admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:25.813966 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc242297-620c-4da5-8af9-70a277fa108c admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:25.818634 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90502b26-48ff-453b-bfd8-c562450ed453 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:25.819294 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90502b26-48ff-453b-bfd8-c562450ed453 admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:25.819577 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90502b26-48ff-453b-bfd8-c562450ed453 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:25.819853 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90502b26-48ff-453b-bfd8-c562450ed453 admin admin] PATH_INFO: `/v3/projects/2abc108af5ce4cc197941b2ce6e353d8/users/b38ef0ade2ad45c79825ef1810a40271/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:25.834435 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90502b26-48ff-453b-bfd8-c562450ed453 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2abc108af5ce4cc197941b2ce6e353d8, user_id=b38ef0ade2ad45c79825ef1810a40271, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:25.837520 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90502b26-48ff-453b-bfd8-c562450ed453 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:25.851193 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1273/2561] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:30:25 2022] PUT /identity/v3/projects/2abc108af5ce4cc197941b2ce6e353d8/users/b38ef0ade2ad45c79825ef1810a40271/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:30:25.862756 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d1399-bd4f-4725-b6dd-fd21c1576ca2 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:25.863116 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d1399-bd4f-4725-b6dd-fd21c1576ca2 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:25.863458 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b99d1399-bd4f-4725-b6dd-fd21c1576ca2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:25.892259 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-b99d1399-bd4f-4725-b6dd-fd21c1576ca2 None None] MFA Rules not processed for user `b38ef0ade2ad45c79825ef1810a40271`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:25.893485 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-b99d1399-bd4f-4725-b6dd-fd21c1576ca2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:25.956848 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1289/2562] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:30:25 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:30:25.969087 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90502b26-48ff-453b-bfd8-c562450ed453 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:25.970760 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-90502b26-48ff-453b-bfd8-c562450ed453 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:26.029686 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90502b26-48ff-453b-bfd8-c562450ed453 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:26.033615 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1076f974-77c7-49f9-9a99-003c46c228bc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:26.034225 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076f974-77c7-49f9-9a99-003c46c228bc service cinder] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:26.034505 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076f974-77c7-49f9-9a99-003c46c228bc service cinder] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:26.034781 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1076f974-77c7-49f9-9a99-003c46c228bc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:26.043093 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1076f974-77c7-49f9-9a99-003c46c228bc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:26.045743 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1076f974-77c7-49f9-9a99-003c46c228bc service cinder] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:26.054719 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1274/2563] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:30:25 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:30:26.074251 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d1399-bd4f-4725-b6dd-fd21c1576ca2 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:26.138205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b99d1399-bd4f-4725-b6dd-fd21c1576ca2 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:26.142652 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883396b-5da8-4adc-a947-9779ed1a5111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:26.143283 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883396b-5da8-4adc-a947-9779ed1a5111 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:26.143560 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883396b-5da8-4adc-a947-9779ed1a5111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:26.143829 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4883396b-5da8-4adc-a947-9779ed1a5111 admin admin] PATH_INFO: `/v3/users/b38ef0ade2ad45c79825ef1810a40271` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:26.145035 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4883396b-5da8-4adc-a947-9779ed1a5111 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b38ef0ade2ad45c79825ef1810a40271)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:26.146925 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4883396b-5da8-4adc-a947-9779ed1a5111 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:26.160057 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=96,keystone:INSERT=3,keystone:DELETE=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:26.198310 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-4883396b-5da8-4adc-a947-9779ed1a5111 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b38ef0ade2ad45c79825ef1810a40271'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:26.211508 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-4883396b-5da8-4adc-a947-9779ed1a5111 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b38ef0ade2ad45c79825ef1810a40271'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:26.212505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-4883396b-5da8-4adc-a947-9779ed1a5111 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b38ef0ade2ad45c79825ef1810a40271'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:26.213160 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-4883396b-5da8-4adc-a947-9779ed1a5111 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b38ef0ade2ad45c79825ef1810a40271'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:26.221750 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-4883396b-5da8-4adc-a947-9779ed1a5111 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b38ef0ade2ad45c79825ef1810a40271'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:26.235035 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1290/2564] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:30:26 2022] DELETE /identity/v3/users/b38ef0ade2ad45c79825ef1810a40271 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:30:26.239736 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6aebad-f890-48fa-b73f-1fe255cabeaf None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:26.240024 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6aebad-f890-48fa-b73f-1fe255cabeaf None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:26.240299 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6aebad-f890-48fa-b73f-1fe255cabeaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:26.258822 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-6d6aebad-f890-48fa-b73f-1fe255cabeaf None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:26.260400 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-6d6aebad-f890-48fa-b73f-1fe255cabeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:26.321647 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1275/2565] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:30:26.332000 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883396b-5da8-4adc-a947-9779ed1a5111 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:26.333429 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-4883396b-5da8-4adc-a947-9779ed1a5111 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:26.390419 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4883396b-5da8-4adc-a947-9779ed1a5111 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:26.393970 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20609589-f79d-4fe8-bd8f-510aa7352d98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:26.394585 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20609589-f79d-4fe8-bd8f-510aa7352d98 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:26.394863 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20609589-f79d-4fe8-bd8f-510aa7352d98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:26.395139 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20609589-f79d-4fe8-bd8f-510aa7352d98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:26.404847 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20609589-f79d-4fe8-bd8f-510aa7352d98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:26.406262 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20609589-f79d-4fe8-bd8f-510aa7352d98 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:26.415991 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1291/2566] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:30:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:30:26.689549 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6aebad-f890-48fa-b73f-1fe255cabeaf None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:26.690989 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-6d6aebad-f890-48fa-b73f-1fe255cabeaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:26.703781 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6aebad-f890-48fa-b73f-1fe255cabeaf None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:26.708300 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d038a78c-a944-4606-91ae-fef73502d222 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:26.708967 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038a78c-a944-4606-91ae-fef73502d222 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:26.709253 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038a78c-a944-4606-91ae-fef73502d222 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:26.709524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d038a78c-a944-4606-91ae-fef73502d222 admin admin] PATH_INFO: `/v3/projects/2abc108af5ce4cc197941b2ce6e353d8` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:26.710679 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d038a78c-a944-4606-91ae-fef73502d222 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2abc108af5ce4cc197941b2ce6e353d8)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:26.712902 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d038a78c-a944-4606-91ae-fef73502d222 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:26.750995 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:26.762283 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-d038a78c-a944-4606-91ae-fef73502d222 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2abc108af5ce4cc197941b2ce6e353d8', 'request_id': 'req-d038a78c-a944-4606-91ae-fef73502d222'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:26.768081 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-d038a78c-a944-4606-91ae-fef73502d222 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2abc108af5ce4cc197941b2ce6e353d8', 'request_id': 'req-d038a78c-a944-4606-91ae-fef73502d222'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:26.775301 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-d038a78c-a944-4606-91ae-fef73502d222 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2abc108af5ce4cc197941b2ce6e353d8', 'request_id': 'req-d038a78c-a944-4606-91ae-fef73502d222'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:26.787008 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-d038a78c-a944-4606-91ae-fef73502d222 admin admin] The token cache is being invalidate because project 2abc108af5ce4cc197941b2ce6e353d8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:30:26.787288 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-d038a78c-a944-4606-91ae-fef73502d222 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:26.787907 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-d038a78c-a944-4606-91ae-fef73502d222 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:26.789649 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1276/2567] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:30:26 2022] DELETE /identity/v3/projects/2abc108af5ce4cc197941b2ce6e353d8 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:30:26.796283 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2259b4-c653-48f4-b74a-788a2861f30d None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:26.797354 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2259b4-c653-48f4-b74a-788a2861f30d None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:26.797659 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2259b4-c653-48f4-b74a-788a2861f30d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:26.818174 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-1e2259b4-c653-48f4-b74a-788a2861f30d None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:26.819363 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-1e2259b4-c653-48f4-b74a-788a2861f30d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:26.880193 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1292/2568] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:30:26.888869 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc43789-d9d5-418b-b1df-feedc08c999d None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:26.889161 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc43789-d9d5-418b-b1df-feedc08c999d None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:26.889438 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc43789-d9d5-418b-b1df-feedc08c999d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:26.909470 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-3bc43789-d9d5-418b-b1df-feedc08c999d None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:26.910665 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-3bc43789-d9d5-418b-b1df-feedc08c999d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:26.918455 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1277/2569] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:30:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:30:26.922958 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2259b4-c653-48f4-b74a-788a2861f30d None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:26.932526 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2259b4-c653-48f4-b74a-788a2861f30d None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:26.937031 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a416d7d-dd07-481b-9e0d-acd055149c05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:26.937980 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a416d7d-dd07-481b-9e0d-acd055149c05 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:26.938269 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a416d7d-dd07-481b-9e0d-acd055149c05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:26.938539 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a416d7d-dd07-481b-9e0d-acd055149c05 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:26.939233 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a416d7d-dd07-481b-9e0d-acd055149c05 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:26.939534 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a416d7d-dd07-481b-9e0d-acd055149c05 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:26.941176 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a416d7d-dd07-481b-9e0d-acd055149c05 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:26.953771 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1293/2570] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:30:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:26.958040 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc43789-d9d5-418b-b1df-feedc08c999d None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:26.968353 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc43789-d9d5-418b-b1df-feedc08c999d None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:26.973100 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb3664-7a91-4d62-9ee3-57beb1658af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:26.973708 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb3664-7a91-4d62-9ee3-57beb1658af6 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:26.973992 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb3664-7a91-4d62-9ee3-57beb1658af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:26.974271 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98eb3664-7a91-4d62-9ee3-57beb1658af6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:26.974942 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb3664-7a91-4d62-9ee3-57beb1658af6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:26.976898 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98eb3664-7a91-4d62-9ee3-57beb1658af6 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:27.003719 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1278/2571] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:30:26 2022] POST /identity/v3/projects => generated 375 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:30:27.008064 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a416d7d-dd07-481b-9e0d-acd055149c05 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:27.018422 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a416d7d-dd07-481b-9e0d-acd055149c05 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:27.037441 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:27.077362 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d9119-d996-4ac1-abdd-0f2ba8628b93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:27.077986 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d9119-d996-4ac1-abdd-0f2ba8628b93 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:27.078270 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d9119-d996-4ac1-abdd-0f2ba8628b93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:27.078550 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d9119-d996-4ac1-abdd-0f2ba8628b93 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:27.079258 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d9119-d996-4ac1-abdd-0f2ba8628b93 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:27.081214 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d9119-d996-4ac1-abdd-0f2ba8628b93 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:27.102084 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1294/2572] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:30:27 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:30:27.106831 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb3664-7a91-4d62-9ee3-57beb1658af6 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:27.116962 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98eb3664-7a91-4d62-9ee3-57beb1658af6 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:27.122101 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ffca7-51d0-450e-8fde-35955b95d949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:27.122714 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ffca7-51d0-450e-8fde-35955b95d949 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:27.122995 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ffca7-51d0-450e-8fde-35955b95d949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:27.123270 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89ffca7-51d0-450e-8fde-35955b95d949 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:27.123961 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ffca7-51d0-450e-8fde-35955b95d949 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:27.125607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89ffca7-51d0-450e-8fde-35955b95d949 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:27.135788 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1279/2573] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:30:27.140766 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d9119-d996-4ac1-abdd-0f2ba8628b93 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:27.151669 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d9119-d996-4ac1-abdd-0f2ba8628b93 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:27.157526 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c372ae-7a82-49c7-8499-345fc8e635fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:27.158195 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c372ae-7a82-49c7-8499-345fc8e635fd admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:27.158505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c372ae-7a82-49c7-8499-345fc8e635fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:27.159112 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c372ae-7a82-49c7-8499-345fc8e635fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:27.160234 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c372ae-7a82-49c7-8499-345fc8e635fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:27.163394 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c372ae-7a82-49c7-8499-345fc8e635fd admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:27.174415 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1295/2574] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:30:27.178592 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ffca7-51d0-450e-8fde-35955b95d949 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:27.188824 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89ffca7-51d0-450e-8fde-35955b95d949 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:27.193346 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441a9ac-dd40-4ba8-96c1-73286466b6aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:27.193999 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441a9ac-dd40-4ba8-96c1-73286466b6aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:27.194285 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441a9ac-dd40-4ba8-96c1-73286466b6aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:27.194566 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0441a9ac-dd40-4ba8-96c1-73286466b6aa admin admin] PATH_INFO: `/v3/projects/16ee74f49e504ae3ac4fd1c9040340bc/users/8878190a865d482683f9bf323bb4a879/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:27.209395 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441a9ac-dd40-4ba8-96c1-73286466b6aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=16ee74f49e504ae3ac4fd1c9040340bc, user_id=8878190a865d482683f9bf323bb4a879, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:27.212346 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0441a9ac-dd40-4ba8-96c1-73286466b6aa admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:27.226438 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1280/2575] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:30:27 2022] PUT /identity/v3/projects/16ee74f49e504ae3ac4fd1c9040340bc/users/8878190a865d482683f9bf323bb4a879/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:30:27.237582 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a2824-7bc1-464b-b60a-4075b954359f None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:27.237874 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a2824-7bc1-464b-b60a-4075b954359f None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:27.238156 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c3a2824-7bc1-464b-b60a-4075b954359f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:27.265945 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-1c3a2824-7bc1-464b-b60a-4075b954359f None None] MFA Rules not processed for user `8878190a865d482683f9bf323bb4a879`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:27.267283 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-1c3a2824-7bc1-464b-b60a-4075b954359f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:27.335491 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1296/2576] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:30:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:30:27.348418 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441a9ac-dd40-4ba8-96c1-73286466b6aa admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:27.350280 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-0441a9ac-dd40-4ba8-96c1-73286466b6aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:27.415003 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0441a9ac-dd40-4ba8-96c1-73286466b6aa admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:27.419498 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c0b133-4b46-4927-a917-70d17455ef54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:27.420112 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0b133-4b46-4927-a917-70d17455ef54 service cinder] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:27.420424 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0b133-4b46-4927-a917-70d17455ef54 service cinder] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:27.420698 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c0b133-4b46-4927-a917-70d17455ef54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:27.428942 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0b133-4b46-4927-a917-70d17455ef54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:27.430372 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c0b133-4b46-4927-a917-70d17455ef54 service cinder] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:27.439289 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1281/2577] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:30:27 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:30:37.332688 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=56,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:37.435056 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:DELETE=5,keystone:SELECT=64,keystone:INSERT=3 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:58.690795 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a2824-7bc1-464b-b60a-4075b954359f None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:58.771783 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c3a2824-7bc1-464b-b60a-4075b954359f None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:58.776308 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92f4a4-0e71-44aa-85da-a3575ef8d441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:58.778073 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92f4a4-0e71-44aa-85da-a3575ef8d441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:58.778374 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92f4a4-0e71-44aa-85da-a3575ef8d441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:58.778631 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da92f4a4-0e71-44aa-85da-a3575ef8d441 admin admin] PATH_INFO: `/v3/users/8878190a865d482683f9bf323bb4a879` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:58.780446 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92f4a4-0e71-44aa-85da-a3575ef8d441 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8878190a865d482683f9bf323bb4a879)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:58.782412 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da92f4a4-0e71-44aa-85da-a3575ef8d441 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:58.830210 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-da92f4a4-0e71-44aa-85da-a3575ef8d441 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8878190a865d482683f9bf323bb4a879'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:58.843489 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-da92f4a4-0e71-44aa-85da-a3575ef8d441 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8878190a865d482683f9bf323bb4a879'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:58.844210 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-da92f4a4-0e71-44aa-85da-a3575ef8d441 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8878190a865d482683f9bf323bb4a879'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:58.844850 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-da92f4a4-0e71-44aa-85da-a3575ef8d441 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8878190a865d482683f9bf323bb4a879'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:58.852202 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-da92f4a4-0e71-44aa-85da-a3575ef8d441 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8878190a865d482683f9bf323bb4a879'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:58.864514 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1297/2578] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:30:58 2022] DELETE /identity/v3/users/8878190a865d482683f9bf323bb4a879 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:30:58.869146 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359abfff-1dec-4808-9346-52751c880487 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:58.869622 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359abfff-1dec-4808-9346-52751c880487 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:58.869728 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359abfff-1dec-4808-9346-52751c880487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:58.890108 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-359abfff-1dec-4808-9346-52751c880487 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:58.891294 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-359abfff-1dec-4808-9346-52751c880487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:58.948390 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1282/2579] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:30:58 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:30:58.958755 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92f4a4-0e71-44aa-85da-a3575ef8d441 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:58.960224 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-da92f4a4-0e71-44aa-85da-a3575ef8d441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:59.016903 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da92f4a4-0e71-44aa-85da-a3575ef8d441 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:59.020412 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe98941-7ebb-4073-ba80-4065b97a8e32 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:59.021024 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe98941-7ebb-4073-ba80-4065b97a8e32 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:59.021302 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe98941-7ebb-4073-ba80-4065b97a8e32 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:59.021575 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe98941-7ebb-4073-ba80-4065b97a8e32 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:59.030496 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe98941-7ebb-4073-ba80-4065b97a8e32 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:59.031896 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe98941-7ebb-4073-ba80-4065b97a8e32 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:59.041090 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1298/2580] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:30:58 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:30:59.307422 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359abfff-1dec-4808-9346-52751c880487 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:59.308905 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-359abfff-1dec-4808-9346-52751c880487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:59.321877 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359abfff-1dec-4808-9346-52751c880487 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:59.326520 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885cdc15-cef5-4c2d-a99e-76347ed20648 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:59.327300 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885cdc15-cef5-4c2d-a99e-76347ed20648 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:59.327578 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885cdc15-cef5-4c2d-a99e-76347ed20648 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:59.327848 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885cdc15-cef5-4c2d-a99e-76347ed20648 admin admin] PATH_INFO: `/v3/projects/16ee74f49e504ae3ac4fd1c9040340bc` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:59.329574 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885cdc15-cef5-4c2d-a99e-76347ed20648 admin admin] RBAC: Authorizing `identity:delete_project(project_id=16ee74f49e504ae3ac4fd1c9040340bc)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:59.330940 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885cdc15-cef5-4c2d-a99e-76347ed20648 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:59.378410 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-885cdc15-cef5-4c2d-a99e-76347ed20648 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '16ee74f49e504ae3ac4fd1c9040340bc', 'request_id': 'req-885cdc15-cef5-4c2d-a99e-76347ed20648'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:59.383810 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-885cdc15-cef5-4c2d-a99e-76347ed20648 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '16ee74f49e504ae3ac4fd1c9040340bc', 'request_id': 'req-885cdc15-cef5-4c2d-a99e-76347ed20648'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:59.391052 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-885cdc15-cef5-4c2d-a99e-76347ed20648 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '16ee74f49e504ae3ac4fd1c9040340bc', 'request_id': 'req-885cdc15-cef5-4c2d-a99e-76347ed20648'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:59.402830 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-885cdc15-cef5-4c2d-a99e-76347ed20648 admin admin] The token cache is being invalidate because project 16ee74f49e504ae3ac4fd1c9040340bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:30:59.403133 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-885cdc15-cef5-4c2d-a99e-76347ed20648 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:59.403736 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-885cdc15-cef5-4c2d-a99e-76347ed20648 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:30:59.405805 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1283/2581] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:30:59 2022] DELETE /identity/v3/projects/16ee74f49e504ae3ac4fd1c9040340bc => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:30:59.410643 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e4dfb-525b-4796-848b-b13f5c660467 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:59.410931 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e4dfb-525b-4796-848b-b13f5c660467 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:59.411210 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c56e4dfb-525b-4796-848b-b13f5c660467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:59.432135 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-c56e4dfb-525b-4796-848b-b13f5c660467 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:59.433621 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-c56e4dfb-525b-4796-848b-b13f5c660467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:59.450397 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:30:59.493162 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1299/2582] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:30:59.501507 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3bf83-b955-4867-b67f-2176657fd63b None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:59.501791 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3bf83-b955-4867-b67f-2176657fd63b None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:59.502066 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3bf83-b955-4867-b67f-2176657fd63b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:59.523124 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-8fb3bf83-b955-4867-b67f-2176657fd63b None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:59.524367 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-8fb3bf83-b955-4867-b67f-2176657fd63b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:59.532286 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1284/2583] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:30:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:30:59.536582 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e4dfb-525b-4796-848b-b13f5c660467 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:59.546173 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c56e4dfb-525b-4796-848b-b13f5c660467 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:59.550768 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8520c-31f2-458b-a2d4-acb321cd277a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:59.551315 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8520c-31f2-458b-a2d4-acb321cd277a admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:59.551592 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8520c-31f2-458b-a2d4-acb321cd277a admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:59.551862 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb8520c-31f2-458b-a2d4-acb321cd277a admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:59.552592 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb8520c-31f2-458b-a2d4-acb321cd277a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:30:59.552896 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb8520c-31f2-458b-a2d4-acb321cd277a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:59.554468 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cb8520c-31f2-458b-a2d4-acb321cd277a admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:59.566887 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1300/2584] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:30:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:30:59.571301 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3bf83-b955-4867-b67f-2176657fd63b None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:59.581211 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3bf83-b955-4867-b67f-2176657fd63b None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:59.585880 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b63c6a-b80d-40a4-b251-2f79c1e1ef13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:59.586490 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b63c6a-b80d-40a4-b251-2f79c1e1ef13 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:59.586761 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b63c6a-b80d-40a4-b251-2f79c1e1ef13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:59.587288 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b63c6a-b80d-40a4-b251-2f79c1e1ef13 admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:59.587947 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b63c6a-b80d-40a4-b251-2f79c1e1ef13 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:59.589864 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6b63c6a-b80d-40a4-b251-2f79c1e1ef13 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:59.617112 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1285/2585] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:30:59 2022] POST /identity/v3/projects => generated 373 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:30:59.621412 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8520c-31f2-458b-a2d4-acb321cd277a admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:59.633338 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb8520c-31f2-458b-a2d4-acb321cd277a admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:59.689294 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d65ec-9bcc-4cda-8424-1d51f2f0e0de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:59.689901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d65ec-9bcc-4cda-8424-1d51f2f0e0de admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:59.690188 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d65ec-9bcc-4cda-8424-1d51f2f0e0de admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:59.690459 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942d65ec-9bcc-4cda-8424-1d51f2f0e0de admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:59.691145 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942d65ec-9bcc-4cda-8424-1d51f2f0e0de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:59.693066 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942d65ec-9bcc-4cda-8424-1d51f2f0e0de admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:59.714646 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1301/2586] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:30:59 2022] POST /identity/v3/users => generated 287 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:30:59.719097 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b63c6a-b80d-40a4-b251-2f79c1e1ef13 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:59.731189 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6b63c6a-b80d-40a4-b251-2f79c1e1ef13 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:59.736529 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f862564-1545-4490-8bd9-405b5a1364f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:59.737134 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f862564-1545-4490-8bd9-405b5a1364f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:59.737419 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f862564-1545-4490-8bd9-405b5a1364f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:59.737697 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f862564-1545-4490-8bd9-405b5a1364f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:59.738389 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f862564-1545-4490-8bd9-405b5a1364f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:59.739975 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f862564-1545-4490-8bd9-405b5a1364f1 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:59.750435 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1286/2587] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:30:59.754279 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d65ec-9bcc-4cda-8424-1d51f2f0e0de admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:59.764618 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942d65ec-9bcc-4cda-8424-1d51f2f0e0de admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:59.769588 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0baef239-fa6c-4bc2-b460-290e243c78ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:59.770232 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baef239-fa6c-4bc2-b460-290e243c78ea admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:59.770515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baef239-fa6c-4bc2-b460-290e243c78ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:59.770798 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0baef239-fa6c-4bc2-b460-290e243c78ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:59.771489 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baef239-fa6c-4bc2-b460-290e243c78ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:59.773103 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0baef239-fa6c-4bc2-b460-290e243c78ea admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:59.783682 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1302/2588] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:30:59 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:30:59.788090 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f862564-1545-4490-8bd9-405b5a1364f1 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:59.798976 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f862564-1545-4490-8bd9-405b5a1364f1 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:30:59.803598 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87cdbba-10e7-40dd-ae3e-168901ff48f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:30:59.804186 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cdbba-10e7-40dd-ae3e-168901ff48f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:59.804832 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cdbba-10e7-40dd-ae3e-168901ff48f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:59.805107 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87cdbba-10e7-40dd-ae3e-168901ff48f0 admin admin] PATH_INFO: `/v3/projects/1821dd4b36114199a140bc630d9dbaaf/users/696f517e8cc54a9b866c33d2d8eead56/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:59.821110 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87cdbba-10e7-40dd-ae3e-168901ff48f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1821dd4b36114199a140bc630d9dbaaf, user_id=696f517e8cc54a9b866c33d2d8eead56, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:30:59.823762 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f87cdbba-10e7-40dd-ae3e-168901ff48f0 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:30:59.839591 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1287/2589] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:30:59 2022] PUT /identity/v3/projects/1821dd4b36114199a140bc630d9dbaaf/users/696f517e8cc54a9b866c33d2d8eead56/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:30:59.850238 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675652ae-04d7-49fb-82c7-b716abc10a18 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:30:59.850553 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675652ae-04d7-49fb-82c7-b716abc10a18 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:30:59.850832 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-675652ae-04d7-49fb-82c7-b716abc10a18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:30:59.880863 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-675652ae-04d7-49fb-82c7-b716abc10a18 None None] MFA Rules not processed for user `696f517e8cc54a9b866c33d2d8eead56`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:30:59.882215 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-675652ae-04d7-49fb-82c7-b716abc10a18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:59.949534 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1303/2590] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:30:59 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:30:59.962532 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87cdbba-10e7-40dd-ae3e-168901ff48f0 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:30:59.965083 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-f87cdbba-10e7-40dd-ae3e-168901ff48f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:30:59.991505 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:00.038553 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87cdbba-10e7-40dd-ae3e-168901ff48f0 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:00.042233 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a36d638-bf76-44ea-a6e1-8745f5d84843 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:00.042846 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36d638-bf76-44ea-a6e1-8745f5d84843 service cinder] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:00.043125 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36d638-bf76-44ea-a6e1-8745f5d84843 service cinder] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:00.043399 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a36d638-bf76-44ea-a6e1-8745f5d84843 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:00.052678 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a36d638-bf76-44ea-a6e1-8745f5d84843 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:00.054143 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a36d638-bf76-44ea-a6e1-8745f5d84843 service cinder] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:00.063919 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1288/2591] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:30:59 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:31:00.088717 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675652ae-04d7-49fb-82c7-b716abc10a18 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:00.109395 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:00.153031 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-675652ae-04d7-49fb-82c7-b716abc10a18 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:00.158263 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee6f080-a136-4e5c-84db-dbbec74055dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:00.158903 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6f080-a136-4e5c-84db-dbbec74055dd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:00.159187 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6f080-a136-4e5c-84db-dbbec74055dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:00.159465 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee6f080-a136-4e5c-84db-dbbec74055dd admin admin] PATH_INFO: `/v3/users/696f517e8cc54a9b866c33d2d8eead56` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:00.160686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee6f080-a136-4e5c-84db-dbbec74055dd admin admin] RBAC: Authorizing `identity:delete_user(user_id=696f517e8cc54a9b866c33d2d8eead56)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:00.162594 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee6f080-a136-4e5c-84db-dbbec74055dd admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:00.207072 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9ee6f080-a136-4e5c-84db-dbbec74055dd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '696f517e8cc54a9b866c33d2d8eead56'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:00.219572 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9ee6f080-a136-4e5c-84db-dbbec74055dd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '696f517e8cc54a9b866c33d2d8eead56'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:00.220227 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9ee6f080-a136-4e5c-84db-dbbec74055dd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '696f517e8cc54a9b866c33d2d8eead56'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:00.220866 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9ee6f080-a136-4e5c-84db-dbbec74055dd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '696f517e8cc54a9b866c33d2d8eead56'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:00.228228 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9ee6f080-a136-4e5c-84db-dbbec74055dd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '696f517e8cc54a9b866c33d2d8eead56'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:00.241647 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1304/2592] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:31:00 2022] DELETE /identity/v3/users/696f517e8cc54a9b866c33d2d8eead56 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:31:00.246253 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623aa99f-9dd7-41a3-ba4a-21d52d0158ce None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:00.246545 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623aa99f-9dd7-41a3-ba4a-21d52d0158ce None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:00.246828 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623aa99f-9dd7-41a3-ba4a-21d52d0158ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:00.265964 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-623aa99f-9dd7-41a3-ba4a-21d52d0158ce None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:00.267187 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-623aa99f-9dd7-41a3-ba4a-21d52d0158ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:00.326669 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1289/2593] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:31:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:31:00.336749 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee6f080-a136-4e5c-84db-dbbec74055dd admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:00.338396 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9ee6f080-a136-4e5c-84db-dbbec74055dd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:00.394741 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee6f080-a136-4e5c-84db-dbbec74055dd admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:00.398368 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a581a32-4f73-406e-ae06-cd64580f005b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:00.398980 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a581a32-4f73-406e-ae06-cd64580f005b service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:00.399260 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a581a32-4f73-406e-ae06-cd64580f005b service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:00.399535 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a581a32-4f73-406e-ae06-cd64580f005b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:00.408967 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a581a32-4f73-406e-ae06-cd64580f005b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:00.410384 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a581a32-4f73-406e-ae06-cd64580f005b service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:00.419602 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1305/2594] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:31:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:31:00.686298 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623aa99f-9dd7-41a3-ba4a-21d52d0158ce None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:00.687994 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-623aa99f-9dd7-41a3-ba4a-21d52d0158ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:00.702842 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623aa99f-9dd7-41a3-ba4a-21d52d0158ce None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:00.707888 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8473320c-fb46-4916-b984-e33a50ba969a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:00.708579 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473320c-fb46-4916-b984-e33a50ba969a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:00.708857 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473320c-fb46-4916-b984-e33a50ba969a admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:00.709127 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8473320c-fb46-4916-b984-e33a50ba969a admin admin] PATH_INFO: `/v3/projects/1821dd4b36114199a140bc630d9dbaaf` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:00.710313 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473320c-fb46-4916-b984-e33a50ba969a admin admin] RBAC: Authorizing `identity:delete_project(project_id=1821dd4b36114199a140bc630d9dbaaf)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:00.712519 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8473320c-fb46-4916-b984-e33a50ba969a admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:00.759971 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-8473320c-fb46-4916-b984-e33a50ba969a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1821dd4b36114199a140bc630d9dbaaf', 'request_id': 'req-8473320c-fb46-4916-b984-e33a50ba969a'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:00.766316 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-8473320c-fb46-4916-b984-e33a50ba969a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1821dd4b36114199a140bc630d9dbaaf', 'request_id': 'req-8473320c-fb46-4916-b984-e33a50ba969a'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:00.773306 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-8473320c-fb46-4916-b984-e33a50ba969a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1821dd4b36114199a140bc630d9dbaaf', 'request_id': 'req-8473320c-fb46-4916-b984-e33a50ba969a'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:00.784846 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-8473320c-fb46-4916-b984-e33a50ba969a admin admin] The token cache is being invalidate because project 1821dd4b36114199a140bc630d9dbaaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:31:00.785132 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-8473320c-fb46-4916-b984-e33a50ba969a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:00.785774 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-8473320c-fb46-4916-b984-e33a50ba969a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:00.787471 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1290/2595] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:31:00 2022] DELETE /identity/v3/projects/1821dd4b36114199a140bc630d9dbaaf => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:31:00.792218 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2cba7-5e02-4655-99e3-0576546c4fd6 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:00.792756 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2cba7-5e02-4655-99e3-0576546c4fd6 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:00.792879 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19d2cba7-5e02-4655-99e3-0576546c4fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:00.812474 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-19d2cba7-5e02-4655-99e3-0576546c4fd6 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:00.813680 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-19d2cba7-5e02-4655-99e3-0576546c4fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:00.847950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:00.874884 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1306/2596] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:31:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:31:00.883887 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb6a3f-945e-4600-bfaf-8cbc3314c2c8 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:00.884176 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb6a3f-945e-4600-bfaf-8cbc3314c2c8 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:00.884491 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3beb6a3f-945e-4600-bfaf-8cbc3314c2c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:00.905041 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-3beb6a3f-945e-4600-bfaf-8cbc3314c2c8 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:00.906397 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-3beb6a3f-945e-4600-bfaf-8cbc3314c2c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:00.915168 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1291/2597] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:31:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:31:00.919562 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d2cba7-5e02-4655-99e3-0576546c4fd6 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:00.929966 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19d2cba7-5e02-4655-99e3-0576546c4fd6 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:00.934640 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb08ef6-68d1-4053-97eb-aa870f3d50a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:00.935254 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb08ef6-68d1-4053-97eb-aa870f3d50a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:00.935533 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb08ef6-68d1-4053-97eb-aa870f3d50a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:00.935805 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb08ef6-68d1-4053-97eb-aa870f3d50a2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:00.937543 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb08ef6-68d1-4053-97eb-aa870f3d50a2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:00.937853 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb08ef6-68d1-4053-97eb-aa870f3d50a2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:00.939436 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cb08ef6-68d1-4053-97eb-aa870f3d50a2 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:00.950908 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1307/2598] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:31:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:00.955844 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb6a3f-945e-4600-bfaf-8cbc3314c2c8 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:00.965376 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3beb6a3f-945e-4600-bfaf-8cbc3314c2c8 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:00.970116 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b348707-ed03-4d6a-b127-8c2a4a0ae705 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:00.970715 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b348707-ed03-4d6a-b127-8c2a4a0ae705 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:00.970996 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b348707-ed03-4d6a-b127-8c2a4a0ae705 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:00.971270 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b348707-ed03-4d6a-b127-8c2a4a0ae705 admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:00.971923 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b348707-ed03-4d6a-b127-8c2a4a0ae705 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:00.973847 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b348707-ed03-4d6a-b127-8c2a4a0ae705 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:01.001245 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1292/2599] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:31:00 2022] POST /identity/v3/projects => generated 391 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:31:01.005263 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb08ef6-68d1-4053-97eb-aa870f3d50a2 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:01.015768 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb08ef6-68d1-4053-97eb-aa870f3d50a2 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:01.072928 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74a6c6-ba9c-424f-b1bd-ed337c91c7c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:01.073547 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74a6c6-ba9c-424f-b1bd-ed337c91c7c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:01.073832 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74a6c6-ba9c-424f-b1bd-ed337c91c7c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:01.074106 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d74a6c6-ba9c-424f-b1bd-ed337c91c7c0 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:01.074768 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d74a6c6-ba9c-424f-b1bd-ed337c91c7c0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:01.077275 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d74a6c6-ba9c-424f-b1bd-ed337c91c7c0 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:01.098614 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1308/2600] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:31:01 2022] POST /identity/v3/users => generated 296 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:31:01.102749 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b348707-ed03-4d6a-b127-8c2a4a0ae705 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:01.112896 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b348707-ed03-4d6a-b127-8c2a4a0ae705 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:01.117418 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8c9f6-58a8-4326-903c-24d5d8643c10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:01.118023 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8c9f6-58a8-4326-903c-24d5d8643c10 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:01.118302 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8c9f6-58a8-4326-903c-24d5d8643c10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:01.118575 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba8c9f6-58a8-4326-903c-24d5d8643c10 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:01.119261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba8c9f6-58a8-4326-903c-24d5d8643c10 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:01.120878 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba8c9f6-58a8-4326-903c-24d5d8643c10 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:01.132070 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1293/2601] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:31:01.135849 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74a6c6-ba9c-424f-b1bd-ed337c91c7c0 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:01.146694 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d74a6c6-ba9c-424f-b1bd-ed337c91c7c0 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:01.151270 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f26762-a176-45d7-b370-7dea66d701c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:01.151874 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f26762-a176-45d7-b370-7dea66d701c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:01.152156 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f26762-a176-45d7-b370-7dea66d701c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:01.152461 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f26762-a176-45d7-b370-7dea66d701c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:01.153149 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f26762-a176-45d7-b370-7dea66d701c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:01.154733 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1f26762-a176-45d7-b370-7dea66d701c8 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:01.167020 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1309/2602] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:31:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:31:01.171574 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8c9f6-58a8-4326-903c-24d5d8643c10 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:01.182426 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba8c9f6-58a8-4326-903c-24d5d8643c10 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:01.188403 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777de87-f3bb-483c-b5d6-c097fb604ba0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:01.189059 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777de87-f3bb-483c-b5d6-c097fb604ba0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:01.189362 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777de87-f3bb-483c-b5d6-c097fb604ba0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:01.189633 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4777de87-f3bb-483c-b5d6-c097fb604ba0 admin admin] PATH_INFO: `/v3/projects/3a0bbd0e2f9f40f99447971ac2de8963/users/8cb9dc8d442847aaadafdcd5508323cf/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:01.191958 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:01.208180 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4777de87-f3bb-483c-b5d6-c097fb604ba0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3a0bbd0e2f9f40f99447971ac2de8963, user_id=8cb9dc8d442847aaadafdcd5508323cf, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:01.210851 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4777de87-f3bb-483c-b5d6-c097fb604ba0 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:01.224845 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1294/2603] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:31:01 2022] PUT /identity/v3/projects/3a0bbd0e2f9f40f99447971ac2de8963/users/8cb9dc8d442847aaadafdcd5508323cf/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:31:01.235798 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc37ea-8d59-43a6-a7dd-734e53f069ae None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:01.236082 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc37ea-8d59-43a6-a7dd-734e53f069ae None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:01.236378 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cc37ea-8d59-43a6-a7dd-734e53f069ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:01.265036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-94cc37ea-8d59-43a6-a7dd-734e53f069ae None None] MFA Rules not processed for user `8cb9dc8d442847aaadafdcd5508323cf`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:01.266229 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-94cc37ea-8d59-43a6-a7dd-734e53f069ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:01.329137 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1310/2604] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:31:01 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:31:01.339963 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777de87-f3bb-483c-b5d6-c097fb604ba0 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:01.341666 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-4777de87-f3bb-483c-b5d6-c097fb604ba0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:01.397722 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4777de87-f3bb-483c-b5d6-c097fb604ba0 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:01.401291 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a0bcf-83f6-41f1-b771-152ef55e0df9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:01.401902 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a0bcf-83f6-41f1-b771-152ef55e0df9 service cinder] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:01.402185 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a0bcf-83f6-41f1-b771-152ef55e0df9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:01.402460 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a7a0bcf-83f6-41f1-b771-152ef55e0df9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:01.410673 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7a0bcf-83f6-41f1-b771-152ef55e0df9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:01.412105 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a7a0bcf-83f6-41f1-b771-152ef55e0df9 service cinder] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:01.421389 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1295/2605] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:31:01 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:31:11.325628 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=81,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:11.416915 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=33,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:17.076018 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc37ea-8d59-43a6-a7dd-734e53f069ae None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:17.077552 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-94cc37ea-8d59-43a6-a7dd-734e53f069ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:17.090614 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cc37ea-8d59-43a6-a7dd-734e53f069ae None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:17.094072 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b4d99-a0d6-415f-8c80-d020e942880f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:17.095327 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b4d99-a0d6-415f-8c80-d020e942880f service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:17.095610 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b4d99-a0d6-415f-8c80-d020e942880f service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:17.095883 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b0b4d99-a0d6-415f-8c80-d020e942880f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:17.097857 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-3b0b4d99-a0d6-415f-8c80-d020e942880f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:17.176480 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b4d99-a0d6-415f-8c80-d020e942880f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:17.177915 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b0b4d99-a0d6-415f-8c80-d020e942880f service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:17.197205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1311/2606] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:31:17 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:31:26.753375 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a0bcf-83f6-41f1-b771-152ef55e0df9 service cinder] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:26.754875 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-4a7a0bcf-83f6-41f1-b771-152ef55e0df9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:26.821049 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a7a0bcf-83f6-41f1-b771-152ef55e0df9 service cinder] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:26.826744 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76eaf1-6c48-4f40-97a9-b85a2850d87d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:26.827916 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76eaf1-6c48-4f40-97a9-b85a2850d87d service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:26.828059 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76eaf1-6c48-4f40-97a9-b85a2850d87d service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:26.833905 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e76eaf1-6c48-4f40-97a9-b85a2850d87d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:26.833905 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-6e76eaf1-6c48-4f40-97a9-b85a2850d87d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:26.848945 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76eaf1-6c48-4f40-97a9-b85a2850d87d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:26.851148 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e76eaf1-6c48-4f40-97a9-b85a2850d87d service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:26.862702 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1296/2607] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:31:26 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:31:26.933074 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b4d99-a0d6-415f-8c80-d020e942880f service cinder] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:27.007374 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b0b4d99-a0d6-415f-8c80-d020e942880f service cinder] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:27.014298 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd63564-936f-4de3-8f72-9909fdafe2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:27.015457 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd63564-936f-4de3-8f72-9909fdafe2b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:27.015457 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd63564-936f-4de3-8f72-9909fdafe2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:27.015705 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd63564-936f-4de3-8f72-9909fdafe2b2 admin admin] PATH_INFO: `/v3/users/8cb9dc8d442847aaadafdcd5508323cf` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:27.016837 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd63564-936f-4de3-8f72-9909fdafe2b2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8cb9dc8d442847aaadafdcd5508323cf)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:27.018770 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dd63564-936f-4de3-8f72-9909fdafe2b2 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:27.076965 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-7dd63564-936f-4de3-8f72-9909fdafe2b2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8cb9dc8d442847aaadafdcd5508323cf'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:27.098561 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-7dd63564-936f-4de3-8f72-9909fdafe2b2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8cb9dc8d442847aaadafdcd5508323cf'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:27.099536 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-7dd63564-936f-4de3-8f72-9909fdafe2b2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8cb9dc8d442847aaadafdcd5508323cf'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:27.100372 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-7dd63564-936f-4de3-8f72-9909fdafe2b2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8cb9dc8d442847aaadafdcd5508323cf'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:27.109440 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-7dd63564-936f-4de3-8f72-9909fdafe2b2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8cb9dc8d442847aaadafdcd5508323cf'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:27.111141 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:27.116538 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76eaf1-6c48-4f40-97a9-b85a2850d87d service neutron] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:27.118164 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-6e76eaf1-6c48-4f40-97a9-b85a2850d87d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:27.129413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1312/2608] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:31:26 2022] DELETE /identity/v3/users/8cb9dc8d442847aaadafdcd5508323cf => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:31:27.133841 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38655ad5-c013-463d-b1e8-b9a5832731ba None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:27.134855 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38655ad5-c013-463d-b1e8-b9a5832731ba None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:27.135748 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38655ad5-c013-463d-b1e8-b9a5832731ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:27.136032 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e76eaf1-6c48-4f40-97a9-b85a2850d87d service neutron] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:27.160268 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-38655ad5-c013-463d-b1e8-b9a5832731ba None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:27.161608 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-38655ad5-c013-463d-b1e8-b9a5832731ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:27.207033 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c3077-b12f-4e0b-ac33-798298c0f334 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:27.207706 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c3077-b12f-4e0b-ac33-798298c0f334 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:27.207994 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c3077-b12f-4e0b-ac33-798298c0f334 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:27.208269 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c3077-b12f-4e0b-ac33-798298c0f334 admin admin] PATH_INFO: `/v3/users/bf4c0ebf69394f49abfb31e297dafccf` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:27.209574 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c3077-b12f-4e0b-ac33-798298c0f334 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bf4c0ebf69394f49abfb31e297dafccf)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:27.211502 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e6c3077-b12f-4e0b-ac33-798298c0f334 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:27.227829 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1313/2609] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:31:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:31:27.239341 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38655ad5-c013-463d-b1e8-b9a5832731ba None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:27.240749 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-38655ad5-c013-463d-b1e8-b9a5832731ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:27.264786 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-5e6c3077-b12f-4e0b-ac33-798298c0f334 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bf4c0ebf69394f49abfb31e297dafccf'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:27.277543 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-5e6c3077-b12f-4e0b-ac33-798298c0f334 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bf4c0ebf69394f49abfb31e297dafccf'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:27.278226 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-5e6c3077-b12f-4e0b-ac33-798298c0f334 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bf4c0ebf69394f49abfb31e297dafccf'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:27.278854 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-5e6c3077-b12f-4e0b-ac33-798298c0f334 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bf4c0ebf69394f49abfb31e297dafccf'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:27.286642 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-5e6c3077-b12f-4e0b-ac33-798298c0f334 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bf4c0ebf69394f49abfb31e297dafccf'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:27.299890 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1297/2610] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:31:27 2022] DELETE /identity/v3/users/bf4c0ebf69394f49abfb31e297dafccf => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:31:27.300572 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38655ad5-c013-463d-b1e8-b9a5832731ba None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:27.351358 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d352706-d8df-4bc9-b1f5-d498dc8ccec1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:27.351978 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d352706-d8df-4bc9-b1f5-d498dc8ccec1 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:27.352258 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d352706-d8df-4bc9-b1f5-d498dc8ccec1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:27.352575 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d352706-d8df-4bc9-b1f5-d498dc8ccec1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:27.354364 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-7d352706-d8df-4bc9-b1f5-d498dc8ccec1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:27.416986 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:27.420096 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d352706-d8df-4bc9-b1f5-d498dc8ccec1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:27.421962 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d352706-d8df-4bc9-b1f5-d498dc8ccec1 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:27.435085 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1314/2611] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:31:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:31:27.729613 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c3077-b12f-4e0b-ac33-798298c0f334 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:27.731165 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-5e6c3077-b12f-4e0b-ac33-798298c0f334 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:27.744420 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e6c3077-b12f-4e0b-ac33-798298c0f334 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:27.749244 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a078f18-7e90-45db-99c4-24a812918f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:27.749894 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a078f18-7e90-45db-99c4-24a812918f6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:27.750178 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a078f18-7e90-45db-99c4-24a812918f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:27.750457 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a078f18-7e90-45db-99c4-24a812918f6f admin admin] PATH_INFO: `/v3/projects/8aeb435284914740b100d506c74bad6b` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:27.752453 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a078f18-7e90-45db-99c4-24a812918f6f admin admin] RBAC: Authorizing `identity:delete_project(project_id=8aeb435284914740b100d506c74bad6b)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:27.754403 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a078f18-7e90-45db-99c4-24a812918f6f admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:27.779903 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:27.849494 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-8a078f18-7e90-45db-99c4-24a812918f6f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8aeb435284914740b100d506c74bad6b', 'request_id': 'req-8a078f18-7e90-45db-99c4-24a812918f6f'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:27.859302 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-8a078f18-7e90-45db-99c4-24a812918f6f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8aeb435284914740b100d506c74bad6b', 'request_id': 'req-8a078f18-7e90-45db-99c4-24a812918f6f'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:27.867875 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-8a078f18-7e90-45db-99c4-24a812918f6f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8aeb435284914740b100d506c74bad6b', 'request_id': 'req-8a078f18-7e90-45db-99c4-24a812918f6f'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:27.877897 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d352706-d8df-4bc9-b1f5-d498dc8ccec1 service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:27.880451 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-7d352706-d8df-4bc9-b1f5-d498dc8ccec1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:27.880610 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-8a078f18-7e90-45db-99c4-24a812918f6f admin admin] The token cache is being invalidate because project 8aeb435284914740b100d506c74bad6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:31:27.880862 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-8a078f18-7e90-45db-99c4-24a812918f6f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:27.881539 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-8a078f18-7e90-45db-99c4-24a812918f6f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:27.883353 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1298/2612] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:31:27 2022] DELETE /identity/v3/projects/8aeb435284914740b100d506c74bad6b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:31:27.897205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d352706-d8df-4bc9-b1f5-d498dc8ccec1 service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:27.901674 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556e550-f58b-4f88-b980-788c11102576 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:27.902046 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556e550-f58b-4f88-b980-788c11102576 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:27.902393 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7556e550-f58b-4f88-b980-788c11102576 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:27.926023 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-7556e550-f58b-4f88-b980-788c11102576 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:27.927273 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-7556e550-f58b-4f88-b980-788c11102576 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:27.975821 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31600e-b9ad-4e03-8e2c-58cd845c668d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:27.976607 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31600e-b9ad-4e03-8e2c-58cd845c668d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:27.976978 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31600e-b9ad-4e03-8e2c-58cd845c668d admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:27.977328 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc31600e-b9ad-4e03-8e2c-58cd845c668d admin admin] PATH_INFO: `/v3/projects/3a0bbd0e2f9f40f99447971ac2de8963` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:27.978557 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc31600e-b9ad-4e03-8e2c-58cd845c668d admin admin] RBAC: Authorizing `identity:delete_project(project_id=3a0bbd0e2f9f40f99447971ac2de8963)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:27.981823 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc31600e-b9ad-4e03-8e2c-58cd845c668d admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:28.007206 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1299/2613] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:31:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:31:28.014732 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a136bd-7f41-4beb-9b7e-6f659d25d38f None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:28.015017 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a136bd-7f41-4beb-9b7e-6f659d25d38f None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:28.015295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1a136bd-7f41-4beb-9b7e-6f659d25d38f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:28.039061 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-a1a136bd-7f41-4beb-9b7e-6f659d25d38f None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:28.040638 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-a1a136bd-7f41-4beb-9b7e-6f659d25d38f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:28.054032 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1300/2614] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:31:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:31:28.058581 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a136bd-7f41-4beb-9b7e-6f659d25d38f None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:28.069836 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1a136bd-7f41-4beb-9b7e-6f659d25d38f None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:28.075110 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8285f5-f99a-4834-953b-191fdcb5efcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:28.076147 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8285f5-f99a-4834-953b-191fdcb5efcf admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:28.076640 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8285f5-f99a-4834-953b-191fdcb5efcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:28.077094 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8285f5-f99a-4834-953b-191fdcb5efcf admin admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:28.078150 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8285f5-f99a-4834-953b-191fdcb5efcf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:28.078790 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8285f5-f99a-4834-953b-191fdcb5efcf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:28.081138 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e8285f5-f99a-4834-953b-191fdcb5efcf admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:28.102227 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1301/2615] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:31:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:28.103687 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8285f5-f99a-4834-953b-191fdcb5efcf admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:28.115254 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8285f5-f99a-4834-953b-191fdcb5efcf admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:28.120778 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bcf286-198b-4ca5-93cd-15af7d4a1831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:28.121328 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bcf286-198b-4ca5-93cd-15af7d4a1831 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:28.121606 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bcf286-198b-4ca5-93cd-15af7d4a1831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:28.121865 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bcf286-198b-4ca5-93cd-15af7d4a1831 admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:28.122891 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bcf286-198b-4ca5-93cd-15af7d4a1831 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:28.124903 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63bcf286-198b-4ca5-93cd-15af7d4a1831 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:28.159543 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1302/2616] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:31:28 2022] POST /identity/v3/projects => generated 399 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:31:28.164012 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bcf286-198b-4ca5-93cd-15af7d4a1831 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:28.219765 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-dc31600e-b9ad-4e03-8e2c-58cd845c668d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3a0bbd0e2f9f40f99447971ac2de8963', 'request_id': 'req-dc31600e-b9ad-4e03-8e2c-58cd845c668d'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:28.226562 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-dc31600e-b9ad-4e03-8e2c-58cd845c668d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3a0bbd0e2f9f40f99447971ac2de8963', 'request_id': 'req-dc31600e-b9ad-4e03-8e2c-58cd845c668d'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:28.236480 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-dc31600e-b9ad-4e03-8e2c-58cd845c668d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3a0bbd0e2f9f40f99447971ac2de8963', 'request_id': 'req-dc31600e-b9ad-4e03-8e2c-58cd845c668d'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:28.240436 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bcf286-198b-4ca5-93cd-15af7d4a1831 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:28.248953 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-dc31600e-b9ad-4e03-8e2c-58cd845c668d admin admin] The token cache is being invalidate because project 3a0bbd0e2f9f40f99447971ac2de8963 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:31:28.249241 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-dc31600e-b9ad-4e03-8e2c-58cd845c668d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:28.249896 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-dc31600e-b9ad-4e03-8e2c-58cd845c668d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:28.250485 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:28.252629 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1315/2617] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:31:27 2022] DELETE /identity/v3/projects/3a0bbd0e2f9f40f99447971ac2de8963 => generated 0 bytes in 377 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:31:28.323419 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48908dc-0e7f-47e0-af22-c281b6086a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:28.324705 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48908dc-0e7f-47e0-af22-c281b6086a14 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:28.325213 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48908dc-0e7f-47e0-af22-c281b6086a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:28.325731 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c48908dc-0e7f-47e0-af22-c281b6086a14 admin admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:28.326700 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48908dc-0e7f-47e0-af22-c281b6086a14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:28.329783 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c48908dc-0e7f-47e0-af22-c281b6086a14 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:28.355767 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1303/2618] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:31:28 2022] POST /identity/v3/users => generated 300 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:31:28.359786 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31600e-b9ad-4e03-8e2c-58cd845c668d admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:28.362191 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-dc31600e-b9ad-4e03-8e2c-58cd845c668d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:28.375713 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc31600e-b9ad-4e03-8e2c-58cd845c668d admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:28.380637 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a71ce-c1e4-42a1-bddb-09a56f844d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:28.381278 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a71ce-c1e4-42a1-bddb-09a56f844d93 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:28.381627 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a71ce-c1e4-42a1-bddb-09a56f844d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:28.381899 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-479a71ce-c1e4-42a1-bddb-09a56f844d93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:28.382815 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a71ce-c1e4-42a1-bddb-09a56f844d93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:28.384477 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-479a71ce-c1e4-42a1-bddb-09a56f844d93 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:28.401131 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1316/2619] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:31:28.402721 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48908dc-0e7f-47e0-af22-c281b6086a14 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:28.419883 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c48908dc-0e7f-47e0-af22-c281b6086a14 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:28.427859 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53fabe5e-7373-4c26-80f5-ebfd9bd76f6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:28.428627 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fabe5e-7373-4c26-80f5-ebfd9bd76f6f admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:28.428937 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fabe5e-7373-4c26-80f5-ebfd9bd76f6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:28.429182 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53fabe5e-7373-4c26-80f5-ebfd9bd76f6f admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:28.429899 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fabe5e-7373-4c26-80f5-ebfd9bd76f6f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:28.431527 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53fabe5e-7373-4c26-80f5-ebfd9bd76f6f admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:28.447194 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1304/2620] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:31:28 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:31:28.448492 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a71ce-c1e4-42a1-bddb-09a56f844d93 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:28.459890 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-479a71ce-c1e4-42a1-bddb-09a56f844d93 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:28.465335 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b3d73-62a0-4a84-acbb-d328097919b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:28.466196 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b3d73-62a0-4a84-acbb-d328097919b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:28.466473 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b3d73-62a0-4a84-acbb-d328097919b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:28.466744 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3b3d73-62a0-4a84-acbb-d328097919b0 admin admin] PATH_INFO: `/v3/projects/dc7a3ac6680043ea942a14550cdc6ff1/users/d279d78cb6d349938d263ab442f52ca8/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:28.484537 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b3d73-62a0-4a84-acbb-d328097919b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc7a3ac6680043ea942a14550cdc6ff1, user_id=d279d78cb6d349938d263ab442f52ca8, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:28.487366 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3b3d73-62a0-4a84-acbb-d328097919b0 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:28.503013 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1317/2621] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:31:28 2022] PUT /identity/v3/projects/dc7a3ac6680043ea942a14550cdc6ff1/users/d279d78cb6d349938d263ab442f52ca8/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:31:28.513277 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd923cb-f837-4ec1-bff4-bd1597722c39 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:28.513518 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd923cb-f837-4ec1-bff4-bd1597722c39 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:28.513813 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd923cb-f837-4ec1-bff4-bd1597722c39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:28.543778 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-5cd923cb-f837-4ec1-bff4-bd1597722c39 None None] MFA Rules not processed for user `d279d78cb6d349938d263ab442f52ca8`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:28.545025 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-5cd923cb-f837-4ec1-bff4-bd1597722c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:28.614476 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1305/2622] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:31:28 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:31:28.625742 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b3d73-62a0-4a84-acbb-d328097919b0 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:28.627957 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-cb3b3d73-62a0-4a84-acbb-d328097919b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:28.699757 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3b3d73-62a0-4a84-acbb-d328097919b0 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:28.703318 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a040326-dce7-40c7-a5a0-6106f8a38267 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:28.703966 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a040326-dce7-40c7-a5a0-6106f8a38267 service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:28.704942 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a040326-dce7-40c7-a5a0-6106f8a38267 service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:28.705223 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a040326-dce7-40c7-a5a0-6106f8a38267 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:28.710848 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:28.715970 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a040326-dce7-40c7-a5a0-6106f8a38267 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:28.717854 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a040326-dce7-40c7-a5a0-6106f8a38267 service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:28.728793 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1318/2623] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:31:28 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:31:28.935537 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd923cb-f837-4ec1-bff4-bd1597722c39 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:28.937851 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-5cd923cb-f837-4ec1-bff4-bd1597722c39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:29.044071 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd923cb-f837-4ec1-bff4-bd1597722c39 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:29.051449 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b94c2a-5dda-4e36-be6c-4e7a0e43f480 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:29.053210 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b94c2a-5dda-4e36-be6c-4e7a0e43f480 service nova] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:29.053210 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b94c2a-5dda-4e36-be6c-4e7a0e43f480 service nova] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:29.053210 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b94c2a-5dda-4e36-be6c-4e7a0e43f480 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:29.055032 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-26b94c2a-5dda-4e36-be6c-4e7a0e43f480 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:29.072567 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b94c2a-5dda-4e36-be6c-4e7a0e43f480 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:29.074508 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b94c2a-5dda-4e36-be6c-4e7a0e43f480 service nova] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:29.091666 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1306/2624] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:31:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:31:32.194384 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a040326-dce7-40c7-a5a0-6106f8a38267 service cinder] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:32.196267 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-5a040326-dce7-40c7-a5a0-6106f8a38267 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:32.274017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a040326-dce7-40c7-a5a0-6106f8a38267 service cinder] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:32.278932 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd331b-5762-4b7b-9270-b5302cb03595 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e84ea976b5914aea94c4d8f805139daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:32.279527 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd331b-5762-4b7b-9270-b5302cb03595 service placement] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:32.279806 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd331b-5762-4b7b-9270-b5302cb03595 service placement] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:32.280081 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59dd331b-5762-4b7b-9270-b5302cb03595 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:32.281848 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-59dd331b-5762-4b7b-9270-b5302cb03595 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:32.293509 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd331b-5762-4b7b-9270-b5302cb03595 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:32.294986 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59dd331b-5762-4b7b-9270-b5302cb03595 service placement] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:32.306417 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1319/2625] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:31:32 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:31:37.974155 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b94c2a-5dda-4e36-be6c-4e7a0e43f480 service nova] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:37.975668 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-26b94c2a-5dda-4e36-be6c-4e7a0e43f480 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:37.979435 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd331b-5762-4b7b-9270-b5302cb03595 service placement] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:37.981603 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:38.040070 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b94c2a-5dda-4e36-be6c-4e7a0e43f480 service nova] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:38.046357 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96dc59b-44e3-4d1f-8791-f32e3aa0c708 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:38.046984 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96dc59b-44e3-4d1f-8791-f32e3aa0c708 service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:38.047262 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96dc59b-44e3-4d1f-8791-f32e3aa0c708 service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:38.047536 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96dc59b-44e3-4d1f-8791-f32e3aa0c708 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:38.049463 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-e96dc59b-44e3-4d1f-8791-f32e3aa0c708 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:38.052713 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59dd331b-5762-4b7b-9270-b5302cb03595 service placement] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:38.057161 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722cf49b-23da-4e76-99b8-9faa3c10b703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:38.057882 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cf49b-23da-4e76-99b8-9faa3c10b703 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:38.058232 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cf49b-23da-4e76-99b8-9faa3c10b703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:38.058580 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722cf49b-23da-4e76-99b8-9faa3c10b703 admin admin] PATH_INFO: `/v3/users/d279d78cb6d349938d263ab442f52ca8` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:38.059928 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722cf49b-23da-4e76-99b8-9faa3c10b703 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d279d78cb6d349938d263ab442f52ca8)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:38.061834 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96dc59b-44e3-4d1f-8791-f32e3aa0c708 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:38.062066 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722cf49b-23da-4e76-99b8-9faa3c10b703 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:38.063295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96dc59b-44e3-4d1f-8791-f32e3aa0c708 service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:38.075302 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1307/2626] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:31:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:31:38.126383 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-722cf49b-23da-4e76-99b8-9faa3c10b703 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd279d78cb6d349938d263ab442f52ca8'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:38.142435 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-722cf49b-23da-4e76-99b8-9faa3c10b703 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd279d78cb6d349938d263ab442f52ca8'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:38.143195 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-722cf49b-23da-4e76-99b8-9faa3c10b703 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd279d78cb6d349938d263ab442f52ca8'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:38.143811 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-722cf49b-23da-4e76-99b8-9faa3c10b703 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd279d78cb6d349938d263ab442f52ca8'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:38.153249 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-722cf49b-23da-4e76-99b8-9faa3c10b703 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd279d78cb6d349938d263ab442f52ca8'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:38.174307 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1320/2627] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:31:37 2022] DELETE /identity/v3/users/d279d78cb6d349938d263ab442f52ca8 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:31:38.178881 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b69c3c-0578-46a7-ba95-a85c2c418bb1 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:38.179173 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b69c3c-0578-46a7-ba95-a85c2c418bb1 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:38.179451 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31b69c3c-0578-46a7-ba95-a85c2c418bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:38.199238 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-31b69c3c-0578-46a7-ba95-a85c2c418bb1 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:38.200501 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-31b69c3c-0578-46a7-ba95-a85c2c418bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:38.261949 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1308/2628] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:31:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:31:38.272632 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722cf49b-23da-4e76-99b8-9faa3c10b703 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:38.274072 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-722cf49b-23da-4e76-99b8-9faa3c10b703 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:38.279394 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:38.338407 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722cf49b-23da-4e76-99b8-9faa3c10b703 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:38.341908 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509accd-d31e-4584-8fd3-81a84032365d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:38.342551 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509accd-d31e-4584-8fd3-81a84032365d service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:38.342831 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509accd-d31e-4584-8fd3-81a84032365d service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:38.343104 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3509accd-d31e-4584-8fd3-81a84032365d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:38.352692 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3509accd-d31e-4584-8fd3-81a84032365d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:38.354098 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3509accd-d31e-4584-8fd3-81a84032365d service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:38.364225 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1321/2629] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:31:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:31:38.636654 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b69c3c-0578-46a7-ba95-a85c2c418bb1 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:38.638215 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-31b69c3c-0578-46a7-ba95-a85c2c418bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:38.650741 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31b69c3c-0578-46a7-ba95-a85c2c418bb1 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:38.656482 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa5e6a-02fe-44cb-9d8a-2657300d8f7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:38.657147 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa5e6a-02fe-44cb-9d8a-2657300d8f7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:38.657395 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa5e6a-02fe-44cb-9d8a-2657300d8f7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:38.657675 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfa5e6a-02fe-44cb-9d8a-2657300d8f7d admin admin] PATH_INFO: `/v3/projects/dc7a3ac6680043ea942a14550cdc6ff1` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:38.659640 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfa5e6a-02fe-44cb-9d8a-2657300d8f7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc7a3ac6680043ea942a14550cdc6ff1)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:38.661597 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfa5e6a-02fe-44cb-9d8a-2657300d8f7d admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:38.710922 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-0bfa5e6a-02fe-44cb-9d8a-2657300d8f7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc7a3ac6680043ea942a14550cdc6ff1', 'request_id': 'req-0bfa5e6a-02fe-44cb-9d8a-2657300d8f7d'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:38.717131 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-0bfa5e6a-02fe-44cb-9d8a-2657300d8f7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc7a3ac6680043ea942a14550cdc6ff1', 'request_id': 'req-0bfa5e6a-02fe-44cb-9d8a-2657300d8f7d'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:38.725210 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-0bfa5e6a-02fe-44cb-9d8a-2657300d8f7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc7a3ac6680043ea942a14550cdc6ff1', 'request_id': 'req-0bfa5e6a-02fe-44cb-9d8a-2657300d8f7d'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:38.737369 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-0bfa5e6a-02fe-44cb-9d8a-2657300d8f7d admin admin] The token cache is being invalidate because project dc7a3ac6680043ea942a14550cdc6ff1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:31:38.737655 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-0bfa5e6a-02fe-44cb-9d8a-2657300d8f7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:38.738292 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-0bfa5e6a-02fe-44cb-9d8a-2657300d8f7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:38.739817 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1309/2630] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:31:38 2022] DELETE /identity/v3/projects/dc7a3ac6680043ea942a14550cdc6ff1 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:31:41.159886 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509accd-d31e-4584-8fd3-81a84032365d service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:41.161360 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-3509accd-d31e-4584-8fd3-81a84032365d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:41.179064 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3509accd-d31e-4584-8fd3-81a84032365d service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:41.234125 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa3868d-8f47-4345-837a-fc781a437b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:41.234760 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3868d-8f47-4345-837a-fc781a437b30 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:41.235039 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3868d-8f47-4345-837a-fc781a437b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:41.235312 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa3868d-8f47-4345-837a-fc781a437b30 admin admin] PATH_INFO: `/v3/users/600f51be8202427fb3691db566ed2ff2` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:41.237114 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3868d-8f47-4345-837a-fc781a437b30 admin admin] RBAC: Authorizing `identity:delete_user(user_id=600f51be8202427fb3691db566ed2ff2)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:41.239009 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa3868d-8f47-4345-837a-fc781a437b30 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:41.284384 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9fa3868d-8f47-4345-837a-fc781a437b30 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '600f51be8202427fb3691db566ed2ff2'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:41.296067 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9fa3868d-8f47-4345-837a-fc781a437b30 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '600f51be8202427fb3691db566ed2ff2'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:41.296687 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9fa3868d-8f47-4345-837a-fc781a437b30 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '600f51be8202427fb3691db566ed2ff2'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:41.297282 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9fa3868d-8f47-4345-837a-fc781a437b30 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '600f51be8202427fb3691db566ed2ff2'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:41.304501 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9fa3868d-8f47-4345-837a-fc781a437b30 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '600f51be8202427fb3691db566ed2ff2'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:41.316917 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1322/2631] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:31:41 2022] DELETE /identity/v3/users/600f51be8202427fb3691db566ed2ff2 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:31:41.491742 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa5e6a-02fe-44cb-9d8a-2657300d8f7d admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:41.493244 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-0bfa5e6a-02fe-44cb-9d8a-2657300d8f7d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:41.509421 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfa5e6a-02fe-44cb-9d8a-2657300d8f7d admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:41.541004 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:41.571498 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad699457-863d-4ed2-ad7d-98cd4988a24b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:41.572066 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad699457-863d-4ed2-ad7d-98cd4988a24b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:41.572370 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad699457-863d-4ed2-ad7d-98cd4988a24b admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:41.572651 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad699457-863d-4ed2-ad7d-98cd4988a24b admin admin] PATH_INFO: `/v3/projects/ad6a220b99d94a648150476bf0a01e50` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:41.573809 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad699457-863d-4ed2-ad7d-98cd4988a24b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad6a220b99d94a648150476bf0a01e50)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:41.575708 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad699457-863d-4ed2-ad7d-98cd4988a24b admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:41.621801 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-ad699457-863d-4ed2-ad7d-98cd4988a24b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad6a220b99d94a648150476bf0a01e50', 'request_id': 'req-ad699457-863d-4ed2-ad7d-98cd4988a24b'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:41.628295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-ad699457-863d-4ed2-ad7d-98cd4988a24b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad6a220b99d94a648150476bf0a01e50', 'request_id': 'req-ad699457-863d-4ed2-ad7d-98cd4988a24b'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:41.636436 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-ad699457-863d-4ed2-ad7d-98cd4988a24b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad6a220b99d94a648150476bf0a01e50', 'request_id': 'req-ad699457-863d-4ed2-ad7d-98cd4988a24b'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:41.647734 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-ad699457-863d-4ed2-ad7d-98cd4988a24b admin admin] The token cache is being invalidate because project ad6a220b99d94a648150476bf0a01e50 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:31:41.648020 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-ad699457-863d-4ed2-ad7d-98cd4988a24b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:41.648656 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-ad699457-863d-4ed2-ad7d-98cd4988a24b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:41.650215 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1310/2632] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:31:41 2022] DELETE /identity/v3/projects/ad6a220b99d94a648150476bf0a01e50 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:31:41.656112 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79545e81-fcab-46fa-8618-e5c6f6c961dd None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:41.656429 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79545e81-fcab-46fa-8618-e5c6f6c961dd None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:41.656704 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79545e81-fcab-46fa-8618-e5c6f6c961dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:41.676792 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-79545e81-fcab-46fa-8618-e5c6f6c961dd None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:41.677999 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-79545e81-fcab-46fa-8618-e5c6f6c961dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:41.697189 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:41.743059 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1323/2633] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:31:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:31:41.752619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab459440-08ff-4530-aa54-c415fdec91c1 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:41.752902 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab459440-08ff-4530-aa54-c415fdec91c1 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:41.753183 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab459440-08ff-4530-aa54-c415fdec91c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:41.774020 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-ab459440-08ff-4530-aa54-c415fdec91c1 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:41.775237 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-ab459440-08ff-4530-aa54-c415fdec91c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:41.783751 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1311/2634] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:31:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:31:41.787559 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79545e81-fcab-46fa-8618-e5c6f6c961dd None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:41.797124 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79545e81-fcab-46fa-8618-e5c6f6c961dd None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:41.802374 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2313f-028d-4eb8-ace1-39559bd0461b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:41.802987 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2313f-028d-4eb8-ace1-39559bd0461b admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:41.803263 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2313f-028d-4eb8-ace1-39559bd0461b admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:41.803537 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e2313f-028d-4eb8-ace1-39559bd0461b admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:41.804234 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e2313f-028d-4eb8-ace1-39559bd0461b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:41.804568 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e2313f-028d-4eb8-ace1-39559bd0461b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:41.806145 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43e2313f-028d-4eb8-ace1-39559bd0461b admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:41.819230 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1324/2635] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:31:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:41.823875 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab459440-08ff-4530-aa54-c415fdec91c1 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:41.835410 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab459440-08ff-4530-aa54-c415fdec91c1 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:41.840052 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8063ef-099b-4ae9-8e82-2de09f31371c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:41.840843 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8063ef-099b-4ae9-8e82-2de09f31371c admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:41.841221 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8063ef-099b-4ae9-8e82-2de09f31371c admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:41.841586 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8063ef-099b-4ae9-8e82-2de09f31371c admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:41.842403 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8063ef-099b-4ae9-8e82-2de09f31371c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:41.844525 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8063ef-099b-4ae9-8e82-2de09f31371c admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:41.875854 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1312/2636] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:31:41 2022] POST /identity/v3/projects => generated 387 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:31:41.878229 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2313f-028d-4eb8-ace1-39559bd0461b admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:41.888116 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e2313f-028d-4eb8-ace1-39559bd0461b admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:41.944845 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1300c04-78bf-40e0-927e-5ed65e080461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:41.945456 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1300c04-78bf-40e0-927e-5ed65e080461 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:41.945737 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1300c04-78bf-40e0-927e-5ed65e080461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:41.946010 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1300c04-78bf-40e0-927e-5ed65e080461 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:41.946664 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1300c04-78bf-40e0-927e-5ed65e080461 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:41.948572 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1300c04-78bf-40e0-927e-5ed65e080461 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:41.970100 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1325/2637] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:31:41 2022] POST /identity/v3/users => generated 294 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:31:41.974605 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8063ef-099b-4ae9-8e82-2de09f31371c admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:41.984847 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8063ef-099b-4ae9-8e82-2de09f31371c admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:41.989745 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dee6cd-d98a-4dc0-930e-2a471d8d4cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:41.990345 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dee6cd-d98a-4dc0-930e-2a471d8d4cc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:41.990624 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dee6cd-d98a-4dc0-930e-2a471d8d4cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:41.990908 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65dee6cd-d98a-4dc0-930e-2a471d8d4cc1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:41.991619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dee6cd-d98a-4dc0-930e-2a471d8d4cc1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:41.993231 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65dee6cd-d98a-4dc0-930e-2a471d8d4cc1 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:42.003523 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1313/2638] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:31:41 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:31:42.007332 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1300c04-78bf-40e0-927e-5ed65e080461 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:42.018263 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1300c04-78bf-40e0-927e-5ed65e080461 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:42.023029 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed29533c-156c-4ca8-a5e7-7f2a9453153b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:42.023635 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29533c-156c-4ca8-a5e7-7f2a9453153b admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:42.023911 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29533c-156c-4ca8-a5e7-7f2a9453153b admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:42.024184 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed29533c-156c-4ca8-a5e7-7f2a9453153b admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:42.024938 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29533c-156c-4ca8-a5e7-7f2a9453153b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:42.026537 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed29533c-156c-4ca8-a5e7-7f2a9453153b admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:42.037100 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1326/2639] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:31:42.041114 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dee6cd-d98a-4dc0-930e-2a471d8d4cc1 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:42.051514 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65dee6cd-d98a-4dc0-930e-2a471d8d4cc1 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:42.056033 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd964c9-7728-44cd-a8c4-d897f3d800df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:42.056730 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd964c9-7728-44cd-a8c4-d897f3d800df admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:42.057012 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd964c9-7728-44cd-a8c4-d897f3d800df admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:42.057283 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd964c9-7728-44cd-a8c4-d897f3d800df admin admin] PATH_INFO: `/v3/projects/771913a48647400e987bc71d8cbbce03/users/501039f2336048818218ce48057671b4/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:42.071524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd964c9-7728-44cd-a8c4-d897f3d800df admin admin] RBAC: Authorizing `identity:create_grant(project_id=771913a48647400e987bc71d8cbbce03, user_id=501039f2336048818218ce48057671b4, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:42.074233 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efd964c9-7728-44cd-a8c4-d897f3d800df admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:42.087277 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1314/2640] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:31:42 2022] PUT /identity/v3/projects/771913a48647400e987bc71d8cbbce03/users/501039f2336048818218ce48057671b4/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:31:42.097780 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76840eb4-7e48-4dfa-8e60-1be4128e5317 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:42.098104 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76840eb4-7e48-4dfa-8e60-1be4128e5317 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:42.098385 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76840eb4-7e48-4dfa-8e60-1be4128e5317 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:42.125516 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-76840eb4-7e48-4dfa-8e60-1be4128e5317 None None] MFA Rules not processed for user `501039f2336048818218ce48057671b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:42.127071 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-76840eb4-7e48-4dfa-8e60-1be4128e5317 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:42.196099 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1327/2641] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:31:42 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:31:42.200752 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd964c9-7728-44cd-a8c4-d897f3d800df admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:42.265554 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:42.270117 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efd964c9-7728-44cd-a8c4-d897f3d800df admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:42.276079 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418536d-38ca-431c-8504-de2dc607c4b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:42.276910 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418536d-38ca-431c-8504-de2dc607c4b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:42.277394 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418536d-38ca-431c-8504-de2dc607c4b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:42.277840 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418536d-38ca-431c-8504-de2dc607c4b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:42.278617 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418536d-38ca-431c-8504-de2dc607c4b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:42.280806 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418536d-38ca-431c-8504-de2dc607c4b0 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:42.310212 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1315/2642] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:31:42 2022] POST /identity/v3/projects => generated 385 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:31:42.313173 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76840eb4-7e48-4dfa-8e60-1be4128e5317 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:42.324994 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76840eb4-7e48-4dfa-8e60-1be4128e5317 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:42.342558 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:42.385437 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6810c17-2f1b-4d29-aa74-12f00ca405c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:42.386096 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6810c17-2f1b-4d29-aa74-12f00ca405c1 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:42.386377 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6810c17-2f1b-4d29-aa74-12f00ca405c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:42.386654 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6810c17-2f1b-4d29-aa74-12f00ca405c1 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:42.387331 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6810c17-2f1b-4d29-aa74-12f00ca405c1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:42.389271 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6810c17-2f1b-4d29-aa74-12f00ca405c1 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:42.412341 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1328/2643] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:31:42 2022] POST /identity/v3/users => generated 293 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:31:42.416648 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418536d-38ca-431c-8504-de2dc607c4b0 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:42.429797 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418536d-38ca-431c-8504-de2dc607c4b0 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:42.434436 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0425e5-8219-403d-9976-28b0c5cc8c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:42.435046 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0425e5-8219-403d-9976-28b0c5cc8c6d admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:42.435331 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0425e5-8219-403d-9976-28b0c5cc8c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:42.435609 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0425e5-8219-403d-9976-28b0c5cc8c6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:42.436303 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0425e5-8219-403d-9976-28b0c5cc8c6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:42.437922 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0425e5-8219-403d-9976-28b0c5cc8c6d admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:42.573180 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1316/2644] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:31:42.577496 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6810c17-2f1b-4d29-aa74-12f00ca405c1 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:42.588956 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6810c17-2f1b-4d29-aa74-12f00ca405c1 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:42.593469 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619bba1c-819b-499c-975d-638d959b9881 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:42.594076 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619bba1c-819b-499c-975d-638d959b9881 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:42.594356 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619bba1c-819b-499c-975d-638d959b9881 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:42.594627 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619bba1c-819b-499c-975d-638d959b9881 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:42.595452 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619bba1c-819b-499c-975d-638d959b9881 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:42.597085 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619bba1c-819b-499c-975d-638d959b9881 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:42.606860 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1329/2645] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:31:42.611681 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0425e5-8219-403d-9976-28b0c5cc8c6d admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:42.621489 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0425e5-8219-403d-9976-28b0c5cc8c6d admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:42.625973 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca7942-55a7-4513-8a53-0d9e4ea7899c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:42.627106 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca7942-55a7-4513-8a53-0d9e4ea7899c admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:42.627842 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca7942-55a7-4513-8a53-0d9e4ea7899c admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:42.628119 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ca7942-55a7-4513-8a53-0d9e4ea7899c admin admin] PATH_INFO: `/v3/projects/6e0df50b13d54f989f860dcb4af3d55f/users/4d8b17dc3bb14dd2995c2a1bde277aef/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:42.643565 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca7942-55a7-4513-8a53-0d9e4ea7899c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e0df50b13d54f989f860dcb4af3d55f, user_id=4d8b17dc3bb14dd2995c2a1bde277aef, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:42.646229 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ca7942-55a7-4513-8a53-0d9e4ea7899c admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:42.659651 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1317/2646] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:31:42 2022] PUT /identity/v3/projects/6e0df50b13d54f989f860dcb4af3d55f/users/4d8b17dc3bb14dd2995c2a1bde277aef/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:31:42.671065 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43f4ca-d7d1-4dfc-ac7b-59a749b00542 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:42.671357 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43f4ca-d7d1-4dfc-ac7b-59a749b00542 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:42.671635 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e43f4ca-d7d1-4dfc-ac7b-59a749b00542 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:42.700339 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-9e43f4ca-d7d1-4dfc-ac7b-59a749b00542 None None] MFA Rules not processed for user `4d8b17dc3bb14dd2995c2a1bde277aef`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:42.701547 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9e43f4ca-d7d1-4dfc-ac7b-59a749b00542 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:42.764993 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1330/2647] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:31:42 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:31:42.770335 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca7942-55a7-4513-8a53-0d9e4ea7899c admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:42.831025 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ca7942-55a7-4513-8a53-0d9e4ea7899c admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:42.835566 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d25cc-3580-4512-a6f2-44e85f634ea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:42.836213 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d25cc-3580-4512-a6f2-44e85f634ea3 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:42.836520 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d25cc-3580-4512-a6f2-44e85f634ea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:42.836796 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f93d25cc-3580-4512-a6f2-44e85f634ea3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:42.837742 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d25cc-3580-4512-a6f2-44e85f634ea3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:42.839628 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f93d25cc-3580-4512-a6f2-44e85f634ea3 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:42.867131 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1318/2648] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:31:42 2022] POST /identity/v3/projects => generated 385 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:31:42.871218 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43f4ca-d7d1-4dfc-ac7b-59a749b00542 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:42.882279 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e43f4ca-d7d1-4dfc-ac7b-59a749b00542 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:42.938861 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35315e2e-4494-4fb1-bfc8-f7cde99f8a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:42.940037 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35315e2e-4494-4fb1-bfc8-f7cde99f8a4c admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:42.940413 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35315e2e-4494-4fb1-bfc8-f7cde99f8a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:42.940745 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35315e2e-4494-4fb1-bfc8-f7cde99f8a4c admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:42.941419 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35315e2e-4494-4fb1-bfc8-f7cde99f8a4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:42.943430 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35315e2e-4494-4fb1-bfc8-f7cde99f8a4c admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:42.967861 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1331/2649] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:31:42 2022] POST /identity/v3/users => generated 299 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:31:42.969173 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d25cc-3580-4512-a6f2-44e85f634ea3 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:42.979565 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f93d25cc-3580-4512-a6f2-44e85f634ea3 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:42.984070 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51672e0-31ed-453f-8837-8d3f780363b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:42.984714 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51672e0-31ed-453f-8837-8d3f780363b0 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:42.985015 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51672e0-31ed-453f-8837-8d3f780363b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:42.985283 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51672e0-31ed-453f-8837-8d3f780363b0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:42.986567 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51672e0-31ed-453f-8837-8d3f780363b0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:42.988221 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51672e0-31ed-453f-8837-8d3f780363b0 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:42.998249 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1319/2650] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:31:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:31:43.002490 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35315e2e-4494-4fb1-bfc8-f7cde99f8a4c admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:43.012263 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35315e2e-4494-4fb1-bfc8-f7cde99f8a4c admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:43.016973 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd876d0-62af-4f67-864c-2b3de1a1e345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:43.018183 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd876d0-62af-4f67-864c-2b3de1a1e345 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:43.018460 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd876d0-62af-4f67-864c-2b3de1a1e345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:43.018730 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd876d0-62af-4f67-864c-2b3de1a1e345 admin admin] PATH_INFO: `/v3/projects/7e2c9624c1d14f31a56923438d70163f/users/c9e8f01ab4564dea961dc14d9a40c80d/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:43.033867 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd876d0-62af-4f67-864c-2b3de1a1e345 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e2c9624c1d14f31a56923438d70163f, user_id=c9e8f01ab4564dea961dc14d9a40c80d, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:43.036628 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd876d0-62af-4f67-864c-2b3de1a1e345 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:43.038944 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:43.052487 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1332/2651] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:31:43 2022] PUT /identity/v3/projects/7e2c9624c1d14f31a56923438d70163f/users/c9e8f01ab4564dea961dc14d9a40c80d/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:31:43.056308 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51672e0-31ed-453f-8837-8d3f780363b0 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:43.067141 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51672e0-31ed-453f-8837-8d3f780363b0 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:43.124612 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee416d9-8b1c-49e9-a2d5-86d4371607e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:43.125167 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee416d9-8b1c-49e9-a2d5-86d4371607e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:43.125445 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee416d9-8b1c-49e9-a2d5-86d4371607e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:43.125717 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee416d9-8b1c-49e9-a2d5-86d4371607e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:43.126467 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee416d9-8b1c-49e9-a2d5-86d4371607e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:43.128047 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee416d9-8b1c-49e9-a2d5-86d4371607e9 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:43.137542 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1320/2652] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:31:43 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:31:43.141866 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd876d0-62af-4f67-864c-2b3de1a1e345 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:43.152386 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd876d0-62af-4f67-864c-2b3de1a1e345 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:43.156818 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190583d3-e1ad-4424-a887-95e092fa576a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:43.157466 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190583d3-e1ad-4424-a887-95e092fa576a admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:43.157755 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190583d3-e1ad-4424-a887-95e092fa576a admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:43.158616 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-190583d3-e1ad-4424-a887-95e092fa576a admin admin] PATH_INFO: `/v3/projects/7e2c9624c1d14f31a56923438d70163f/users/c9e8f01ab4564dea961dc14d9a40c80d/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:43.160591 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190583d3-e1ad-4424-a887-95e092fa576a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e2c9624c1d14f31a56923438d70163f, user_id=c9e8f01ab4564dea961dc14d9a40c80d, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:43.163191 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-190583d3-e1ad-4424-a887-95e092fa576a admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:43.173015 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1333/2653] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:31:43 2022] PUT /identity/v3/projects/7e2c9624c1d14f31a56923438d70163f/users/c9e8f01ab4564dea961dc14d9a40c80d/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:31:43.183174 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b3768-fd98-43e1-a94a-368ec65d9c2d None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:43.183462 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b3768-fd98-43e1-a94a-368ec65d9c2d None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:43.183742 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53b3768-fd98-43e1-a94a-368ec65d9c2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:43.211923 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-c53b3768-fd98-43e1-a94a-368ec65d9c2d None None] MFA Rules not processed for user `c9e8f01ab4564dea961dc14d9a40c80d`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:43.213496 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-c53b3768-fd98-43e1-a94a-368ec65d9c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:43.218647 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:43.282020 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1321/2654] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:31:43 2022] POST /identity/v3/auth/tokens => generated 3329 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:31:43.292616 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190583d3-e1ad-4424-a887-95e092fa576a admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:43.294360 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-190583d3-e1ad-4424-a887-95e092fa576a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:43.352773 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-190583d3-e1ad-4424-a887-95e092fa576a admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:43.356431 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5eeba-6b67-4c11-bb5b-613750dda76b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:43.357047 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5eeba-6b67-4c11-bb5b-613750dda76b service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:43.357336 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5eeba-6b67-4c11-bb5b-613750dda76b service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:43.357610 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf5eeba-6b67-4c11-bb5b-613750dda76b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:43.367445 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5eeba-6b67-4c11-bb5b-613750dda76b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:43.368895 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf5eeba-6b67-4c11-bb5b-613750dda76b service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:43.378454 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1334/2655] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:31:43 2022] GET /identity/v3/auth/tokens => generated 3329 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:31:43.866848 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b3768-fd98-43e1-a94a-368ec65d9c2d None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:43.868237 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-c53b3768-fd98-43e1-a94a-368ec65d9c2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:43.880315 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53b3768-fd98-43e1-a94a-368ec65d9c2d None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:43.883865 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644f548-6bd6-4b62-9bf7-60dbafeae0f1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:43.884506 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644f548-6bd6-4b62-9bf7-60dbafeae0f1 service cinder] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:43.884803 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644f548-6bd6-4b62-9bf7-60dbafeae0f1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:43.885054 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0644f548-6bd6-4b62-9bf7-60dbafeae0f1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:43.942812 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0644f548-6bd6-4b62-9bf7-60dbafeae0f1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:43.944228 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0644f548-6bd6-4b62-9bf7-60dbafeae0f1 service cinder] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:43.953189 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1322/2656] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:31:43 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:31:47.409191 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5eeba-6b67-4c11-bb5b-613750dda76b service cinder] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:47.410828 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-dcf5eeba-6b67-4c11-bb5b-613750dda76b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:47.490426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf5eeba-6b67-4c11-bb5b-613750dda76b service cinder] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:47.495720 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f04766-0995-4bff-af90-55e8b5e9f161 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:47.496351 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f04766-0995-4bff-af90-55e8b5e9f161 service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:47.496630 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f04766-0995-4bff-af90-55e8b5e9f161 service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:47.496899 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f04766-0995-4bff-af90-55e8b5e9f161 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:47.498630 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-69f04766-0995-4bff-af90-55e8b5e9f161 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:47.510471 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f04766-0995-4bff-af90-55e8b5e9f161 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:47.512011 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69f04766-0995-4bff-af90-55e8b5e9f161 service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:47.522633 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1335/2657] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:31:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:31:48.006559 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644f548-6bd6-4b62-9bf7-60dbafeae0f1 service cinder] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:48.012288 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f04766-0995-4bff-af90-55e8b5e9f161 service nova] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:48.015372 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0644f548-6bd6-4b62-9bf7-60dbafeae0f1 service cinder] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:48.019792 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1085e-92e1-43d9-9552-7118b887edc3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:48.020452 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1085e-92e1-43d9-9552-7118b887edc3 service cinder] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:48.020735 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1085e-92e1-43d9-9552-7118b887edc3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:48.021018 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf1085e-92e1-43d9-9552-7118b887edc3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:48.022763 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69f04766-0995-4bff-af90-55e8b5e9f161 service nova] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:48.026462 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeb53c0c-cfb0-4380-9ade-439dfe49230b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:48.027176 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb53c0c-cfb0-4380-9ade-439dfe49230b service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:48.027458 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb53c0c-cfb0-4380-9ade-439dfe49230b service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:48.027729 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeb53c0c-cfb0-4380-9ade-439dfe49230b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:48.029485 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-aeb53c0c-cfb0-4380-9ade-439dfe49230b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:48.077803 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf1085e-92e1-43d9-9552-7118b887edc3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:48.079233 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf1085e-92e1-43d9-9552-7118b887edc3 service cinder] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:48.088436 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1323/2658] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:31:48 2022] GET /identity/v3/auth/tokens => generated 3262 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:31:48.098453 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:48.115757 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb53c0c-cfb0-4380-9ade-439dfe49230b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:48.117281 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeb53c0c-cfb0-4380-9ade-439dfe49230b service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:48.138568 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1336/2659] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:31:48 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:31:50.221074 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1085e-92e1-43d9-9552-7118b887edc3 service cinder] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:50.266296 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:50.287852 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf1085e-92e1-43d9-9552-7118b887edc3 service cinder] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:50.292310 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3d3bdd-82e0-4f71-9447-9abfa072dd5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:50.292973 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d3bdd-82e0-4f71-9447-9abfa072dd5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:50.293249 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d3bdd-82e0-4f71-9447-9abfa072dd5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:50.293521 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f3d3bdd-82e0-4f71-9447-9abfa072dd5d admin admin] PATH_INFO: `/v3/users/501039f2336048818218ce48057671b4` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:50.294699 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3d3bdd-82e0-4f71-9447-9abfa072dd5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=501039f2336048818218ce48057671b4)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:50.296633 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f3d3bdd-82e0-4f71-9447-9abfa072dd5d admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:50.358119 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-9f3d3bdd-82e0-4f71-9447-9abfa072dd5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '501039f2336048818218ce48057671b4'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:50.370608 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-9f3d3bdd-82e0-4f71-9447-9abfa072dd5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '501039f2336048818218ce48057671b4'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:50.371294 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-9f3d3bdd-82e0-4f71-9447-9abfa072dd5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '501039f2336048818218ce48057671b4'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:50.371925 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-9f3d3bdd-82e0-4f71-9447-9abfa072dd5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '501039f2336048818218ce48057671b4'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:50.379626 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-9f3d3bdd-82e0-4f71-9447-9abfa072dd5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '501039f2336048818218ce48057671b4'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:50.393326 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1324/2660] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:31:50 2022] DELETE /identity/v3/users/501039f2336048818218ce48057671b4 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:31:50.397774 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee44af-f44f-45e7-9c06-c1d493cd57bc None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:50.398278 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee44af-f44f-45e7-9c06-c1d493cd57bc None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:50.398387 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aee44af-f44f-45e7-9c06-c1d493cd57bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:50.417916 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-8aee44af-f44f-45e7-9c06-c1d493cd57bc None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:50.418996 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-8aee44af-f44f-45e7-9c06-c1d493cd57bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:50.479428 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1337/2661] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:31:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:31:50.489152 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3d3bdd-82e0-4f71-9447-9abfa072dd5d admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:50.490554 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-9f3d3bdd-82e0-4f71-9447-9abfa072dd5d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:50.547152 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f3d3bdd-82e0-4f71-9447-9abfa072dd5d admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:50.551181 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94fbb4-d0de-4959-9f68-dbecec53e066 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:50.551781 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94fbb4-d0de-4959-9f68-dbecec53e066 service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:50.552060 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94fbb4-d0de-4959-9f68-dbecec53e066 service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:50.552341 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da94fbb4-d0de-4959-9f68-dbecec53e066 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:50.561221 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94fbb4-d0de-4959-9f68-dbecec53e066 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:50.562618 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da94fbb4-d0de-4959-9f68-dbecec53e066 service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:50.572381 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1325/2662] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:31:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:31:50.848884 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee44af-f44f-45e7-9c06-c1d493cd57bc None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:50.850346 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-8aee44af-f44f-45e7-9c06-c1d493cd57bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:50.863960 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aee44af-f44f-45e7-9c06-c1d493cd57bc None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:50.871283 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a7e0a-a8ce-4712-89f0-ff7164d79214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:50.871959 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a7e0a-a8ce-4712-89f0-ff7164d79214 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:50.872256 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a7e0a-a8ce-4712-89f0-ff7164d79214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:50.872605 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-056a7e0a-a8ce-4712-89f0-ff7164d79214 admin admin] PATH_INFO: `/v3/projects/771913a48647400e987bc71d8cbbce03` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:50.873762 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a7e0a-a8ce-4712-89f0-ff7164d79214 admin admin] RBAC: Authorizing `identity:delete_project(project_id=771913a48647400e987bc71d8cbbce03)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:50.875696 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-056a7e0a-a8ce-4712-89f0-ff7164d79214 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:50.931367 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-056a7e0a-a8ce-4712-89f0-ff7164d79214 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '771913a48647400e987bc71d8cbbce03', 'request_id': 'req-056a7e0a-a8ce-4712-89f0-ff7164d79214'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:50.936886 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-056a7e0a-a8ce-4712-89f0-ff7164d79214 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '771913a48647400e987bc71d8cbbce03', 'request_id': 'req-056a7e0a-a8ce-4712-89f0-ff7164d79214'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:50.945539 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-056a7e0a-a8ce-4712-89f0-ff7164d79214 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '771913a48647400e987bc71d8cbbce03', 'request_id': 'req-056a7e0a-a8ce-4712-89f0-ff7164d79214'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:50.958021 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-056a7e0a-a8ce-4712-89f0-ff7164d79214 admin admin] The token cache is being invalidate because project 771913a48647400e987bc71d8cbbce03 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:31:50.958304 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-056a7e0a-a8ce-4712-89f0-ff7164d79214 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:50.958950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-056a7e0a-a8ce-4712-89f0-ff7164d79214 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:50.960895 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1338/2663] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:31:50 2022] DELETE /identity/v3/projects/771913a48647400e987bc71d8cbbce03 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:31:50.964676 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94fbb4-d0de-4959-9f68-dbecec53e066 service neutron] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:50.974218 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da94fbb4-d0de-4959-9f68-dbecec53e066 service neutron] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:51.031934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0daee-c6ad-455a-b8c4-bb78a1e710f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:51.032716 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0daee-c6ad-455a-b8c4-bb78a1e710f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:51.033176 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0daee-c6ad-455a-b8c4-bb78a1e710f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:51.033518 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b0daee-c6ad-455a-b8c4-bb78a1e710f4 admin admin] PATH_INFO: `/v3/users/4d8b17dc3bb14dd2995c2a1bde277aef` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:51.034724 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0daee-c6ad-455a-b8c4-bb78a1e710f4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4d8b17dc3bb14dd2995c2a1bde277aef)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:51.036647 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07b0daee-c6ad-455a-b8c4-bb78a1e710f4 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:51.040011 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:51.094459 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-07b0daee-c6ad-455a-b8c4-bb78a1e710f4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4d8b17dc3bb14dd2995c2a1bde277aef'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:51.112358 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-07b0daee-c6ad-455a-b8c4-bb78a1e710f4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4d8b17dc3bb14dd2995c2a1bde277aef'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:51.113081 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-07b0daee-c6ad-455a-b8c4-bb78a1e710f4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4d8b17dc3bb14dd2995c2a1bde277aef'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:51.113709 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-07b0daee-c6ad-455a-b8c4-bb78a1e710f4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4d8b17dc3bb14dd2995c2a1bde277aef'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:51.121803 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-07b0daee-c6ad-455a-b8c4-bb78a1e710f4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4d8b17dc3bb14dd2995c2a1bde277aef'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:51.136264 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1326/2664] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:31:50 2022] DELETE /identity/v3/users/4d8b17dc3bb14dd2995c2a1bde277aef => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:31:51.409303 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a7e0a-a8ce-4712-89f0-ff7164d79214 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:51.410777 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-056a7e0a-a8ce-4712-89f0-ff7164d79214 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:51.426347 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-056a7e0a-a8ce-4712-89f0-ff7164d79214 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:51.517190 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0eaa31-1486-41ad-a2a4-c8045c43a941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:51.520288 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0eaa31-1486-41ad-a2a4-c8045c43a941 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:51.520613 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0eaa31-1486-41ad-a2a4-c8045c43a941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:51.520889 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0eaa31-1486-41ad-a2a4-c8045c43a941 admin admin] PATH_INFO: `/v3/projects/6e0df50b13d54f989f860dcb4af3d55f` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:51.522200 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0eaa31-1486-41ad-a2a4-c8045c43a941 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e0df50b13d54f989f860dcb4af3d55f)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:51.524582 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0eaa31-1486-41ad-a2a4-c8045c43a941 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:51.527693 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:51.592445 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-5e0eaa31-1486-41ad-a2a4-c8045c43a941 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e0df50b13d54f989f860dcb4af3d55f', 'request_id': 'req-5e0eaa31-1486-41ad-a2a4-c8045c43a941'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:51.598523 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-5e0eaa31-1486-41ad-a2a4-c8045c43a941 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e0df50b13d54f989f860dcb4af3d55f', 'request_id': 'req-5e0eaa31-1486-41ad-a2a4-c8045c43a941'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:51.608010 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-5e0eaa31-1486-41ad-a2a4-c8045c43a941 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e0df50b13d54f989f860dcb4af3d55f', 'request_id': 'req-5e0eaa31-1486-41ad-a2a4-c8045c43a941'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:51.621601 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-5e0eaa31-1486-41ad-a2a4-c8045c43a941 admin admin] The token cache is being invalidate because project 6e0df50b13d54f989f860dcb4af3d55f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:31:51.621894 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-5e0eaa31-1486-41ad-a2a4-c8045c43a941 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:51.622546 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-5e0eaa31-1486-41ad-a2a4-c8045c43a941 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:51.624177 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1339/2665] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:31:51 2022] DELETE /identity/v3/projects/6e0df50b13d54f989f860dcb4af3d55f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:31:51.629473 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0daee-c6ad-455a-b8c4-bb78a1e710f4 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:51.637493 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-07b0daee-c6ad-455a-b8c4-bb78a1e710f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:51.651149 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b0daee-c6ad-455a-b8c4-bb78a1e710f4 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:51.709681 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33e8ea7-7cab-4de8-8867-7e61b3735405 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:51.710324 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e8ea7-7cab-4de8-8867-7e61b3735405 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:51.710610 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e8ea7-7cab-4de8-8867-7e61b3735405 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:51.710880 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33e8ea7-7cab-4de8-8867-7e61b3735405 admin admin] PATH_INFO: `/v3/users/c9e8f01ab4564dea961dc14d9a40c80d` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:51.712820 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33e8ea7-7cab-4de8-8867-7e61b3735405 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9e8f01ab4564dea961dc14d9a40c80d)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:51.714278 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33e8ea7-7cab-4de8-8867-7e61b3735405 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:51.770836 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-d33e8ea7-7cab-4de8-8867-7e61b3735405 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9e8f01ab4564dea961dc14d9a40c80d'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:51.784053 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-d33e8ea7-7cab-4de8-8867-7e61b3735405 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9e8f01ab4564dea961dc14d9a40c80d'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:51.784865 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-d33e8ea7-7cab-4de8-8867-7e61b3735405 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9e8f01ab4564dea961dc14d9a40c80d'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:51.785547 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-d33e8ea7-7cab-4de8-8867-7e61b3735405 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9e8f01ab4564dea961dc14d9a40c80d'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:51.799146 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-d33e8ea7-7cab-4de8-8867-7e61b3735405 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9e8f01ab4564dea961dc14d9a40c80d'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:51.811636 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:51.821092 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1327/2666] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:31:51 2022] DELETE /identity/v3/users/c9e8f01ab4564dea961dc14d9a40c80d => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:31:52.160428 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0eaa31-1486-41ad-a2a4-c8045c43a941 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:52.162117 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-5e0eaa31-1486-41ad-a2a4-c8045c43a941 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:52.179115 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0eaa31-1486-41ad-a2a4-c8045c43a941 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:52.244260 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-919cb60b-e8f9-4eda-958f-4eaf2bf6795b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:52.244857 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cb60b-e8f9-4eda-958f-4eaf2bf6795b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:52.245266 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cb60b-e8f9-4eda-958f-4eaf2bf6795b admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:52.245543 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-919cb60b-e8f9-4eda-958f-4eaf2bf6795b admin admin] PATH_INFO: `/v3/projects/7e2c9624c1d14f31a56923438d70163f` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:52.246703 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919cb60b-e8f9-4eda-958f-4eaf2bf6795b admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e2c9624c1d14f31a56923438d70163f)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:52.248626 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-919cb60b-e8f9-4eda-958f-4eaf2bf6795b admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:52.303756 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-919cb60b-e8f9-4eda-958f-4eaf2bf6795b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e2c9624c1d14f31a56923438d70163f', 'request_id': 'req-919cb60b-e8f9-4eda-958f-4eaf2bf6795b'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:52.310365 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-919cb60b-e8f9-4eda-958f-4eaf2bf6795b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e2c9624c1d14f31a56923438d70163f', 'request_id': 'req-919cb60b-e8f9-4eda-958f-4eaf2bf6795b'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:52.322853 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-919cb60b-e8f9-4eda-958f-4eaf2bf6795b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e2c9624c1d14f31a56923438d70163f', 'request_id': 'req-919cb60b-e8f9-4eda-958f-4eaf2bf6795b'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:52.337927 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-919cb60b-e8f9-4eda-958f-4eaf2bf6795b admin admin] The token cache is being invalidate because project 7e2c9624c1d14f31a56923438d70163f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:31:52.338240 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-919cb60b-e8f9-4eda-958f-4eaf2bf6795b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:52.339015 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-919cb60b-e8f9-4eda-958f-4eaf2bf6795b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:52.341720 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1340/2667] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:31:52 2022] DELETE /identity/v3/projects/7e2c9624c1d14f31a56923438d70163f => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:31:52.349200 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca3aa5-2475-44d7-bd0e-8d0561f62c2f None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:52.349608 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca3aa5-2475-44d7-bd0e-8d0561f62c2f None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:52.349959 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca3aa5-2475-44d7-bd0e-8d0561f62c2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:52.371100 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-3fca3aa5-2475-44d7-bd0e-8d0561f62c2f None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:52.372319 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-3fca3aa5-2475-44d7-bd0e-8d0561f62c2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:52.441501 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1328/2668] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:31:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:31:52.452501 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a70975-610b-4dfd-ab53-b1215d57b2df None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:52.453004 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a70975-610b-4dfd-ab53-b1215d57b2df None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:52.453127 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a70975-610b-4dfd-ab53-b1215d57b2df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:52.473474 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-f6a70975-610b-4dfd-ab53-b1215d57b2df None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:52.474679 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-f6a70975-610b-4dfd-ab53-b1215d57b2df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:52.483047 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1341/2669] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:31:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:31:52.487573 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca3aa5-2475-44d7-bd0e-8d0561f62c2f None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:52.497551 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca3aa5-2475-44d7-bd0e-8d0561f62c2f None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:52.503014 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f27d34-20ef-42c3-b066-9c0cad8dc1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:52.503695 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f27d34-20ef-42c3-b066-9c0cad8dc1c3 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:52.504005 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f27d34-20ef-42c3-b066-9c0cad8dc1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:52.504277 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f27d34-20ef-42c3-b066-9c0cad8dc1c3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:52.505000 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f27d34-20ef-42c3-b066-9c0cad8dc1c3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:52.505299 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f27d34-20ef-42c3-b066-9c0cad8dc1c3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:52.506878 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f27d34-20ef-42c3-b066-9c0cad8dc1c3 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:52.519393 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1329/2670] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:31:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:52.523659 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a70975-610b-4dfd-ab53-b1215d57b2df None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:52.533018 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a70975-610b-4dfd-ab53-b1215d57b2df None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:52.537659 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea7fbb-83dc-4217-af4d-4e598c664bbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:52.538264 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea7fbb-83dc-4217-af4d-4e598c664bbc admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:52.538547 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea7fbb-83dc-4217-af4d-4e598c664bbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:52.538822 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ea7fbb-83dc-4217-af4d-4e598c664bbc admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:52.539490 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ea7fbb-83dc-4217-af4d-4e598c664bbc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:52.541434 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ea7fbb-83dc-4217-af4d-4e598c664bbc admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:52.558173 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:52.573702 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1342/2671] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:31:52 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:31:52.578019 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f27d34-20ef-42c3-b066-9c0cad8dc1c3 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:52.588707 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f27d34-20ef-42c3-b066-9c0cad8dc1c3 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:52.648604 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38a5ca-9795-460b-b99f-6439e34e1bfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:52.649355 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38a5ca-9795-460b-b99f-6439e34e1bfa admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:52.649476 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38a5ca-9795-460b-b99f-6439e34e1bfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:52.649727 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b38a5ca-9795-460b-b99f-6439e34e1bfa admin admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:52.650428 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b38a5ca-9795-460b-b99f-6439e34e1bfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:52.652403 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b38a5ca-9795-460b-b99f-6439e34e1bfa admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:52.674805 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1330/2672] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:31:52 2022] POST /identity/v3/users => generated 286 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:31:52.678840 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea7fbb-83dc-4217-af4d-4e598c664bbc admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:52.690433 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ea7fbb-83dc-4217-af4d-4e598c664bbc admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:52.695132 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534dc07-93d4-4712-b6e6-b2699304d92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:52.695782 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534dc07-93d4-4712-b6e6-b2699304d92a admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:52.696064 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534dc07-93d4-4712-b6e6-b2699304d92a admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:52.696362 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a534dc07-93d4-4712-b6e6-b2699304d92a admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:52.697070 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534dc07-93d4-4712-b6e6-b2699304d92a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:52.698636 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a534dc07-93d4-4712-b6e6-b2699304d92a admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:52.709489 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1343/2673] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:31:52.713984 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38a5ca-9795-460b-b99f-6439e34e1bfa admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:52.724529 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b38a5ca-9795-460b-b99f-6439e34e1bfa admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:52.729922 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6a6e29-5c78-4e09-8832-76c586469798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:52.730571 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a6e29-5c78-4e09-8832-76c586469798 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:52.730850 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a6e29-5c78-4e09-8832-76c586469798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:52.731122 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6a6e29-5c78-4e09-8832-76c586469798 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:52.731820 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a6e29-5c78-4e09-8832-76c586469798 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:52.733452 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6a6e29-5c78-4e09-8832-76c586469798 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:52.751320 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1331/2674] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:31:52 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:31:52.753426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534dc07-93d4-4712-b6e6-b2699304d92a admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:52.765054 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a534dc07-93d4-4712-b6e6-b2699304d92a admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:52.770697 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48be0b-48bf-4b41-8b4d-977cf9502d2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:52.771391 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48be0b-48bf-4b41-8b4d-977cf9502d2f admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:52.771672 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48be0b-48bf-4b41-8b4d-977cf9502d2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:52.771955 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48be0b-48bf-4b41-8b4d-977cf9502d2f admin admin] PATH_INFO: `/v3/projects/ee7e7c112caa46d4a5150ce517235f4f/users/7735831463154d608399dd940ae0f105/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:52.788255 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48be0b-48bf-4b41-8b4d-977cf9502d2f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee7e7c112caa46d4a5150ce517235f4f, user_id=7735831463154d608399dd940ae0f105, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:52.790918 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb48be0b-48bf-4b41-8b4d-977cf9502d2f admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:52.805700 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1344/2675] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:31:52 2022] PUT /identity/v3/projects/ee7e7c112caa46d4a5150ce517235f4f/users/7735831463154d608399dd940ae0f105/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:31:52.818335 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a24f18-03f8-47a9-bc5d-424ef4e40cfd None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:52.818618 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a24f18-03f8-47a9-bc5d-424ef4e40cfd None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:52.818895 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a24f18-03f8-47a9-bc5d-424ef4e40cfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:52.852636 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-e6a24f18-03f8-47a9-bc5d-424ef4e40cfd None None] MFA Rules not processed for user `7735831463154d608399dd940ae0f105`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:52.853910 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-e6a24f18-03f8-47a9-bc5d-424ef4e40cfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:52.914176 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:52.924661 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1332/2676] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:31:52 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:31:52.935526 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48be0b-48bf-4b41-8b4d-977cf9502d2f admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:52.937239 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-bb48be0b-48bf-4b41-8b4d-977cf9502d2f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:52.997494 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb48be0b-48bf-4b41-8b4d-977cf9502d2f admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:53.002287 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8a2008-3582-41ab-92fb-767563716132 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:53.002927 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a2008-3582-41ab-92fb-767563716132 service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:53.003212 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a2008-3582-41ab-92fb-767563716132 service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:53.003485 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8a2008-3582-41ab-92fb-767563716132 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:53.012364 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a2008-3582-41ab-92fb-767563716132 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:53.013869 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8a2008-3582-41ab-92fb-767563716132 service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:53.024193 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1345/2677] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:31:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:31:53.045307 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a24f18-03f8-47a9-bc5d-424ef4e40cfd None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:53.105997 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a24f18-03f8-47a9-bc5d-424ef4e40cfd None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:53.110480 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d48c71-d18b-4cd5-a2da-201e5aae6b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:53.111170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d48c71-d18b-4cd5-a2da-201e5aae6b38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:53.111445 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d48c71-d18b-4cd5-a2da-201e5aae6b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:53.111714 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d48c71-d18b-4cd5-a2da-201e5aae6b38 admin admin] PATH_INFO: `/v3/users/7735831463154d608399dd940ae0f105` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:53.112901 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d48c71-d18b-4cd5-a2da-201e5aae6b38 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7735831463154d608399dd940ae0f105)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:53.114787 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d48c71-d18b-4cd5-a2da-201e5aae6b38 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:53.159264 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-f6d48c71-d18b-4cd5-a2da-201e5aae6b38 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7735831463154d608399dd940ae0f105'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:53.170579 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-f6d48c71-d18b-4cd5-a2da-201e5aae6b38 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7735831463154d608399dd940ae0f105'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:53.171266 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-f6d48c71-d18b-4cd5-a2da-201e5aae6b38 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7735831463154d608399dd940ae0f105'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:53.171877 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-f6d48c71-d18b-4cd5-a2da-201e5aae6b38 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7735831463154d608399dd940ae0f105'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:53.178853 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-f6d48c71-d18b-4cd5-a2da-201e5aae6b38 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7735831463154d608399dd940ae0f105'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:53.191143 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1333/2678] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:31:53 2022] DELETE /identity/v3/users/7735831463154d608399dd940ae0f105 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:31:53.195694 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a666233-fb95-4b03-b110-551c205468b6 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:53.195980 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a666233-fb95-4b03-b110-551c205468b6 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:53.196258 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a666233-fb95-4b03-b110-551c205468b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:53.216832 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-5a666233-fb95-4b03-b110-551c205468b6 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:53.218017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-5a666233-fb95-4b03-b110-551c205468b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:53.286130 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1346/2679] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:31:53.295855 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d48c71-d18b-4cd5-a2da-201e5aae6b38 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:53.297379 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-f6d48c71-d18b-4cd5-a2da-201e5aae6b38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:53.357178 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d48c71-d18b-4cd5-a2da-201e5aae6b38 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:53.361353 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a5feb50-d9f7-4904-8b92-6c75d21a0228 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:53.361969 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5feb50-d9f7-4904-8b92-6c75d21a0228 service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:53.362248 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5feb50-d9f7-4904-8b92-6c75d21a0228 service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:53.362521 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a5feb50-d9f7-4904-8b92-6c75d21a0228 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:53.371774 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5feb50-d9f7-4904-8b92-6c75d21a0228 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:53.373233 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a5feb50-d9f7-4904-8b92-6c75d21a0228 service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:53.383943 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1334/2680] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:31:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:31:53.810902 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a666233-fb95-4b03-b110-551c205468b6 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:53.812445 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-5a666233-fb95-4b03-b110-551c205468b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:53.825011 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a666233-fb95-4b03-b110-551c205468b6 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:53.837509 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6d70e4-dccb-49a7-8000-816f810249a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:53.838452 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d70e4-dccb-49a7-8000-816f810249a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:53.839435 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d70e4-dccb-49a7-8000-816f810249a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:53.839918 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6d70e4-dccb-49a7-8000-816f810249a2 admin admin] PATH_INFO: `/v3/projects/ee7e7c112caa46d4a5150ce517235f4f` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:53.841439 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d70e4-dccb-49a7-8000-816f810249a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee7e7c112caa46d4a5150ce517235f4f)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:53.843717 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b6d70e4-dccb-49a7-8000-816f810249a2 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:53.898936 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1b6d70e4-dccb-49a7-8000-816f810249a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee7e7c112caa46d4a5150ce517235f4f', 'request_id': 'req-1b6d70e4-dccb-49a7-8000-816f810249a2'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:53.904787 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:INSERT=2,keystone:SELECT=92,keystone:DELETE=6 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:53.910164 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1b6d70e4-dccb-49a7-8000-816f810249a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee7e7c112caa46d4a5150ce517235f4f', 'request_id': 'req-1b6d70e4-dccb-49a7-8000-816f810249a2'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:53.919813 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1b6d70e4-dccb-49a7-8000-816f810249a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee7e7c112caa46d4a5150ce517235f4f', 'request_id': 'req-1b6d70e4-dccb-49a7-8000-816f810249a2'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:53.933760 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1b6d70e4-dccb-49a7-8000-816f810249a2 admin admin] The token cache is being invalidate because project ee7e7c112caa46d4a5150ce517235f4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:31:53.934032 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1b6d70e4-dccb-49a7-8000-816f810249a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:53.934742 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1b6d70e4-dccb-49a7-8000-816f810249a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:53.936310 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1347/2681] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:31:53 2022] DELETE /identity/v3/projects/ee7e7c112caa46d4a5150ce517235f4f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:31:53.941283 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74dda4-1a3b-4dab-846c-7c6e4ce254a0 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:53.941806 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74dda4-1a3b-4dab-846c-7c6e4ce254a0 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:53.941907 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed74dda4-1a3b-4dab-846c-7c6e4ce254a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:53.960810 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-ed74dda4-1a3b-4dab-846c-7c6e4ce254a0 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:53.962251 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-ed74dda4-1a3b-4dab-846c-7c6e4ce254a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:53.976939 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:54.030957 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1335/2682] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:31:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:31:54.039175 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cee71-ccb4-492f-b682-dc94e1585bcb None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:54.039459 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cee71-ccb4-492f-b682-dc94e1585bcb None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:54.039736 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7cee71-ccb4-492f-b682-dc94e1585bcb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:54.062326 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-3f7cee71-ccb4-492f-b682-dc94e1585bcb None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:54.063569 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-3f7cee71-ccb4-492f-b682-dc94e1585bcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:54.072410 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1348/2683] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:31:54 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:31:54.076521 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74dda4-1a3b-4dab-846c-7c6e4ce254a0 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:54.086875 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed74dda4-1a3b-4dab-846c-7c6e4ce254a0 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:54.093752 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f72c3-0a66-439f-8ef8-9ec4990f93ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:54.094363 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f72c3-0a66-439f-8ef8-9ec4990f93ca admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:54.094637 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f72c3-0a66-439f-8ef8-9ec4990f93ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:54.094906 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74f72c3-0a66-439f-8ef8-9ec4990f93ca admin admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:54.096222 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74f72c3-0a66-439f-8ef8-9ec4990f93ca admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:31:54.096556 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74f72c3-0a66-439f-8ef8-9ec4990f93ca admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:54.098138 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a74f72c3-0a66-439f-8ef8-9ec4990f93ca admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:54.113836 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1336/2684] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:31:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:31:54.118398 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cee71-ccb4-492f-b682-dc94e1585bcb None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:54.128854 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7cee71-ccb4-492f-b682-dc94e1585bcb None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:54.133794 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e364bb6-e8fe-4f8e-a262-d6f57a92d6a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:54.134423 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e364bb6-e8fe-4f8e-a262-d6f57a92d6a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:54.134711 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e364bb6-e8fe-4f8e-a262-d6f57a92d6a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:54.134992 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e364bb6-e8fe-4f8e-a262-d6f57a92d6a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:54.135666 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e364bb6-e8fe-4f8e-a262-d6f57a92d6a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:54.137676 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e364bb6-e8fe-4f8e-a262-d6f57a92d6a0 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:54.171709 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1349/2685] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:31:54 2022] POST /identity/v3/projects => generated 383 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:31:54.176029 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f72c3-0a66-439f-8ef8-9ec4990f93ca admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:54.186743 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a74f72c3-0a66-439f-8ef8-9ec4990f93ca admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:54.244186 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddecf263-cf34-46a2-8814-c4bf0db77592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:54.244841 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecf263-cf34-46a2-8814-c4bf0db77592 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:54.245171 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecf263-cf34-46a2-8814-c4bf0db77592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:54.245454 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddecf263-cf34-46a2-8814-c4bf0db77592 admin admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:54.246170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddecf263-cf34-46a2-8814-c4bf0db77592 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:54.248229 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddecf263-cf34-46a2-8814-c4bf0db77592 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:54.273093 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1337/2686] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:31:54 2022] POST /identity/v3/users => generated 292 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:31:54.277190 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e364bb6-e8fe-4f8e-a262-d6f57a92d6a0 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:54.288141 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e364bb6-e8fe-4f8e-a262-d6f57a92d6a0 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:54.292908 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef62c7-2a3e-4de3-94e8-6e82b9890bf8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:54.293521 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef62c7-2a3e-4de3-94e8-6e82b9890bf8 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:54.293808 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef62c7-2a3e-4de3-94e8-6e82b9890bf8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:54.294079 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ef62c7-2a3e-4de3-94e8-6e82b9890bf8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:54.294774 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef62c7-2a3e-4de3-94e8-6e82b9890bf8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:54.296396 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04ef62c7-2a3e-4de3-94e8-6e82b9890bf8 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:54.311069 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1350/2687] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:31:54.312568 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddecf263-cf34-46a2-8814-c4bf0db77592 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:54.324277 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddecf263-cf34-46a2-8814-c4bf0db77592 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:54.330742 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b0508b-4969-41bb-967d-874bb9a1616c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:54.331659 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0508b-4969-41bb-967d-874bb9a1616c admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:54.331949 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0508b-4969-41bb-967d-874bb9a1616c admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:54.332240 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b0508b-4969-41bb-967d-874bb9a1616c admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:54.332974 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b0508b-4969-41bb-967d-874bb9a1616c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:54.334709 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b0508b-4969-41bb-967d-874bb9a1616c admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:54.347322 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1338/2688] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:31:54 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:31:54.351649 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef62c7-2a3e-4de3-94e8-6e82b9890bf8 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:54.362739 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04ef62c7-2a3e-4de3-94e8-6e82b9890bf8 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:54.367691 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585efe86-1f6c-465c-9dd7-6ea10b475f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:54.368384 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585efe86-1f6c-465c-9dd7-6ea10b475f0a admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:54.368666 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585efe86-1f6c-465c-9dd7-6ea10b475f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:54.368939 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585efe86-1f6c-465c-9dd7-6ea10b475f0a admin admin] PATH_INFO: `/v3/projects/c57c1e759ab6472b9e24cab21bbf7267/users/fe18d880f56f4e72939d46e73da887d6/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:54.386335 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585efe86-1f6c-465c-9dd7-6ea10b475f0a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c57c1e759ab6472b9e24cab21bbf7267, user_id=fe18d880f56f4e72939d46e73da887d6, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:54.389000 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585efe86-1f6c-465c-9dd7-6ea10b475f0a admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:54.402121 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1351/2689] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:31:54 2022] PUT /identity/v3/projects/c57c1e759ab6472b9e24cab21bbf7267/users/fe18d880f56f4e72939d46e73da887d6/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:31:54.413563 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558005f-c91f-4df9-a62d-e84882181f32 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:54.413850 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558005f-c91f-4df9-a62d-e84882181f32 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:54.414155 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5558005f-c91f-4df9-a62d-e84882181f32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:54.443382 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-5558005f-c91f-4df9-a62d-e84882181f32 None None] MFA Rules not processed for user `fe18d880f56f4e72939d46e73da887d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:54.444633 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-5558005f-c91f-4df9-a62d-e84882181f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:54.509135 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1339/2690] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:31:54 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:31:54.520501 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585efe86-1f6c-465c-9dd7-6ea10b475f0a admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:54.522162 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-585efe86-1f6c-465c-9dd7-6ea10b475f0a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:54.578624 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585efe86-1f6c-465c-9dd7-6ea10b475f0a admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:54.582285 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92f45e-0e2f-41e2-b06f-3cc38b41cbab service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:54.582900 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92f45e-0e2f-41e2-b06f-3cc38b41cbab service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:54.583183 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92f45e-0e2f-41e2-b06f-3cc38b41cbab service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:54.583461 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92f45e-0e2f-41e2-b06f-3cc38b41cbab service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:54.591813 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f92f45e-0e2f-41e2-b06f-3cc38b41cbab service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:54.593253 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f92f45e-0e2f-41e2-b06f-3cc38b41cbab service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:54.602741 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1352/2691] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:31:54 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:31:56.407298 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558005f-c91f-4df9-a62d-e84882181f32 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:56.409646 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-5558005f-c91f-4df9-a62d-e84882181f32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:56.423478 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:56.466660 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5558005f-c91f-4df9-a62d-e84882181f32 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:56.470838 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c03be-619c-4cdf-b2b7-75a63731f1cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:56.471520 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c03be-619c-4cdf-b2b7-75a63731f1cc service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:56.471803 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c03be-619c-4cdf-b2b7-75a63731f1cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:56.472077 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9c03be-619c-4cdf-b2b7-75a63731f1cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:56.473829 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-ce9c03be-619c-4cdf-b2b7-75a63731f1cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:56.536593 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9c03be-619c-4cdf-b2b7-75a63731f1cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:56.538480 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9c03be-619c-4cdf-b2b7-75a63731f1cc service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:56.549118 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1340/2692] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:31:56 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:31:59.441435 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92f45e-0e2f-41e2-b06f-3cc38b41cbab service cinder] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:59.442966 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-7f92f45e-0e2f-41e2-b06f-3cc38b41cbab service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:59.457312 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92f45e-0e2f-41e2-b06f-3cc38b41cbab service cinder] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:59.462447 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38458c3c-d895-4d20-964c-68953a61247f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:59.463081 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38458c3c-d895-4d20-964c-68953a61247f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:59.463356 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38458c3c-d895-4d20-964c-68953a61247f admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:59.463627 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38458c3c-d895-4d20-964c-68953a61247f admin admin] PATH_INFO: `/v3/users/3d47613c7085460da42e2179625b3f16` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:59.464810 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38458c3c-d895-4d20-964c-68953a61247f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d47613c7085460da42e2179625b3f16)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:59.466696 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38458c3c-d895-4d20-964c-68953a61247f admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:59.512016 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-38458c3c-d895-4d20-964c-68953a61247f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d47613c7085460da42e2179625b3f16'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:59.524275 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-38458c3c-d895-4d20-964c-68953a61247f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d47613c7085460da42e2179625b3f16'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:59.524974 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-38458c3c-d895-4d20-964c-68953a61247f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d47613c7085460da42e2179625b3f16'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:59.525572 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-38458c3c-d895-4d20-964c-68953a61247f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d47613c7085460da42e2179625b3f16'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:59.533354 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-38458c3c-d895-4d20-964c-68953a61247f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d47613c7085460da42e2179625b3f16'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:59.538723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=85,keystone:INSERT=4,keystone:DELETE=11 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:59.547873 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1353/2693] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:31:59 2022] DELETE /identity/v3/users/3d47613c7085460da42e2179625b3f16 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:31:59.718200 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c03be-619c-4cdf-b2b7-75a63731f1cc service neutron] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:31:59.729539 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9c03be-619c-4cdf-b2b7-75a63731f1cc service neutron] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:31:59.787633 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd6f077-2f4f-45cf-a974-17b4edf3bde8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:31:59.788192 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6f077-2f4f-45cf-a974-17b4edf3bde8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:59.788510 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6f077-2f4f-45cf-a974-17b4edf3bde8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:59.788789 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd6f077-2f4f-45cf-a974-17b4edf3bde8 admin admin] PATH_INFO: `/v3/projects/6873a99b9878495895acb21ed2133bb6` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:59.789961 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd6f077-2f4f-45cf-a974-17b4edf3bde8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6873a99b9878495895acb21ed2133bb6)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:31:59.791839 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd6f077-2f4f-45cf-a974-17b4edf3bde8 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:31:59.836842 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-dcd6f077-2f4f-45cf-a974-17b4edf3bde8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6873a99b9878495895acb21ed2133bb6', 'request_id': 'req-dcd6f077-2f4f-45cf-a974-17b4edf3bde8'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:59.842549 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-dcd6f077-2f4f-45cf-a974-17b4edf3bde8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6873a99b9878495895acb21ed2133bb6', 'request_id': 'req-dcd6f077-2f4f-45cf-a974-17b4edf3bde8'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:59.850233 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-dcd6f077-2f4f-45cf-a974-17b4edf3bde8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6873a99b9878495895acb21ed2133bb6', 'request_id': 'req-dcd6f077-2f4f-45cf-a974-17b4edf3bde8'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:59.851392 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:31:59.864996 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-dcd6f077-2f4f-45cf-a974-17b4edf3bde8 admin admin] The token cache is being invalidate because project 6873a99b9878495895acb21ed2133bb6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:31:59.865281 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-dcd6f077-2f4f-45cf-a974-17b4edf3bde8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:59.865913 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-dcd6f077-2f4f-45cf-a974-17b4edf3bde8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:31:59.867398 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1341/2694] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:31:59 2022] DELETE /identity/v3/projects/6873a99b9878495895acb21ed2133bb6 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:31:59.872280 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca009cb-f160-4c31-bac2-15805ae355c0 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:59.872587 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca009cb-f160-4c31-bac2-15805ae355c0 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:59.872885 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca009cb-f160-4c31-bac2-15805ae355c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:59.892404 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-dca009cb-f160-4c31-bac2-15805ae355c0 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:59.893668 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-dca009cb-f160-4c31-bac2-15805ae355c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:59.952433 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1354/2695] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:31:59.960479 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac387989-87ae-4547-b254-20198b25610a None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:31:59.960771 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac387989-87ae-4547-b254-20198b25610a None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:31:59.961044 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac387989-87ae-4547-b254-20198b25610a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:31:59.980790 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-ac387989-87ae-4547-b254-20198b25610a None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:31:59.981981 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-ac387989-87ae-4547-b254-20198b25610a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:31:59.990991 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1342/2696] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:31:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:31:59.995130 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca009cb-f160-4c31-bac2-15805ae355c0 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:00.005508 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca009cb-f160-4c31-bac2-15805ae355c0 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:00.010097 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf066492-2273-4fac-901f-a94a6920e296 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:00.010704 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf066492-2273-4fac-901f-a94a6920e296 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:00.011003 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf066492-2273-4fac-901f-a94a6920e296 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:00.011263 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf066492-2273-4fac-901f-a94a6920e296 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:00.011956 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf066492-2273-4fac-901f-a94a6920e296 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:32:00.012261 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf066492-2273-4fac-901f-a94a6920e296 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:00.013991 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf066492-2273-4fac-901f-a94a6920e296 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:00.025998 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1355/2697] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:31:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:32:00.030183 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac387989-87ae-4547-b254-20198b25610a None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:00.040468 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac387989-87ae-4547-b254-20198b25610a None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:00.045052 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72658dc4-cf6f-4386-ab7d-1c6094ded451 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:00.045647 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72658dc4-cf6f-4386-ab7d-1c6094ded451 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:00.045926 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72658dc4-cf6f-4386-ab7d-1c6094ded451 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:00.046198 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72658dc4-cf6f-4386-ab7d-1c6094ded451 admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:00.046869 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72658dc4-cf6f-4386-ab7d-1c6094ded451 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:00.049289 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72658dc4-cf6f-4386-ab7d-1c6094ded451 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:00.075434 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1343/2698] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:32:00 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:32:00.080050 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf066492-2273-4fac-901f-a94a6920e296 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:00.090183 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf066492-2273-4fac-901f-a94a6920e296 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:00.147205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da07fd-7190-4a39-88e4-dd5738a93ec8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:00.147821 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da07fd-7190-4a39-88e4-dd5738a93ec8 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:00.148110 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da07fd-7190-4a39-88e4-dd5738a93ec8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:00.148421 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39da07fd-7190-4a39-88e4-dd5738a93ec8 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:00.149094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39da07fd-7190-4a39-88e4-dd5738a93ec8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:00.151252 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39da07fd-7190-4a39-88e4-dd5738a93ec8 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:00.172581 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1356/2699] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:32:00 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:32:00.176919 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72658dc4-cf6f-4386-ab7d-1c6094ded451 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:00.186930 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72658dc4-cf6f-4386-ab7d-1c6094ded451 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:00.191445 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a708e8-cfba-4e94-9029-7a31bfc1ad07 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:00.192047 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a708e8-cfba-4e94-9029-7a31bfc1ad07 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:00.192336 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a708e8-cfba-4e94-9029-7a31bfc1ad07 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:00.192615 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a708e8-cfba-4e94-9029-7a31bfc1ad07 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:00.193298 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a708e8-cfba-4e94-9029-7a31bfc1ad07 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:00.194863 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a708e8-cfba-4e94-9029-7a31bfc1ad07 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:00.205277 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1344/2700] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:32:00.209979 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da07fd-7190-4a39-88e4-dd5738a93ec8 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:00.221331 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39da07fd-7190-4a39-88e4-dd5738a93ec8 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:00.226101 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-059ed1dd-245c-4921-8d1b-65ebf20458aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:00.226713 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ed1dd-245c-4921-8d1b-65ebf20458aa admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:00.227088 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ed1dd-245c-4921-8d1b-65ebf20458aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:00.227382 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-059ed1dd-245c-4921-8d1b-65ebf20458aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:00.228114 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059ed1dd-245c-4921-8d1b-65ebf20458aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:00.229846 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-059ed1dd-245c-4921-8d1b-65ebf20458aa admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:00.240987 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1357/2701] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:32:00 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:32:00.245261 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a708e8-cfba-4e94-9029-7a31bfc1ad07 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:00.255753 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a708e8-cfba-4e94-9029-7a31bfc1ad07 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:00.260576 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f398f-8133-4b74-994f-43ede0b4bf61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:00.261423 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f398f-8133-4b74-994f-43ede0b4bf61 admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:00.261707 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f398f-8133-4b74-994f-43ede0b4bf61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:00.261981 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f398f-8133-4b74-994f-43ede0b4bf61 admin admin] PATH_INFO: `/v3/projects/aa1ddae651ae43b8858dda78df091ee7/users/b44894dc37cb4461931fdb80745efc58/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:00.277552 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f398f-8133-4b74-994f-43ede0b4bf61 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aa1ddae651ae43b8858dda78df091ee7, user_id=b44894dc37cb4461931fdb80745efc58, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:00.280459 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f398f-8133-4b74-994f-43ede0b4bf61 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:00.294905 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1345/2702] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:32:00 2022] PUT /identity/v3/projects/aa1ddae651ae43b8858dda78df091ee7/users/b44894dc37cb4461931fdb80745efc58/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:32:00.305557 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447372c-95de-47a7-b4a9-16aa9c6681a2 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:00.305907 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447372c-95de-47a7-b4a9-16aa9c6681a2 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:00.306185 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b447372c-95de-47a7-b4a9-16aa9c6681a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:00.341842 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-b447372c-95de-47a7-b4a9-16aa9c6681a2 None None] MFA Rules not processed for user `b44894dc37cb4461931fdb80745efc58`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:32:00.343134 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-b447372c-95de-47a7-b4a9-16aa9c6681a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:00.410746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:00.433022 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1358/2703] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:32:00 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:32:00.445142 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f398f-8133-4b74-994f-43ede0b4bf61 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:00.447017 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-168f398f-8133-4b74-994f-43ede0b4bf61 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:00.528905 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f398f-8133-4b74-994f-43ede0b4bf61 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:00.535731 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f514e94-c3a1-4e6c-a3b7-f015f122782e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:00.536479 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f514e94-c3a1-4e6c-a3b7-f015f122782e service nova] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:00.536765 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f514e94-c3a1-4e6c-a3b7-f015f122782e service nova] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:00.537035 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f514e94-c3a1-4e6c-a3b7-f015f122782e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:00.548618 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f514e94-c3a1-4e6c-a3b7-f015f122782e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:00.550483 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f514e94-c3a1-4e6c-a3b7-f015f122782e service nova] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:00.559746 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1346/2704] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:32:00 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:32:03.049687 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447372c-95de-47a7-b4a9-16aa9c6681a2 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:03.051112 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-b447372c-95de-47a7-b4a9-16aa9c6681a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:03.118476 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b447372c-95de-47a7-b4a9-16aa9c6681a2 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:03.122905 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95754c94-0694-4589-8ec3-4022de20aaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:03.123538 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95754c94-0694-4589-8ec3-4022de20aaff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:03.123820 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95754c94-0694-4589-8ec3-4022de20aaff admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:03.124092 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95754c94-0694-4589-8ec3-4022de20aaff admin admin] PATH_INFO: `/v3/users/fe18d880f56f4e72939d46e73da887d6` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:03.125264 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95754c94-0694-4589-8ec3-4022de20aaff admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe18d880f56f4e72939d46e73da887d6)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:03.127696 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95754c94-0694-4589-8ec3-4022de20aaff admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:03.172735 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-95754c94-0694-4589-8ec3-4022de20aaff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe18d880f56f4e72939d46e73da887d6'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:03.184293 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-95754c94-0694-4589-8ec3-4022de20aaff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe18d880f56f4e72939d46e73da887d6'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:03.184976 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-95754c94-0694-4589-8ec3-4022de20aaff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe18d880f56f4e72939d46e73da887d6'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:03.185565 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-95754c94-0694-4589-8ec3-4022de20aaff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe18d880f56f4e72939d46e73da887d6'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:03.192847 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-95754c94-0694-4589-8ec3-4022de20aaff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe18d880f56f4e72939d46e73da887d6'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:03.205460 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1359/2705] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:32:03 2022] DELETE /identity/v3/users/fe18d880f56f4e72939d46e73da887d6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:32:03.209850 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e444c4-ef5a-4923-bfc8-7be10eca8ec8 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:03.210316 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e444c4-ef5a-4923-bfc8-7be10eca8ec8 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:03.210436 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e444c4-ef5a-4923-bfc8-7be10eca8ec8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:03.229419 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-20e444c4-ef5a-4923-bfc8-7be10eca8ec8 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:32:03.230596 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-20e444c4-ef5a-4923-bfc8-7be10eca8ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:03.288166 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1347/2706] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:32:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:32:03.297661 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95754c94-0694-4589-8ec3-4022de20aaff admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:03.299712 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-95754c94-0694-4589-8ec3-4022de20aaff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:03.359794 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95754c94-0694-4589-8ec3-4022de20aaff admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:03.363471 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18f4383-9e7d-46e0-9501-0cabaf874964 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:03.364094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f4383-9e7d-46e0-9501-0cabaf874964 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:03.364406 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f4383-9e7d-46e0-9501-0cabaf874964 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:03.364681 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18f4383-9e7d-46e0-9501-0cabaf874964 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:03.373646 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f4383-9e7d-46e0-9501-0cabaf874964 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:03.375001 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18f4383-9e7d-46e0-9501-0cabaf874964 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:03.384293 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1360/2707] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:32:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:32:03.658403 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e444c4-ef5a-4923-bfc8-7be10eca8ec8 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:03.659872 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-20e444c4-ef5a-4923-bfc8-7be10eca8ec8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:03.671792 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e444c4-ef5a-4923-bfc8-7be10eca8ec8 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:03.676717 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3e6d32-c7d0-423f-9510-3ff9a417370b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:03.677350 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e6d32-c7d0-423f-9510-3ff9a417370b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:03.677625 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e6d32-c7d0-423f-9510-3ff9a417370b admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:03.677896 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3e6d32-c7d0-423f-9510-3ff9a417370b admin admin] PATH_INFO: `/v3/projects/c57c1e759ab6472b9e24cab21bbf7267` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:03.679039 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e6d32-c7d0-423f-9510-3ff9a417370b admin admin] RBAC: Authorizing `identity:delete_project(project_id=c57c1e759ab6472b9e24cab21bbf7267)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:03.680958 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3e6d32-c7d0-423f-9510-3ff9a417370b admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:03.693398 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:03.729597 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-2b3e6d32-c7d0-423f-9510-3ff9a417370b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c57c1e759ab6472b9e24cab21bbf7267', 'request_id': 'req-2b3e6d32-c7d0-423f-9510-3ff9a417370b'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:03.735137 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-2b3e6d32-c7d0-423f-9510-3ff9a417370b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c57c1e759ab6472b9e24cab21bbf7267', 'request_id': 'req-2b3e6d32-c7d0-423f-9510-3ff9a417370b'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:03.743437 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-2b3e6d32-c7d0-423f-9510-3ff9a417370b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c57c1e759ab6472b9e24cab21bbf7267', 'request_id': 'req-2b3e6d32-c7d0-423f-9510-3ff9a417370b'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:03.755556 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-2b3e6d32-c7d0-423f-9510-3ff9a417370b admin admin] The token cache is being invalidate because project c57c1e759ab6472b9e24cab21bbf7267 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:32:03.755845 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-2b3e6d32-c7d0-423f-9510-3ff9a417370b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:03.756502 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-2b3e6d32-c7d0-423f-9510-3ff9a417370b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:03.757991 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1348/2708] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:32:03 2022] DELETE /identity/v3/projects/c57c1e759ab6472b9e24cab21bbf7267 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:32:03.762787 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1013d8-08ea-4e87-938f-01a13348979d None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:03.763076 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1013d8-08ea-4e87-938f-01a13348979d None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:03.763351 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce1013d8-08ea-4e87-938f-01a13348979d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:03.784099 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-ce1013d8-08ea-4e87-938f-01a13348979d None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:32:03.785339 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-ce1013d8-08ea-4e87-938f-01a13348979d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:03.793546 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:03.847986 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1361/2709] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:32:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:32:03.855637 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0311787-8d67-4aef-80cd-a84118141784 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:03.855928 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0311787-8d67-4aef-80cd-a84118141784 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:03.856207 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0311787-8d67-4aef-80cd-a84118141784 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:03.877325 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-f0311787-8d67-4aef-80cd-a84118141784 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:32:03.878737 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-f0311787-8d67-4aef-80cd-a84118141784 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:03.886533 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1349/2710] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:32:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:32:03.890570 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1013d8-08ea-4e87-938f-01a13348979d None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:03.900300 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce1013d8-08ea-4e87-938f-01a13348979d None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:03.904852 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112970c8-da60-435b-9ebd-eb86f6e7ca22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:03.905458 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112970c8-da60-435b-9ebd-eb86f6e7ca22 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:03.905737 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112970c8-da60-435b-9ebd-eb86f6e7ca22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:03.906008 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112970c8-da60-435b-9ebd-eb86f6e7ca22 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:03.906702 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112970c8-da60-435b-9ebd-eb86f6e7ca22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:32:03.907002 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112970c8-da60-435b-9ebd-eb86f6e7ca22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:03.908607 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112970c8-da60-435b-9ebd-eb86f6e7ca22 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:03.920110 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1362/2711] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:32:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:32:03.924856 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0311787-8d67-4aef-80cd-a84118141784 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:03.934162 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0311787-8d67-4aef-80cd-a84118141784 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:03.939488 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa88a3-e839-48b4-b91f-ba8b5cfb8e10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:03.940082 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa88a3-e839-48b4-b91f-ba8b5cfb8e10 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:03.940387 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa88a3-e839-48b4-b91f-ba8b5cfb8e10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:03.940661 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aa88a3-e839-48b4-b91f-ba8b5cfb8e10 admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:03.941352 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa88a3-e839-48b4-b91f-ba8b5cfb8e10 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:03.943226 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71aa88a3-e839-48b4-b91f-ba8b5cfb8e10 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:03.969594 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1350/2712] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:32:03 2022] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:32:03.973661 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112970c8-da60-435b-9ebd-eb86f6e7ca22 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:03.983357 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112970c8-da60-435b-9ebd-eb86f6e7ca22 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:04.037922 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4dfdc-094b-4e5d-b3c4-9eccd9d5500b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:04.038520 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4dfdc-094b-4e5d-b3c4-9eccd9d5500b admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:04.038913 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4dfdc-094b-4e5d-b3c4-9eccd9d5500b admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:04.039165 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcf4dfdc-094b-4e5d-b3c4-9eccd9d5500b admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:04.039734 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4dfdc-094b-4e5d-b3c4-9eccd9d5500b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:04.041753 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcf4dfdc-094b-4e5d-b3c4-9eccd9d5500b admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:04.063091 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1363/2713] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:32:03 2022] POST /identity/v3/users => generated 285 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:32:04.068064 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa88a3-e839-48b4-b91f-ba8b5cfb8e10 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:04.078290 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71aa88a3-e839-48b4-b91f-ba8b5cfb8e10 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:04.082913 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f62a04-3aa0-4dd7-8587-70953e760ffc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:04.083519 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f62a04-3aa0-4dd7-8587-70953e760ffc admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:04.083800 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f62a04-3aa0-4dd7-8587-70953e760ffc admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:04.084078 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f62a04-3aa0-4dd7-8587-70953e760ffc admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:04.084816 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f62a04-3aa0-4dd7-8587-70953e760ffc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:04.086405 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2f62a04-3aa0-4dd7-8587-70953e760ffc admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:04.096487 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1351/2714] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:32:04.100591 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4dfdc-094b-4e5d-b3c4-9eccd9d5500b admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:04.110945 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcf4dfdc-094b-4e5d-b3c4-9eccd9d5500b admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:04.115483 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e51335a-d884-413a-a91a-e2eb4b43dc7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:04.116077 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51335a-d884-413a-a91a-e2eb4b43dc7b admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:04.116381 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51335a-d884-413a-a91a-e2eb4b43dc7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:04.116655 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e51335a-d884-413a-a91a-e2eb4b43dc7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:04.117339 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51335a-d884-413a-a91a-e2eb4b43dc7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:04.118888 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e51335a-d884-413a-a91a-e2eb4b43dc7b admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:04.129881 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1364/2715] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:32:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:32:04.133779 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f62a04-3aa0-4dd7-8587-70953e760ffc admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:04.144578 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f62a04-3aa0-4dd7-8587-70953e760ffc admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:04.149203 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26aba1-a718-42a7-86c6-63b708c9c7a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:04.149859 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26aba1-a718-42a7-86c6-63b708c9c7a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:04.150140 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26aba1-a718-42a7-86c6-63b708c9c7a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:04.150419 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd26aba1-a718-42a7-86c6-63b708c9c7a9 admin admin] PATH_INFO: `/v3/projects/7e03689c17ed437f889489552bc95ee7/users/a5fbf90cb88e485fab63c06642f53bec/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:04.165180 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd26aba1-a718-42a7-86c6-63b708c9c7a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e03689c17ed437f889489552bc95ee7, user_id=a5fbf90cb88e485fab63c06642f53bec, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:04.167800 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd26aba1-a718-42a7-86c6-63b708c9c7a9 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:04.180969 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1352/2716] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:32:04 2022] PUT /identity/v3/projects/7e03689c17ed437f889489552bc95ee7/users/a5fbf90cb88e485fab63c06642f53bec/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:32:04.191280 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bce1a4-8ac8-49a1-839e-7bbdf80ba1d7 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:04.191621 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bce1a4-8ac8-49a1-839e-7bbdf80ba1d7 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:04.191899 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bce1a4-8ac8-49a1-839e-7bbdf80ba1d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:04.218711 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-c8bce1a4-8ac8-49a1-839e-7bbdf80ba1d7 None None] MFA Rules not processed for user `a5fbf90cb88e485fab63c06642f53bec`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:32:04.220467 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-c8bce1a4-8ac8-49a1-839e-7bbdf80ba1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:04.284552 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1365/2717] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:32:04 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:32:04.296149 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26aba1-a718-42a7-86c6-63b708c9c7a9 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:04.298509 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-fd26aba1-a718-42a7-86c6-63b708c9c7a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:04.377105 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd26aba1-a718-42a7-86c6-63b708c9c7a9 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:04.380807 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54158087-5759-4195-8507-52b703a47f2e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c09080c507f4c35b81d482cfbaa6a88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:04.381355 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54158087-5759-4195-8507-52b703a47f2e service glance] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:04.381621 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54158087-5759-4195-8507-52b703a47f2e service glance] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:04.381890 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54158087-5759-4195-8507-52b703a47f2e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:04.390525 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54158087-5759-4195-8507-52b703a47f2e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:04.392018 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54158087-5759-4195-8507-52b703a47f2e service glance] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:04.401000 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1353/2718] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:32:04 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:32:08.917494 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bce1a4-8ac8-49a1-839e-7bbdf80ba1d7 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:08.917494 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-c8bce1a4-8ac8-49a1-839e-7bbdf80ba1d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:08.928369 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:08.991032 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bce1a4-8ac8-49a1-839e-7bbdf80ba1d7 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:08.995816 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf654e0-ae99-4bb8-a3fa-e9e1bb30e19f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:08.996494 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf654e0-ae99-4bb8-a3fa-e9e1bb30e19f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:08.996775 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf654e0-ae99-4bb8-a3fa-e9e1bb30e19f admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:08.997052 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf654e0-ae99-4bb8-a3fa-e9e1bb30e19f admin admin] PATH_INFO: `/v3/users/b44894dc37cb4461931fdb80745efc58` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:08.998208 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf654e0-ae99-4bb8-a3fa-e9e1bb30e19f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b44894dc37cb4461931fdb80745efc58)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:09.000121 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf654e0-ae99-4bb8-a3fa-e9e1bb30e19f admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:09.051114 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-2bf654e0-ae99-4bb8-a3fa-e9e1bb30e19f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b44894dc37cb4461931fdb80745efc58'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:09.064426 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-2bf654e0-ae99-4bb8-a3fa-e9e1bb30e19f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b44894dc37cb4461931fdb80745efc58'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:09.065152 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-2bf654e0-ae99-4bb8-a3fa-e9e1bb30e19f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b44894dc37cb4461931fdb80745efc58'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:09.065748 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-2bf654e0-ae99-4bb8-a3fa-e9e1bb30e19f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b44894dc37cb4461931fdb80745efc58'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:09.073110 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-2bf654e0-ae99-4bb8-a3fa-e9e1bb30e19f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b44894dc37cb4461931fdb80745efc58'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:09.086085 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1366/2719] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:32:08 2022] DELETE /identity/v3/users/b44894dc37cb4461931fdb80745efc58 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:32:09.090648 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffefa762-6bdc-4169-b34a-a497945f9418 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:09.091134 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffefa762-6bdc-4169-b34a-a497945f9418 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:09.091288 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffefa762-6bdc-4169-b34a-a497945f9418 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:09.110306 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-ffefa762-6bdc-4169-b34a-a497945f9418 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:32:09.111541 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-ffefa762-6bdc-4169-b34a-a497945f9418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:09.122845 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:09.177344 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1354/2720] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:32:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:32:09.187027 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf654e0-ae99-4bb8-a3fa-e9e1bb30e19f admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:09.188605 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-2bf654e0-ae99-4bb8-a3fa-e9e1bb30e19f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:09.249976 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf654e0-ae99-4bb8-a3fa-e9e1bb30e19f admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:09.254651 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdbb5b9-83ee-40ac-8ce8-d6aa05d084de service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:09.255293 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbb5b9-83ee-40ac-8ce8-d6aa05d084de service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:09.255570 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbb5b9-83ee-40ac-8ce8-d6aa05d084de service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:09.255841 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdbb5b9-83ee-40ac-8ce8-d6aa05d084de service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:09.264806 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbb5b9-83ee-40ac-8ce8-d6aa05d084de service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:09.266204 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdbb5b9-83ee-40ac-8ce8-d6aa05d084de service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:09.275919 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1367/2721] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:32:09 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:32:09.546743 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffefa762-6bdc-4169-b34a-a497945f9418 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:09.548242 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-ffefa762-6bdc-4169-b34a-a497945f9418 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:09.560562 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffefa762-6bdc-4169-b34a-a497945f9418 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:09.565817 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44929961-2030-49a7-8c50-870f43eb4d01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:09.566457 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44929961-2030-49a7-8c50-870f43eb4d01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:09.566738 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44929961-2030-49a7-8c50-870f43eb4d01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:09.567015 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44929961-2030-49a7-8c50-870f43eb4d01 admin admin] PATH_INFO: `/v3/projects/aa1ddae651ae43b8858dda78df091ee7` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:09.568366 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44929961-2030-49a7-8c50-870f43eb4d01 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aa1ddae651ae43b8858dda78df091ee7)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:09.570258 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44929961-2030-49a7-8c50-870f43eb4d01 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:09.621404 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-44929961-2030-49a7-8c50-870f43eb4d01 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aa1ddae651ae43b8858dda78df091ee7', 'request_id': 'req-44929961-2030-49a7-8c50-870f43eb4d01'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:09.627370 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-44929961-2030-49a7-8c50-870f43eb4d01 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aa1ddae651ae43b8858dda78df091ee7', 'request_id': 'req-44929961-2030-49a7-8c50-870f43eb4d01'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:09.635344 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-44929961-2030-49a7-8c50-870f43eb4d01 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aa1ddae651ae43b8858dda78df091ee7', 'request_id': 'req-44929961-2030-49a7-8c50-870f43eb4d01'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:09.647465 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-44929961-2030-49a7-8c50-870f43eb4d01 admin admin] The token cache is being invalidate because project aa1ddae651ae43b8858dda78df091ee7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:32:09.647683 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-44929961-2030-49a7-8c50-870f43eb4d01 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:09.648304 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-44929961-2030-49a7-8c50-870f43eb4d01 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:09.649833 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1355/2722] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:32:09 2022] DELETE /identity/v3/projects/aa1ddae651ae43b8858dda78df091ee7 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:32:09.654730 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a120cb-66e3-4775-8b9a-7e7f5f23ace4 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:09.655013 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a120cb-66e3-4775-8b9a-7e7f5f23ace4 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:09.655286 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a120cb-66e3-4775-8b9a-7e7f5f23ace4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:09.674922 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-c6a120cb-66e3-4775-8b9a-7e7f5f23ace4 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:32:09.676261 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-c6a120cb-66e3-4775-8b9a-7e7f5f23ace4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:09.703067 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:09.738032 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1368/2723] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:32:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:32:09.745924 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77315c3e-b996-4cec-aa91-2a5e68412d24 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:09.746227 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77315c3e-b996-4cec-aa91-2a5e68412d24 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:09.746507 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77315c3e-b996-4cec-aa91-2a5e68412d24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:09.768858 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-77315c3e-b996-4cec-aa91-2a5e68412d24 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:32:09.770096 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-77315c3e-b996-4cec-aa91-2a5e68412d24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:09.778035 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1356/2724] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:32:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:32:09.782305 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a120cb-66e3-4775-8b9a-7e7f5f23ace4 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:09.791975 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a120cb-66e3-4775-8b9a-7e7f5f23ace4 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:09.796443 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58247cc0-6fae-4319-a142-e3afb5281ee7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:09.797045 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58247cc0-6fae-4319-a142-e3afb5281ee7 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:09.797321 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58247cc0-6fae-4319-a142-e3afb5281ee7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:09.797592 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58247cc0-6fae-4319-a142-e3afb5281ee7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:09.798958 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58247cc0-6fae-4319-a142-e3afb5281ee7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:32:09.799252 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58247cc0-6fae-4319-a142-e3afb5281ee7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:09.800870 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58247cc0-6fae-4319-a142-e3afb5281ee7 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:09.811939 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1369/2725] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:32:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:32:09.816677 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77315c3e-b996-4cec-aa91-2a5e68412d24 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:09.825966 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77315c3e-b996-4cec-aa91-2a5e68412d24 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:09.830788 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c278ec8-b91f-42bf-9c96-6b490bd8c83b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:09.834004 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c278ec8-b91f-42bf-9c96-6b490bd8c83b admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:09.834309 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c278ec8-b91f-42bf-9c96-6b490bd8c83b admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:09.834545 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c278ec8-b91f-42bf-9c96-6b490bd8c83b admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:09.835761 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c278ec8-b91f-42bf-9c96-6b490bd8c83b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:09.837546 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c278ec8-b91f-42bf-9c96-6b490bd8c83b admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:09.865995 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1357/2726] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:32:09 2022] POST /identity/v3/projects => generated 405 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:32:09.870411 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58247cc0-6fae-4319-a142-e3afb5281ee7 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:09.881130 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58247cc0-6fae-4319-a142-e3afb5281ee7 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:09.937937 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645bd043-f3cf-431a-a966-9d39b24fc1b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:09.939784 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645bd043-f3cf-431a-a966-9d39b24fc1b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:09.939784 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645bd043-f3cf-431a-a966-9d39b24fc1b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:09.939784 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645bd043-f3cf-431a-a966-9d39b24fc1b8 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:09.940466 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645bd043-f3cf-431a-a966-9d39b24fc1b8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:09.942368 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645bd043-f3cf-431a-a966-9d39b24fc1b8 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:09.963440 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1370/2727] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:32:09 2022] POST /identity/v3/users => generated 303 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:32:09.967667 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c278ec8-b91f-42bf-9c96-6b490bd8c83b admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:09.983240 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c278ec8-b91f-42bf-9c96-6b490bd8c83b admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:09.989178 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3529b9-3936-40ad-a735-5de4f7836644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:09.989817 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3529b9-3936-40ad-a735-5de4f7836644 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:09.990098 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3529b9-3936-40ad-a735-5de4f7836644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:09.990368 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3529b9-3936-40ad-a735-5de4f7836644 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:09.991059 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3529b9-3936-40ad-a735-5de4f7836644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:09.992768 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3529b9-3936-40ad-a735-5de4f7836644 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:10.003732 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1358/2728] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:32:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:32:10.007757 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645bd043-f3cf-431a-a966-9d39b24fc1b8 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:10.017971 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645bd043-f3cf-431a-a966-9d39b24fc1b8 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:10.022701 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd17010-1318-407b-bed4-1135abe62c22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:10.023331 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd17010-1318-407b-bed4-1135abe62c22 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:10.023615 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd17010-1318-407b-bed4-1135abe62c22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:10.023896 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd17010-1318-407b-bed4-1135abe62c22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:10.024730 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd17010-1318-407b-bed4-1135abe62c22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:10.026324 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd17010-1318-407b-bed4-1135abe62c22 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:10.037950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1371/2729] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:32:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:32:10.041934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3529b9-3936-40ad-a735-5de4f7836644 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:10.057179 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3529b9-3936-40ad-a735-5de4f7836644 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:10.063452 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80dfb7-8b27-43f1-be63-ee759eaa6d6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:10.064873 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80dfb7-8b27-43f1-be63-ee759eaa6d6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:10.065113 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80dfb7-8b27-43f1-be63-ee759eaa6d6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:10.065390 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c80dfb7-8b27-43f1-be63-ee759eaa6d6e admin admin] PATH_INFO: `/v3/projects/1541a453a7884d9da6a2f1345c405867/users/db289472edcb4d73be91553fab4b08e9/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:10.081359 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80dfb7-8b27-43f1-be63-ee759eaa6d6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1541a453a7884d9da6a2f1345c405867, user_id=db289472edcb4d73be91553fab4b08e9, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:10.084008 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c80dfb7-8b27-43f1-be63-ee759eaa6d6e admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:10.097601 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1359/2730] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:32:10 2022] PUT /identity/v3/projects/1541a453a7884d9da6a2f1345c405867/users/db289472edcb4d73be91553fab4b08e9/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:32:10.102768 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca419a-667f-4141-87a8-14d956c48723 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:10.103059 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca419a-667f-4141-87a8-14d956c48723 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:10.103335 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca419a-667f-4141-87a8-14d956c48723 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:10.123450 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-ceca419a-667f-4141-87a8-14d956c48723 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:32:10.124782 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-ceca419a-667f-4141-87a8-14d956c48723 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:10.185990 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1372/2731] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:32:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:32:10.196090 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80dfb7-8b27-43f1-be63-ee759eaa6d6e admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:10.197880 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-1c80dfb7-8b27-43f1-be63-ee759eaa6d6e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:10.241046 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:10.257410 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c80dfb7-8b27-43f1-be63-ee759eaa6d6e admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:10.260956 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1487d143-db20-4df6-90e8-61b387d143f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:10.261561 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487d143-db20-4df6-90e8-61b387d143f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:10.261837 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487d143-db20-4df6-90e8-61b387d143f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:10.262106 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1487d143-db20-4df6-90e8-61b387d143f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:10.271683 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1487d143-db20-4df6-90e8-61b387d143f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:10.273233 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1487d143-db20-4df6-90e8-61b387d143f3 service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:10.284360 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1360/2732] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:32:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:32:11.196882 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec694968-24c8-445c-8503-a3ec43db0a75 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:11.197418 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec694968-24c8-445c-8503-a3ec43db0a75 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:11.197550 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec694968-24c8-445c-8503-a3ec43db0a75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:11.226350 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-ec694968-24c8-445c-8503-a3ec43db0a75 None None] MFA Rules not processed for user `db289472edcb4d73be91553fab4b08e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:32:11.227684 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-ec694968-24c8-445c-8503-a3ec43db0a75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:11.263020 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:11.306333 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1373/2733] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:32:11 2022] POST /identity/v3/auth/tokens => generated 3282 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:32:11.310839 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1487d143-db20-4df6-90e8-61b387d143f3 service neutron] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:11.321589 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1487d143-db20-4df6-90e8-61b387d143f3 service neutron] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:11.326065 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933521e8-33b2-49b4-b416-bd92a56d25af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:11.326682 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933521e8-33b2-49b4-b416-bd92a56d25af admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:11.326942 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933521e8-33b2-49b4-b416-bd92a56d25af admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:11.327350 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-933521e8-33b2-49b4-b416-bd92a56d25af admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:11.328131 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933521e8-33b2-49b4-b416-bd92a56d25af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:11.330166 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-933521e8-33b2-49b4-b416-bd92a56d25af admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:11.361941 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1361/2734] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:32:11 2022] POST /identity/v3/projects => generated 405 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:32:11.362998 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec694968-24c8-445c-8503-a3ec43db0a75 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:11.374731 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec694968-24c8-445c-8503-a3ec43db0a75 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:11.433808 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525527a-d701-4204-9308-dd4d26158a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:11.434425 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525527a-d701-4204-9308-dd4d26158a35 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:11.434699 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525527a-d701-4204-9308-dd4d26158a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:11.434969 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1525527a-d701-4204-9308-dd4d26158a35 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:11.435622 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1525527a-d701-4204-9308-dd4d26158a35 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:11.437549 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1525527a-d701-4204-9308-dd4d26158a35 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:11.458473 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1374/2735] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:32:11 2022] POST /identity/v3/users => generated 309 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:32:11.462757 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933521e8-33b2-49b4-b416-bd92a56d25af admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:11.473035 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-933521e8-33b2-49b4-b416-bd92a56d25af admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:11.479011 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16458a44-5193-406e-a86f-d8532e1c0c89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:11.479635 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16458a44-5193-406e-a86f-d8532e1c0c89 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:11.479917 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16458a44-5193-406e-a86f-d8532e1c0c89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:11.480195 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16458a44-5193-406e-a86f-d8532e1c0c89 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:11.480942 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16458a44-5193-406e-a86f-d8532e1c0c89 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:11.482662 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16458a44-5193-406e-a86f-d8532e1c0c89 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:11.494798 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1362/2736] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:32:11.499094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525527a-d701-4204-9308-dd4d26158a35 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:11.509995 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1525527a-d701-4204-9308-dd4d26158a35 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:11.514753 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009b57a-8802-4f80-a132-6b027b56d355 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:11.515410 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009b57a-8802-4f80-a132-6b027b56d355 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:11.515687 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009b57a-8802-4f80-a132-6b027b56d355 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:11.515957 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3009b57a-8802-4f80-a132-6b027b56d355 admin admin] PATH_INFO: `/v3/projects/bdb4bcb880144d0e99a2a776097bfee9/users/d858f300c1fd46248516d6ecb71ccee4/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:11.530553 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009b57a-8802-4f80-a132-6b027b56d355 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdb4bcb880144d0e99a2a776097bfee9, user_id=d858f300c1fd46248516d6ecb71ccee4, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:11.533294 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3009b57a-8802-4f80-a132-6b027b56d355 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:11.546103 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1375/2737] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:32:11 2022] PUT /identity/v3/projects/bdb4bcb880144d0e99a2a776097bfee9/users/d858f300c1fd46248516d6ecb71ccee4/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:32:11.552071 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16458a44-5193-406e-a86f-d8532e1c0c89 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:11.567460 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16458a44-5193-406e-a86f-d8532e1c0c89 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:11.622139 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9e8227-fbb8-4b8b-b5e1-b1b20f8757f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:11.622680 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e8227-fbb8-4b8b-b5e1-b1b20f8757f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:11.622960 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e8227-fbb8-4b8b-b5e1-b1b20f8757f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:11.623235 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9e8227-fbb8-4b8b-b5e1-b1b20f8757f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:11.623917 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e8227-fbb8-4b8b-b5e1-b1b20f8757f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:11.625530 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9e8227-fbb8-4b8b-b5e1-b1b20f8757f9 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:11.643208 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1363/2738] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:32:11 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:32:11.644196 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009b57a-8802-4f80-a132-6b027b56d355 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:11.654502 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3009b57a-8802-4f80-a132-6b027b56d355 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:11.659633 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42244e17-7660-4cbc-a37d-0805d4493cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:11.660289 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42244e17-7660-4cbc-a37d-0805d4493cb1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:11.660599 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42244e17-7660-4cbc-a37d-0805d4493cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:11.660874 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42244e17-7660-4cbc-a37d-0805d4493cb1 admin admin] PATH_INFO: `/v3/projects/bdb4bcb880144d0e99a2a776097bfee9/users/d858f300c1fd46248516d6ecb71ccee4/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:11.662801 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42244e17-7660-4cbc-a37d-0805d4493cb1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdb4bcb880144d0e99a2a776097bfee9, user_id=d858f300c1fd46248516d6ecb71ccee4, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:11.665452 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42244e17-7660-4cbc-a37d-0805d4493cb1 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:11.676213 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1376/2739] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:32:11 2022] PUT /identity/v3/projects/bdb4bcb880144d0e99a2a776097bfee9/users/d858f300c1fd46248516d6ecb71ccee4/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:32:12.337912 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cf740-e6ba-4d0e-8cab-869195c565b1 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:12.338481 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cf740-e6ba-4d0e-8cab-869195c565b1 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:12.338481 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10cf740-e6ba-4d0e-8cab-869195c565b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:12.369662 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-a10cf740-e6ba-4d0e-8cab-869195c565b1 None None] MFA Rules not processed for user `d858f300c1fd46248516d6ecb71ccee4`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:32:12.370907 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-a10cf740-e6ba-4d0e-8cab-869195c565b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:12.455635 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1364/2740] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:32:12 2022] POST /identity/v3/auth/tokens => generated 3349 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:32:13.733151 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42244e17-7660-4cbc-a37d-0805d4493cb1 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:13.801138 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42244e17-7660-4cbc-a37d-0805d4493cb1 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:13.805621 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d156d35-df4d-41db-b5d0-eeac5bf044de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:13.806257 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d156d35-df4d-41db-b5d0-eeac5bf044de admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:13.806542 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d156d35-df4d-41db-b5d0-eeac5bf044de admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:13.806819 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d156d35-df4d-41db-b5d0-eeac5bf044de admin admin] PATH_INFO: `/v3/users/db289472edcb4d73be91553fab4b08e9` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:13.807971 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d156d35-df4d-41db-b5d0-eeac5bf044de admin admin] RBAC: Authorizing `identity:delete_user(user_id=db289472edcb4d73be91553fab4b08e9)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:13.809935 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d156d35-df4d-41db-b5d0-eeac5bf044de admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:13.835955 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=92,keystone:INSERT=5,keystone:DELETE=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:13.865118 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9d156d35-df4d-41db-b5d0-eeac5bf044de admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db289472edcb4d73be91553fab4b08e9'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:13.877359 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9d156d35-df4d-41db-b5d0-eeac5bf044de admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db289472edcb4d73be91553fab4b08e9'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:13.878097 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9d156d35-df4d-41db-b5d0-eeac5bf044de admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db289472edcb4d73be91553fab4b08e9'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:13.878704 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9d156d35-df4d-41db-b5d0-eeac5bf044de admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db289472edcb4d73be91553fab4b08e9'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:13.885842 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-9d156d35-df4d-41db-b5d0-eeac5bf044de admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db289472edcb4d73be91553fab4b08e9'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:13.898143 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1377/2741] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:32:13 2022] DELETE /identity/v3/users/db289472edcb4d73be91553fab4b08e9 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:32:14.078375 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10cf740-e6ba-4d0e-8cab-869195c565b1 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:14.089654 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10cf740-e6ba-4d0e-8cab-869195c565b1 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:14.118183 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:14.148272 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff7f74-b6fe-4a89-b61d-2dae65291787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:14.148933 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff7f74-b6fe-4a89-b61d-2dae65291787 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:14.149214 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff7f74-b6fe-4a89-b61d-2dae65291787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:14.149485 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ff7f74-b6fe-4a89-b61d-2dae65291787 admin admin] PATH_INFO: `/v3/projects/1541a453a7884d9da6a2f1345c405867` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:14.150652 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff7f74-b6fe-4a89-b61d-2dae65291787 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1541a453a7884d9da6a2f1345c405867)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:14.152644 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ff7f74-b6fe-4a89-b61d-2dae65291787 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:14.202139 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-36ff7f74-b6fe-4a89-b61d-2dae65291787 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1541a453a7884d9da6a2f1345c405867', 'request_id': 'req-36ff7f74-b6fe-4a89-b61d-2dae65291787'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:14.208224 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-36ff7f74-b6fe-4a89-b61d-2dae65291787 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1541a453a7884d9da6a2f1345c405867', 'request_id': 'req-36ff7f74-b6fe-4a89-b61d-2dae65291787'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:14.215686 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-36ff7f74-b6fe-4a89-b61d-2dae65291787 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1541a453a7884d9da6a2f1345c405867', 'request_id': 'req-36ff7f74-b6fe-4a89-b61d-2dae65291787'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:14.226707 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-36ff7f74-b6fe-4a89-b61d-2dae65291787 admin admin] The token cache is being invalidate because project 1541a453a7884d9da6a2f1345c405867 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:32:14.226998 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-36ff7f74-b6fe-4a89-b61d-2dae65291787 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:14.227628 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-36ff7f74-b6fe-4a89-b61d-2dae65291787 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:14.229157 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1365/2742] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:32:14 2022] DELETE /identity/v3/projects/1541a453a7884d9da6a2f1345c405867 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:32:14.233199 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d156d35-df4d-41db-b5d0-eeac5bf044de admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:14.234583 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9d156d35-df4d-41db-b5d0-eeac5bf044de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:14.247523 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d156d35-df4d-41db-b5d0-eeac5bf044de admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:14.310656 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d15b8ed-52fc-45b9-974b-1c30356bb1a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:14.311310 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15b8ed-52fc-45b9-974b-1c30356bb1a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:14.311717 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15b8ed-52fc-45b9-974b-1c30356bb1a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:14.311897 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d15b8ed-52fc-45b9-974b-1c30356bb1a9 admin admin] PATH_INFO: `/v3/users/d858f300c1fd46248516d6ecb71ccee4` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:14.313147 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d15b8ed-52fc-45b9-974b-1c30356bb1a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d858f300c1fd46248516d6ecb71ccee4)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:14.316846 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d15b8ed-52fc-45b9-974b-1c30356bb1a9 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:14.365976 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1d15b8ed-52fc-45b9-974b-1c30356bb1a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd858f300c1fd46248516d6ecb71ccee4'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:14.378432 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1d15b8ed-52fc-45b9-974b-1c30356bb1a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd858f300c1fd46248516d6ecb71ccee4'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:14.379040 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1d15b8ed-52fc-45b9-974b-1c30356bb1a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd858f300c1fd46248516d6ecb71ccee4'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:14.379651 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1d15b8ed-52fc-45b9-974b-1c30356bb1a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd858f300c1fd46248516d6ecb71ccee4'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:14.386939 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1d15b8ed-52fc-45b9-974b-1c30356bb1a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd858f300c1fd46248516d6ecb71ccee4'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:14.399021 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1378/2743] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:32:14 2022] DELETE /identity/v3/users/d858f300c1fd46248516d6ecb71ccee4 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:32:14.575910 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff7f74-b6fe-4a89-b61d-2dae65291787 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:14.577377 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-36ff7f74-b6fe-4a89-b61d-2dae65291787 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:14.590659 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ff7f74-b6fe-4a89-b61d-2dae65291787 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:14.650689 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbfab93e-8b74-4696-b7c7-71da07c4bcaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:14.651250 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfab93e-8b74-4696-b7c7-71da07c4bcaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:14.651528 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfab93e-8b74-4696-b7c7-71da07c4bcaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:14.651798 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbfab93e-8b74-4696-b7c7-71da07c4bcaa admin admin] PATH_INFO: `/v3/projects/bdb4bcb880144d0e99a2a776097bfee9` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:14.652963 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfab93e-8b74-4696-b7c7-71da07c4bcaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdb4bcb880144d0e99a2a776097bfee9)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:14.654840 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbfab93e-8b74-4696-b7c7-71da07c4bcaa admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:14.700959 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-bbfab93e-8b74-4696-b7c7-71da07c4bcaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdb4bcb880144d0e99a2a776097bfee9', 'request_id': 'req-bbfab93e-8b74-4696-b7c7-71da07c4bcaa'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:14.707251 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-bbfab93e-8b74-4696-b7c7-71da07c4bcaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdb4bcb880144d0e99a2a776097bfee9', 'request_id': 'req-bbfab93e-8b74-4696-b7c7-71da07c4bcaa'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:14.710095 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:14.716374 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-bbfab93e-8b74-4696-b7c7-71da07c4bcaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdb4bcb880144d0e99a2a776097bfee9', 'request_id': 'req-bbfab93e-8b74-4696-b7c7-71da07c4bcaa'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:14.729868 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-bbfab93e-8b74-4696-b7c7-71da07c4bcaa admin admin] The token cache is being invalidate because project bdb4bcb880144d0e99a2a776097bfee9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:32:14.730147 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-bbfab93e-8b74-4696-b7c7-71da07c4bcaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:14.730795 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-bbfab93e-8b74-4696-b7c7-71da07c4bcaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:14.732276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1366/2744] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:32:14 2022] DELETE /identity/v3/projects/bdb4bcb880144d0e99a2a776097bfee9 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:32:14.737782 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3563f38b-5864-4fd9-8edc-e44b0950fc42 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:14.738297 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3563f38b-5864-4fd9-8edc-e44b0950fc42 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:14.738418 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3563f38b-5864-4fd9-8edc-e44b0950fc42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:14.758732 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-3563f38b-5864-4fd9-8edc-e44b0950fc42 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:32:14.759942 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-3563f38b-5864-4fd9-8edc-e44b0950fc42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:14.771982 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:14.824548 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1379/2745] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:32:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:32:14.832410 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28d183-03c5-4f35-8779-850fa94bec7e None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:14.832698 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28d183-03c5-4f35-8779-850fa94bec7e None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:14.832970 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c28d183-03c5-4f35-8779-850fa94bec7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:14.853908 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-1c28d183-03c5-4f35-8779-850fa94bec7e None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:32:14.855544 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-1c28d183-03c5-4f35-8779-850fa94bec7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:14.863847 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1367/2746] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:32:14 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:32:14.868472 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3563f38b-5864-4fd9-8edc-e44b0950fc42 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:14.879259 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3563f38b-5864-4fd9-8edc-e44b0950fc42 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:14.884160 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e712b4-c4be-44ec-bfae-5931f653d27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:14.884885 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e712b4-c4be-44ec-bfae-5931f653d27e admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:14.885138 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e712b4-c4be-44ec-bfae-5931f653d27e admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:14.885409 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e712b4-c4be-44ec-bfae-5931f653d27e admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:14.886163 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e712b4-c4be-44ec-bfae-5931f653d27e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:32:14.886492 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e712b4-c4be-44ec-bfae-5931f653d27e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:14.888168 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e712b4-c4be-44ec-bfae-5931f653d27e admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:14.900483 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1380/2747] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:32:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:32:14.904926 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c28d183-03c5-4f35-8779-850fa94bec7e None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:14.916851 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c28d183-03c5-4f35-8779-850fa94bec7e None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:14.921679 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd6650-9644-4f42-80ad-f91061daea4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:14.922286 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd6650-9644-4f42-80ad-f91061daea4c admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:14.923160 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd6650-9644-4f42-80ad-f91061daea4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:14.923934 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdd6650-9644-4f42-80ad-f91061daea4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:14.924185 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd6650-9644-4f42-80ad-f91061daea4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:14.926129 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbdd6650-9644-4f42-80ad-f91061daea4c admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:14.953094 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1368/2748] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:32:14 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:32:14.957492 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e712b4-c4be-44ec-bfae-5931f653d27e admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:14.967944 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e712b4-c4be-44ec-bfae-5931f653d27e admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:15.029661 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189bc9b7-0cd5-49ad-bdad-097ec47b280e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:15.030283 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189bc9b7-0cd5-49ad-bdad-097ec47b280e admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:15.030565 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189bc9b7-0cd5-49ad-bdad-097ec47b280e admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:15.030840 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-189bc9b7-0cd5-49ad-bdad-097ec47b280e admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:15.031497 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189bc9b7-0cd5-49ad-bdad-097ec47b280e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:15.034235 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-189bc9b7-0cd5-49ad-bdad-097ec47b280e admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:15.055873 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1381/2749] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:32:14 2022] POST /identity/v3/users => generated 293 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:32:15.059921 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd6650-9644-4f42-80ad-f91061daea4c admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:15.071195 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdd6650-9644-4f42-80ad-f91061daea4c admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:15.076072 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3513d89-6f7c-426a-ba5d-c115b179f376 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:15.076716 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3513d89-6f7c-426a-ba5d-c115b179f376 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:15.076996 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3513d89-6f7c-426a-ba5d-c115b179f376 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:15.077264 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3513d89-6f7c-426a-ba5d-c115b179f376 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:15.077980 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3513d89-6f7c-426a-ba5d-c115b179f376 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:15.080076 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3513d89-6f7c-426a-ba5d-c115b179f376 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:15.090328 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1369/2750] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:32:15.094358 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189bc9b7-0cd5-49ad-bdad-097ec47b280e admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:15.104671 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-189bc9b7-0cd5-49ad-bdad-097ec47b280e admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:15.109135 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4930f4bc-b24e-4142-8410-2c5f379780a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:15.109737 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930f4bc-b24e-4142-8410-2c5f379780a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:15.110016 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930f4bc-b24e-4142-8410-2c5f379780a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:15.110310 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4930f4bc-b24e-4142-8410-2c5f379780a7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:15.111130 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4930f4bc-b24e-4142-8410-2c5f379780a7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:15.112813 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4930f4bc-b24e-4142-8410-2c5f379780a7 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:15.123121 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1382/2751] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:32:15.127223 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3513d89-6f7c-426a-ba5d-c115b179f376 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:15.137072 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3513d89-6f7c-426a-ba5d-c115b179f376 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:15.142325 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395584a-25b1-4537-aeba-19dea42bd206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:15.142972 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395584a-25b1-4537-aeba-19dea42bd206 admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:15.143249 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395584a-25b1-4537-aeba-19dea42bd206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:15.143519 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f395584a-25b1-4537-aeba-19dea42bd206 admin admin] PATH_INFO: `/v3/projects/509ca55bc0bc41309aa6a17dd2df0faa/users/097c8d11dc984044af507e3306a6dc1b/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:15.161689 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f395584a-25b1-4537-aeba-19dea42bd206 admin admin] RBAC: Authorizing `identity:create_grant(project_id=509ca55bc0bc41309aa6a17dd2df0faa, user_id=097c8d11dc984044af507e3306a6dc1b, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:15.164242 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f395584a-25b1-4537-aeba-19dea42bd206 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:15.177594 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1370/2752] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:32:15 2022] PUT /identity/v3/projects/509ca55bc0bc41309aa6a17dd2df0faa/users/097c8d11dc984044af507e3306a6dc1b/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:32:15.187898 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e032e-b27e-49c4-80b9-31cc94107930 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:15.188483 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e032e-b27e-49c4-80b9-31cc94107930 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:15.188770 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-242e032e-b27e-49c4-80b9-31cc94107930 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:15.223120 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-242e032e-b27e-49c4-80b9-31cc94107930 None None] MFA Rules not processed for user `097c8d11dc984044af507e3306a6dc1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:32:15.224352 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-242e032e-b27e-49c4-80b9-31cc94107930 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:15.291564 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1383/2753] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:32:15 2022] POST /identity/v3/auth/tokens => generated 3262 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:32:15.296450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395584a-25b1-4537-aeba-19dea42bd206 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:15.361086 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f395584a-25b1-4537-aeba-19dea42bd206 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:15.373699 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19933847-ea02-4b39-9606-c0debcd45de2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:15.374366 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19933847-ea02-4b39-9606-c0debcd45de2 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:15.374649 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19933847-ea02-4b39-9606-c0debcd45de2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:15.374920 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19933847-ea02-4b39-9606-c0debcd45de2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:15.375596 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19933847-ea02-4b39-9606-c0debcd45de2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:15.377507 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19933847-ea02-4b39-9606-c0debcd45de2 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:15.405010 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1371/2754] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:32:15 2022] POST /identity/v3/projects => generated 387 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:32:15.410079 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e032e-b27e-49c4-80b9-31cc94107930 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:15.420571 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-242e032e-b27e-49c4-80b9-31cc94107930 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:15.429600 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:15.479283 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fad4ee-6b29-499d-a517-774780836835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:15.479900 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fad4ee-6b29-499d-a517-774780836835 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:15.480179 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fad4ee-6b29-499d-a517-774780836835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:15.480492 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fad4ee-6b29-499d-a517-774780836835 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:15.481159 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fad4ee-6b29-499d-a517-774780836835 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:15.483049 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22fad4ee-6b29-499d-a517-774780836835 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:15.505316 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1384/2755] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:32:15 2022] POST /identity/v3/users => generated 300 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:32:15.509254 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19933847-ea02-4b39-9606-c0debcd45de2 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:15.520908 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19933847-ea02-4b39-9606-c0debcd45de2 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:15.525429 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3141e4a-43e8-4359-bcb0-47744c652c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:15.526032 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3141e4a-43e8-4359-bcb0-47744c652c13 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:15.526311 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3141e4a-43e8-4359-bcb0-47744c652c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:15.526583 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3141e4a-43e8-4359-bcb0-47744c652c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:15.527269 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3141e4a-43e8-4359-bcb0-47744c652c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:15.528889 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3141e4a-43e8-4359-bcb0-47744c652c13 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:15.539730 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1372/2756] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:32:15.543748 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fad4ee-6b29-499d-a517-774780836835 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:15.553850 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22fad4ee-6b29-499d-a517-774780836835 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:15.558442 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d672d3-bc9d-4981-acf4-fa14a4f3e4bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:15.559092 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d672d3-bc9d-4981-acf4-fa14a4f3e4bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:15.559368 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d672d3-bc9d-4981-acf4-fa14a4f3e4bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:15.559638 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d672d3-bc9d-4981-acf4-fa14a4f3e4bd admin admin] PATH_INFO: `/v3/projects/d1dcc5343a264a1484bbb998b33c23eb/users/61bac46e970b4d4699cd3ac5155b6046/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:15.574571 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d672d3-bc9d-4981-acf4-fa14a4f3e4bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1dcc5343a264a1484bbb998b33c23eb, user_id=61bac46e970b4d4699cd3ac5155b6046, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:15.577245 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41d672d3-bc9d-4981-acf4-fa14a4f3e4bd admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:15.590834 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1385/2757] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:32:15 2022] PUT /identity/v3/projects/d1dcc5343a264a1484bbb998b33c23eb/users/61bac46e970b4d4699cd3ac5155b6046/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:32:15.594780 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3141e4a-43e8-4359-bcb0-47744c652c13 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:15.604735 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3141e4a-43e8-4359-bcb0-47744c652c13 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:15.663407 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5143c029-1772-4b49-9684-94fe46b549e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:15.664291 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143c029-1772-4b49-9684-94fe46b549e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:15.664615 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143c029-1772-4b49-9684-94fe46b549e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:15.664896 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5143c029-1772-4b49-9684-94fe46b549e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:15.665586 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5143c029-1772-4b49-9684-94fe46b549e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:15.667174 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5143c029-1772-4b49-9684-94fe46b549e8 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:15.668431 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:15.678056 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1373/2758] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:32:15 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:32:15.682700 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d672d3-bc9d-4981-acf4-fa14a4f3e4bd admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:15.693617 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41d672d3-bc9d-4981-acf4-fa14a4f3e4bd admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:15.698175 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4123f0-d967-4757-b735-710c3546f940 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:15.698836 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4123f0-d967-4757-b735-710c3546f940 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:15.699117 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4123f0-d967-4757-b735-710c3546f940 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:15.699394 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4123f0-d967-4757-b735-710c3546f940 admin admin] PATH_INFO: `/v3/projects/d1dcc5343a264a1484bbb998b33c23eb/users/61bac46e970b4d4699cd3ac5155b6046/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:15.701391 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4123f0-d967-4757-b735-710c3546f940 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d1dcc5343a264a1484bbb998b33c23eb, user_id=61bac46e970b4d4699cd3ac5155b6046, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:15.704595 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4123f0-d967-4757-b735-710c3546f940 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:15.714879 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1386/2759] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:32:15 2022] PUT /identity/v3/projects/d1dcc5343a264a1484bbb998b33c23eb/users/61bac46e970b4d4699cd3ac5155b6046/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:32:15.725950 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9a002-06a4-404c-a46f-54631d3c179a None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:15.726238 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9a002-06a4-404c-a46f-54631d3c179a None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:15.726514 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f9a002-06a4-404c-a46f-54631d3c179a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:15.754280 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-27f9a002-06a4-404c-a46f-54631d3c179a None None] MFA Rules not processed for user `61bac46e970b4d4699cd3ac5155b6046`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:32:15.755619 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-27f9a002-06a4-404c-a46f-54631d3c179a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:15.827479 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1374/2760] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:32:15 2022] POST /identity/v3/auth/tokens => generated 3331 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:32:15.839298 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4123f0-d967-4757-b735-710c3546f940 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:15.841049 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-2c4123f0-d967-4757-b735-710c3546f940 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:15.898072 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4123f0-d967-4757-b735-710c3546f940 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:15.901725 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3b1da32-f4ea-4053-93ae-b9fb46bf42eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:15.902334 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1da32-f4ea-4053-93ae-b9fb46bf42eb service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:15.902681 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1da32-f4ea-4053-93ae-b9fb46bf42eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:15.902953 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3b1da32-f4ea-4053-93ae-b9fb46bf42eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:15.911890 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b1da32-f4ea-4053-93ae-b9fb46bf42eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:15.913323 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3b1da32-f4ea-4053-93ae-b9fb46bf42eb service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:15.923784 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1387/2761] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:32:15 2022] GET /identity/v3/auth/tokens => generated 3331 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:32:15.955287 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9a002-06a4-404c-a46f-54631d3c179a None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:16.018485 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f9a002-06a4-404c-a46f-54631d3c179a None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:16.024090 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69023a-98d0-47ea-a3d3-a7a83190422a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:16.024791 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69023a-98d0-47ea-a3d3-a7a83190422a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:16.025073 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69023a-98d0-47ea-a3d3-a7a83190422a admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:16.025345 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b69023a-98d0-47ea-a3d3-a7a83190422a admin admin] PATH_INFO: `/v3/users/097c8d11dc984044af507e3306a6dc1b` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:16.026531 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b69023a-98d0-47ea-a3d3-a7a83190422a admin admin] RBAC: Authorizing `identity:delete_user(user_id=097c8d11dc984044af507e3306a6dc1b)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:16.028461 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b69023a-98d0-47ea-a3d3-a7a83190422a admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:16.074331 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-9b69023a-98d0-47ea-a3d3-a7a83190422a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '097c8d11dc984044af507e3306a6dc1b'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:16.086062 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-9b69023a-98d0-47ea-a3d3-a7a83190422a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '097c8d11dc984044af507e3306a6dc1b'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:16.086749 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-9b69023a-98d0-47ea-a3d3-a7a83190422a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '097c8d11dc984044af507e3306a6dc1b'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:16.087627 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-9b69023a-98d0-47ea-a3d3-a7a83190422a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '097c8d11dc984044af507e3306a6dc1b'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:16.094880 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-9b69023a-98d0-47ea-a3d3-a7a83190422a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '097c8d11dc984044af507e3306a6dc1b'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:16.103338 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:16.108955 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1375/2762] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:32:15 2022] DELETE /identity/v3/users/097c8d11dc984044af507e3306a6dc1b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:32:16.114436 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652b62e-6e8b-4430-8665-fbedae1b296c None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:16.114776 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652b62e-6e8b-4430-8665-fbedae1b296c None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:16.115050 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9652b62e-6e8b-4430-8665-fbedae1b296c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:16.134998 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-9652b62e-6e8b-4430-8665-fbedae1b296c None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:32:16.136197 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9652b62e-6e8b-4430-8665-fbedae1b296c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:16.198687 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1388/2763] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:32:16 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:32:16.208125 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69023a-98d0-47ea-a3d3-a7a83190422a admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:16.209542 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-9b69023a-98d0-47ea-a3d3-a7a83190422a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:16.266968 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b69023a-98d0-47ea-a3d3-a7a83190422a admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:16.270719 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91dfba8-c4e2-4d22-84b1-c21248bde924 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:16.271324 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91dfba8-c4e2-4d22-84b1-c21248bde924 service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:16.271600 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91dfba8-c4e2-4d22-84b1-c21248bde924 service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:16.271877 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91dfba8-c4e2-4d22-84b1-c21248bde924 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:16.280789 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91dfba8-c4e2-4d22-84b1-c21248bde924 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:16.282830 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a91dfba8-c4e2-4d22-84b1-c21248bde924 service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:16.292035 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1376/2764] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:32:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:32:16.564782 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9652b62e-6e8b-4430-8665-fbedae1b296c None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:16.566302 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9652b62e-6e8b-4430-8665-fbedae1b296c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:16.578490 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9652b62e-6e8b-4430-8665-fbedae1b296c None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:16.583680 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79349adb-edfa-4040-914a-80a8c2b12df6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:16.584386 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79349adb-edfa-4040-914a-80a8c2b12df6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:16.584631 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79349adb-edfa-4040-914a-80a8c2b12df6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:16.584930 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79349adb-edfa-4040-914a-80a8c2b12df6 admin admin] PATH_INFO: `/v3/projects/509ca55bc0bc41309aa6a17dd2df0faa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:16.586098 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79349adb-edfa-4040-914a-80a8c2b12df6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=509ca55bc0bc41309aa6a17dd2df0faa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:16.588362 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79349adb-edfa-4040-914a-80a8c2b12df6 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:16.590898 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:16.637536 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-79349adb-edfa-4040-914a-80a8c2b12df6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '509ca55bc0bc41309aa6a17dd2df0faa', 'request_id': 'req-79349adb-edfa-4040-914a-80a8c2b12df6'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:16.643686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-79349adb-edfa-4040-914a-80a8c2b12df6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '509ca55bc0bc41309aa6a17dd2df0faa', 'request_id': 'req-79349adb-edfa-4040-914a-80a8c2b12df6'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:16.650693 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-79349adb-edfa-4040-914a-80a8c2b12df6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '509ca55bc0bc41309aa6a17dd2df0faa', 'request_id': 'req-79349adb-edfa-4040-914a-80a8c2b12df6'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:16.662569 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-79349adb-edfa-4040-914a-80a8c2b12df6 admin admin] The token cache is being invalidate because project 509ca55bc0bc41309aa6a17dd2df0faa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:32:16.662863 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-79349adb-edfa-4040-914a-80a8c2b12df6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:16.663497 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-79349adb-edfa-4040-914a-80a8c2b12df6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:16.665036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1389/2765] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:32:16 2022] DELETE /identity/v3/projects/509ca55bc0bc41309aa6a17dd2df0faa => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:32:16.669209 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91dfba8-c4e2-4d22-84b1-c21248bde924 service neutron] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:16.678744 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91dfba8-c4e2-4d22-84b1-c21248bde924 service neutron] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:16.742204 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f46f28-c60e-43bc-a158-f9e0aae25515 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:16.742770 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f46f28-c60e-43bc-a158-f9e0aae25515 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:16.743050 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f46f28-c60e-43bc-a158-f9e0aae25515 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:16.743325 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f46f28-c60e-43bc-a158-f9e0aae25515 admin admin] PATH_INFO: `/v3/users/61bac46e970b4d4699cd3ac5155b6046` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:16.744543 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f46f28-c60e-43bc-a158-f9e0aae25515 admin admin] RBAC: Authorizing `identity:delete_user(user_id=61bac46e970b4d4699cd3ac5155b6046)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:16.746458 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f46f28-c60e-43bc-a158-f9e0aae25515 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:16.793108 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-b8f46f28-c60e-43bc-a158-f9e0aae25515 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61bac46e970b4d4699cd3ac5155b6046'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:16.805522 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-b8f46f28-c60e-43bc-a158-f9e0aae25515 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61bac46e970b4d4699cd3ac5155b6046'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:16.806253 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-b8f46f28-c60e-43bc-a158-f9e0aae25515 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61bac46e970b4d4699cd3ac5155b6046'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:16.806872 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-b8f46f28-c60e-43bc-a158-f9e0aae25515 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61bac46e970b4d4699cd3ac5155b6046'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:16.814659 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-b8f46f28-c60e-43bc-a158-f9e0aae25515 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61bac46e970b4d4699cd3ac5155b6046'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:16.826774 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1377/2766] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:32:16 2022] DELETE /identity/v3/users/61bac46e970b4d4699cd3ac5155b6046 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:32:17.093109 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79349adb-edfa-4040-914a-80a8c2b12df6 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:17.094576 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-79349adb-edfa-4040-914a-80a8c2b12df6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:17.107744 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79349adb-edfa-4040-914a-80a8c2b12df6 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:17.164881 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b68904-d7bc-4bf4-af59-69b63faf0d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:17.165519 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b68904-d7bc-4bf4-af59-69b63faf0d68 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:17.165797 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b68904-d7bc-4bf4-af59-69b63faf0d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:17.166067 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b68904-d7bc-4bf4-af59-69b63faf0d68 admin admin] PATH_INFO: `/v3/projects/d1dcc5343a264a1484bbb998b33c23eb` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:17.167203 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b68904-d7bc-4bf4-af59-69b63faf0d68 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d1dcc5343a264a1484bbb998b33c23eb)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:17.169122 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b68904-d7bc-4bf4-af59-69b63faf0d68 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:17.221162 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-06b68904-d7bc-4bf4-af59-69b63faf0d68 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd1dcc5343a264a1484bbb998b33c23eb', 'request_id': 'req-06b68904-d7bc-4bf4-af59-69b63faf0d68'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:17.226639 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-06b68904-d7bc-4bf4-af59-69b63faf0d68 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd1dcc5343a264a1484bbb998b33c23eb', 'request_id': 'req-06b68904-d7bc-4bf4-af59-69b63faf0d68'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:17.233976 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-06b68904-d7bc-4bf4-af59-69b63faf0d68 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd1dcc5343a264a1484bbb998b33c23eb', 'request_id': 'req-06b68904-d7bc-4bf4-af59-69b63faf0d68'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:17.245093 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-06b68904-d7bc-4bf4-af59-69b63faf0d68 admin admin] The token cache is being invalidate because project d1dcc5343a264a1484bbb998b33c23eb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:32:17.245378 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-06b68904-d7bc-4bf4-af59-69b63faf0d68 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:17.246000 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-06b68904-d7bc-4bf4-af59-69b63faf0d68 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:17.247494 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1390/2767] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:32:17 2022] DELETE /identity/v3/projects/d1dcc5343a264a1484bbb998b33c23eb => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:32:17.253140 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06699f3-9e27-49da-b78c-af57ee616bd6 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:17.253652 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06699f3-9e27-49da-b78c-af57ee616bd6 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:17.253772 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c06699f3-9e27-49da-b78c-af57ee616bd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:17.273186 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-c06699f3-9e27-49da-b78c-af57ee616bd6 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:32:17.274307 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-c06699f3-9e27-49da-b78c-af57ee616bd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:17.290359 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:17.332772 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1378/2768] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:32:17.340636 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc81c40-1c69-4b50-b737-b53a968c7914 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:17.340928 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc81c40-1c69-4b50-b737-b53a968c7914 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:17.341205 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc81c40-1c69-4b50-b737-b53a968c7914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:17.361293 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-2fc81c40-1c69-4b50-b737-b53a968c7914 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:32:17.362525 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-2fc81c40-1c69-4b50-b737-b53a968c7914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:17.370333 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1391/2769] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:32:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:32:17.374436 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06699f3-9e27-49da-b78c-af57ee616bd6 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:17.384687 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c06699f3-9e27-49da-b78c-af57ee616bd6 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:17.389201 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e41a7-bd76-441d-adc6-bf441e63e6e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:17.389802 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e41a7-bd76-441d-adc6-bf441e63e6e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:17.390083 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e41a7-bd76-441d-adc6-bf441e63e6e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:17.390358 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5e41a7-bd76-441d-adc6-bf441e63e6e8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:17.391049 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e41a7-bd76-441d-adc6-bf441e63e6e8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:32:17.391352 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e41a7-bd76-441d-adc6-bf441e63e6e8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:17.392979 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5e41a7-bd76-441d-adc6-bf441e63e6e8 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:17.404274 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1379/2770] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:32:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:32:17.408542 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc81c40-1c69-4b50-b737-b53a968c7914 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:17.417766 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc81c40-1c69-4b50-b737-b53a968c7914 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:17.422374 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec547f98-c670-4cd7-8d08-96dd94faf46d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:17.423512 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec547f98-c670-4cd7-8d08-96dd94faf46d admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:17.423793 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec547f98-c670-4cd7-8d08-96dd94faf46d admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:17.424069 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec547f98-c670-4cd7-8d08-96dd94faf46d admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:17.424775 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec547f98-c670-4cd7-8d08-96dd94faf46d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:17.426649 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec547f98-c670-4cd7-8d08-96dd94faf46d admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:17.441559 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:17.457199 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1392/2771] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:32:17 2022] POST /identity/v3/projects => generated 361 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:32:17.461413 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e41a7-bd76-441d-adc6-bf441e63e6e8 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:17.472662 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5e41a7-bd76-441d-adc6-bf441e63e6e8 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:17.528242 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489232f-ae94-4103-9dd3-1b7e1e62f9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:17.528803 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489232f-ae94-4103-9dd3-1b7e1e62f9eb admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:17.529080 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489232f-ae94-4103-9dd3-1b7e1e62f9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:17.529350 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e489232f-ae94-4103-9dd3-1b7e1e62f9eb admin admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:17.530008 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e489232f-ae94-4103-9dd3-1b7e1e62f9eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:17.532597 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e489232f-ae94-4103-9dd3-1b7e1e62f9eb admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:17.552128 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1380/2772] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:32:17 2022] POST /identity/v3/users => generated 281 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:32:17.556308 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec547f98-c670-4cd7-8d08-96dd94faf46d admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:17.566403 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec547f98-c670-4cd7-8d08-96dd94faf46d admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:17.571139 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07771e5a-3499-4868-b4ee-d4023f6605c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:17.571741 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07771e5a-3499-4868-b4ee-d4023f6605c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:17.572025 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07771e5a-3499-4868-b4ee-d4023f6605c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:17.572301 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07771e5a-3499-4868-b4ee-d4023f6605c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:17.573079 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07771e5a-3499-4868-b4ee-d4023f6605c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:17.574692 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07771e5a-3499-4868-b4ee-d4023f6605c7 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:17.585201 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1393/2773] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:32:17.589159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489232f-ae94-4103-9dd3-1b7e1e62f9eb admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:17.599405 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e489232f-ae94-4103-9dd3-1b7e1e62f9eb admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:17.603900 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd7603c9-1288-4e68-b24d-bdd11ec9d6d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:17.604531 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7603c9-1288-4e68-b24d-bdd11ec9d6d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:17.604809 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7603c9-1288-4e68-b24d-bdd11ec9d6d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:17.605078 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7603c9-1288-4e68-b24d-bdd11ec9d6d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:17.605751 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7603c9-1288-4e68-b24d-bdd11ec9d6d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:17.607315 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd7603c9-1288-4e68-b24d-bdd11ec9d6d1 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:17.617551 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1381/2774] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:32:17 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:32:17.621518 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07771e5a-3499-4868-b4ee-d4023f6605c7 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:17.631577 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07771e5a-3499-4868-b4ee-d4023f6605c7 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:17.636996 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a5221-8414-4595-8694-c1bb069e7cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:17.637655 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a5221-8414-4595-8694-c1bb069e7cab admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:17.637937 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a5221-8414-4595-8694-c1bb069e7cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:17.638332 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02a5221-8414-4595-8694-c1bb069e7cab admin admin] PATH_INFO: `/v3/projects/4f8e005b413c47ac8bf14c518ae48ccf/users/4f7cf63f403b4aedaa4f860097b5fe9c/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:17.655069 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a5221-8414-4595-8694-c1bb069e7cab admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f8e005b413c47ac8bf14c518ae48ccf, user_id=4f7cf63f403b4aedaa4f860097b5fe9c, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:17.658441 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02a5221-8414-4595-8694-c1bb069e7cab admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:17.671131 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1394/2775] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:32:17 2022] PUT /identity/v3/projects/4f8e005b413c47ac8bf14c518ae48ccf/users/4f7cf63f403b4aedaa4f860097b5fe9c/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:32:17.681457 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0469ce3-11ad-4638-92ef-2a7ae2225ef7 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:17.681735 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0469ce3-11ad-4638-92ef-2a7ae2225ef7 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:17.682003 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0469ce3-11ad-4638-92ef-2a7ae2225ef7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:17.709816 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-e0469ce3-11ad-4638-92ef-2a7ae2225ef7 None None] MFA Rules not processed for user `4f7cf63f403b4aedaa4f860097b5fe9c`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:32:17.711003 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-e0469ce3-11ad-4638-92ef-2a7ae2225ef7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:17.774263 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1382/2776] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:32:17 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:32:17.807057 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a5221-8414-4595-8694-c1bb069e7cab admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:17.808787 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-d02a5221-8414-4595-8694-c1bb069e7cab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:17.867904 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02a5221-8414-4595-8694-c1bb069e7cab admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:17.871615 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2db5293-052e-4be1-b88f-b5651e0765d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:17.872223 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db5293-052e-4be1-b88f-b5651e0765d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:17.872532 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db5293-052e-4be1-b88f-b5651e0765d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:17.872831 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2db5293-052e-4be1-b88f-b5651e0765d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:17.881760 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db5293-052e-4be1-b88f-b5651e0765d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:17.883187 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2db5293-052e-4be1-b88f-b5651e0765d4 service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:17.892444 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1395/2777] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:32:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:32:17.907369 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0469ce3-11ad-4638-92ef-2a7ae2225ef7 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:17.925724 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:17.969202 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0469ce3-11ad-4638-92ef-2a7ae2225ef7 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:17.973712 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15645e42-d6ab-4665-899c-1c2404400f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:17.974333 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15645e42-d6ab-4665-899c-1c2404400f11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:17.974610 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15645e42-d6ab-4665-899c-1c2404400f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:17.974882 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15645e42-d6ab-4665-899c-1c2404400f11 admin admin] PATH_INFO: `/v3/users/4f7cf63f403b4aedaa4f860097b5fe9c` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:17.976025 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15645e42-d6ab-4665-899c-1c2404400f11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f7cf63f403b4aedaa4f860097b5fe9c)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:17.977960 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15645e42-d6ab-4665-899c-1c2404400f11 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:18.025025 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-15645e42-d6ab-4665-899c-1c2404400f11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f7cf63f403b4aedaa4f860097b5fe9c'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:18.036832 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-15645e42-d6ab-4665-899c-1c2404400f11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f7cf63f403b4aedaa4f860097b5fe9c'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:18.037438 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-15645e42-d6ab-4665-899c-1c2404400f11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f7cf63f403b4aedaa4f860097b5fe9c'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:18.038049 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-15645e42-d6ab-4665-899c-1c2404400f11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f7cf63f403b4aedaa4f860097b5fe9c'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:18.044986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-15645e42-d6ab-4665-899c-1c2404400f11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f7cf63f403b4aedaa4f860097b5fe9c'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:18.057762 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1383/2778] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:32:17 2022] DELETE /identity/v3/users/4f7cf63f403b4aedaa4f860097b5fe9c => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:32:18.062228 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed9342-2498-448d-b51d-f16e09083980 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:18.062505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed9342-2498-448d-b51d-f16e09083980 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:18.062804 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aed9342-2498-448d-b51d-f16e09083980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:18.086193 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-0aed9342-2498-448d-b51d-f16e09083980 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:32:18.087654 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-0aed9342-2498-448d-b51d-f16e09083980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:18.147955 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1396/2779] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:32:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:32:18.158151 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15645e42-d6ab-4665-899c-1c2404400f11 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:18.159754 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-15645e42-d6ab-4665-899c-1c2404400f11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:18.217127 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15645e42-d6ab-4665-899c-1c2404400f11 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:18.220805 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e84d9f2-0a94-4b68-85ad-95cca8626bf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:18.221410 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84d9f2-0a94-4b68-85ad-95cca8626bf1 service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:18.221690 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84d9f2-0a94-4b68-85ad-95cca8626bf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:18.221966 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e84d9f2-0a94-4b68-85ad-95cca8626bf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:18.231054 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e84d9f2-0a94-4b68-85ad-95cca8626bf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:18.232502 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e84d9f2-0a94-4b68-85ad-95cca8626bf1 service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:18.242530 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1384/2780] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:32:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:32:18.512188 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed9342-2498-448d-b51d-f16e09083980 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:18.513773 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-0aed9342-2498-448d-b51d-f16e09083980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:18.533407 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aed9342-2498-448d-b51d-f16e09083980 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:18.539491 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7347de22-47c8-4394-b995-59595570a01b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:18.540064 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347de22-47c8-4394-b995-59595570a01b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:18.540267 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347de22-47c8-4394-b995-59595570a01b admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:18.540781 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7347de22-47c8-4394-b995-59595570a01b admin admin] PATH_INFO: `/v3/projects/4f8e005b413c47ac8bf14c518ae48ccf` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:18.541737 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7347de22-47c8-4394-b995-59595570a01b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f8e005b413c47ac8bf14c518ae48ccf)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:18.543615 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7347de22-47c8-4394-b995-59595570a01b admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:18.597505 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-7347de22-47c8-4394-b995-59595570a01b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f8e005b413c47ac8bf14c518ae48ccf', 'request_id': 'req-7347de22-47c8-4394-b995-59595570a01b'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:18.601940 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:INSERT=2,keystone:SELECT=92,keystone:DELETE=6 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:18.603188 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-7347de22-47c8-4394-b995-59595570a01b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f8e005b413c47ac8bf14c518ae48ccf', 'request_id': 'req-7347de22-47c8-4394-b995-59595570a01b'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:18.611580 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-7347de22-47c8-4394-b995-59595570a01b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f8e005b413c47ac8bf14c518ae48ccf', 'request_id': 'req-7347de22-47c8-4394-b995-59595570a01b'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:18.623347 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-7347de22-47c8-4394-b995-59595570a01b admin admin] The token cache is being invalidate because project 4f8e005b413c47ac8bf14c518ae48ccf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:32:18.623632 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-7347de22-47c8-4394-b995-59595570a01b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:18.624247 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-7347de22-47c8-4394-b995-59595570a01b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:18.626017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1397/2781] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:32:18 2022] DELETE /identity/v3/projects/4f8e005b413c47ac8bf14c518ae48ccf => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:32:18.630983 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b3c59-ba2f-474f-a75f-bb9f8358aac4 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:18.631455 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b3c59-ba2f-474f-a75f-bb9f8358aac4 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:18.631552 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e5b3c59-ba2f-474f-a75f-bb9f8358aac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:18.650980 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-4e5b3c59-ba2f-474f-a75f-bb9f8358aac4 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:32:18.652191 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-4e5b3c59-ba2f-474f-a75f-bb9f8358aac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:18.685694 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:18.716189 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1385/2782] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:32:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:32:18.725654 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9490d-7e3c-4182-ac63-09cad8063b53 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:18.725942 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9490d-7e3c-4182-ac63-09cad8063b53 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:18.726217 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d9490d-7e3c-4182-ac63-09cad8063b53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:18.746341 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-e5d9490d-7e3c-4182-ac63-09cad8063b53 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:32:18.747542 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-e5d9490d-7e3c-4182-ac63-09cad8063b53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:18.755386 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1398/2783] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:32:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:32:18.759585 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b3c59-ba2f-474f-a75f-bb9f8358aac4 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:18.769758 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e5b3c59-ba2f-474f-a75f-bb9f8358aac4 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:18.774188 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b3c0c-5556-4ee9-895a-18f57b2f75e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:18.774779 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b3c0c-5556-4ee9-895a-18f57b2f75e3 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:18.775078 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b3c0c-5556-4ee9-895a-18f57b2f75e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:18.775331 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8b3c0c-5556-4ee9-895a-18f57b2f75e3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:18.776016 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b3c0c-5556-4ee9-895a-18f57b2f75e3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80442) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:32:18.776312 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b3c0c-5556-4ee9-895a-18f57b2f75e3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:18.777937 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8b3c0c-5556-4ee9-895a-18f57b2f75e3 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:18.789834 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1386/2784] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:32:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:32:18.794073 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9490d-7e3c-4182-ac63-09cad8063b53 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:18.803917 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d9490d-7e3c-4182-ac63-09cad8063b53 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:18.808568 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb515c4-d0d8-47cc-825f-c901ed7d2ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:18.809171 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb515c4-d0d8-47cc-825f-c901ed7d2ce3 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:18.809451 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb515c4-d0d8-47cc-825f-c901ed7d2ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:18.809725 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb515c4-d0d8-47cc-825f-c901ed7d2ce3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:18.810395 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb515c4-d0d8-47cc-825f-c901ed7d2ce3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:18.812318 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb515c4-d0d8-47cc-825f-c901ed7d2ce3 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:18.839870 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1399/2785] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:32:18 2022] POST /identity/v3/projects => generated 371 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:32:18.844089 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b3c0c-5556-4ee9-895a-18f57b2f75e3 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:18.854284 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8b3c0c-5556-4ee9-895a-18f57b2f75e3 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:18.908605 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7c4c2-d1e6-493c-a44b-209e9b7bd1eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:18.909208 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7c4c2-d1e6-493c-a44b-209e9b7bd1eb admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:18.909485 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7c4c2-d1e6-493c-a44b-209e9b7bd1eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:18.909755 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa7c4c2-d1e6-493c-a44b-209e9b7bd1eb admin admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:18.910403 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7c4c2-d1e6-493c-a44b-209e9b7bd1eb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:18.912292 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa7c4c2-d1e6-493c-a44b-209e9b7bd1eb admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:18.933250 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1387/2786] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:32:18 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:32:18.937350 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb515c4-d0d8-47cc-825f-c901ed7d2ce3 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:18.948689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb515c4-d0d8-47cc-825f-c901ed7d2ce3 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:18.953650 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b4c37-171b-4260-8049-331066009729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:18.954727 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b4c37-171b-4260-8049-331066009729 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:18.955028 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b4c37-171b-4260-8049-331066009729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:18.955393 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687b4c37-171b-4260-8049-331066009729 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:18.956098 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b4c37-171b-4260-8049-331066009729 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:18.957723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687b4c37-171b-4260-8049-331066009729 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:18.967797 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1400/2787] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:32:18.971741 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7c4c2-d1e6-493c-a44b-209e9b7bd1eb admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:18.981461 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa7c4c2-d1e6-493c-a44b-209e9b7bd1eb admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:18.986571 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601c84ab-953d-47ab-80a2-0763dc6fa4c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:18.987168 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c84ab-953d-47ab-80a2-0763dc6fa4c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:18.987444 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c84ab-953d-47ab-80a2-0763dc6fa4c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:18.987715 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601c84ab-953d-47ab-80a2-0763dc6fa4c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:18.988434 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c84ab-953d-47ab-80a2-0763dc6fa4c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:18.990000 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601c84ab-953d-47ab-80a2-0763dc6fa4c4 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:19.000258 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1388/2788] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:32:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:32:19.004840 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b4c37-171b-4260-8049-331066009729 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:19.015168 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687b4c37-171b-4260-8049-331066009729 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:19.020460 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1875c7d9-89c8-4973-ade9-6fd812f8aacc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:19.021116 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875c7d9-89c8-4973-ade9-6fd812f8aacc admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:19.021394 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875c7d9-89c8-4973-ade9-6fd812f8aacc admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:19.021666 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1875c7d9-89c8-4973-ade9-6fd812f8aacc admin admin] PATH_INFO: `/v3/projects/987079573e6c4d488ede5b7f0eb183f2/users/fb2784d053c4408e98e18cc4705daec8/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:19.036579 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1875c7d9-89c8-4973-ade9-6fd812f8aacc admin admin] RBAC: Authorizing `identity:create_grant(project_id=987079573e6c4d488ede5b7f0eb183f2, user_id=fb2784d053c4408e98e18cc4705daec8, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:19.039193 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1875c7d9-89c8-4973-ade9-6fd812f8aacc admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:19.052830 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1401/2789] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:32:19 2022] PUT /identity/v3/projects/987079573e6c4d488ede5b7f0eb183f2/users/fb2784d053c4408e98e18cc4705daec8/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:32:19.062946 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df865c19-96ba-47fe-9a61-9b9558cfb905 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:19.063493 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df865c19-96ba-47fe-9a61-9b9558cfb905 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:19.063852 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df865c19-96ba-47fe-9a61-9b9558cfb905 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:19.091207 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-df865c19-96ba-47fe-9a61-9b9558cfb905 None None] MFA Rules not processed for user `fb2784d053c4408e98e18cc4705daec8`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:32:19.092426 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-df865c19-96ba-47fe-9a61-9b9558cfb905 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:19.153494 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1389/2790] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:32:19 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:32:19.158490 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1875c7d9-89c8-4973-ade9-6fd812f8aacc admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:19.224835 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1875c7d9-89c8-4973-ade9-6fd812f8aacc admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:19.229502 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b68d6-8eb3-46e2-a5e6-cd6f05ab13b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:19.230117 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b68d6-8eb3-46e2-a5e6-cd6f05ab13b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:19.230401 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b68d6-8eb3-46e2-a5e6-cd6f05ab13b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:19.230676 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263b68d6-8eb3-46e2-a5e6-cd6f05ab13b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:19.231334 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b68d6-8eb3-46e2-a5e6-cd6f05ab13b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:19.233256 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263b68d6-8eb3-46e2-a5e6-cd6f05ab13b5 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:19.259457 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1402/2791] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:32:19 2022] POST /identity/v3/projects => generated 373 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:32:19.263481 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df865c19-96ba-47fe-9a61-9b9558cfb905 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:19.274577 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df865c19-96ba-47fe-9a61-9b9558cfb905 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:19.305587 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:19.332246 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efdb461-ab0d-410f-8c31-dc2dd72df3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:19.332884 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdb461-ab0d-410f-8c31-dc2dd72df3dc admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:19.333166 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdb461-ab0d-410f-8c31-dc2dd72df3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:19.333456 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efdb461-ab0d-410f-8c31-dc2dd72df3dc admin admin] PATH_INFO: `/v3/users` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:19.334107 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efdb461-ab0d-410f-8c31-dc2dd72df3dc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:19.336042 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efdb461-ab0d-410f-8c31-dc2dd72df3dc admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:19.357719 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1390/2792] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:32:19 2022] POST /identity/v3/users => generated 293 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:32:19.361806 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b68d6-8eb3-46e2-a5e6-cd6f05ab13b5 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:19.372043 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263b68d6-8eb3-46e2-a5e6-cd6f05ab13b5 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:19.377138 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6f540-aa74-4461-9b74-83d54ea7ad8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:19.377758 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6f540-aa74-4461-9b74-83d54ea7ad8a admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:19.378035 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6f540-aa74-4461-9b74-83d54ea7ad8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:19.378306 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa6f540-aa74-4461-9b74-83d54ea7ad8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:19.379020 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa6f540-aa74-4461-9b74-83d54ea7ad8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:19.380609 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fa6f540-aa74-4461-9b74-83d54ea7ad8a admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:19.390836 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1403/2793] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:32:19 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:32:19.395749 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efdb461-ab0d-410f-8c31-dc2dd72df3dc admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:19.405555 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efdb461-ab0d-410f-8c31-dc2dd72df3dc admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:19.410187 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea727f-487e-45cc-8c6b-6ca7b641ff85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:19.410831 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea727f-487e-45cc-8c6b-6ca7b641ff85 admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:19.411109 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea727f-487e-45cc-8c6b-6ca7b641ff85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:19.411381 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fea727f-487e-45cc-8c6b-6ca7b641ff85 admin admin] PATH_INFO: `/v3/projects/c846e92dcf2e43a681f979a8ea7da44a/users/4fe7390d3b9743209ddacce6d9ef3630/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:19.425803 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea727f-487e-45cc-8c6b-6ca7b641ff85 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c846e92dcf2e43a681f979a8ea7da44a, user_id=4fe7390d3b9743209ddacce6d9ef3630, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:19.428475 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fea727f-487e-45cc-8c6b-6ca7b641ff85 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:19.441613 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1391/2794] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:32:19 2022] PUT /identity/v3/projects/c846e92dcf2e43a681f979a8ea7da44a/users/4fe7390d3b9743209ddacce6d9ef3630/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:32:19.445549 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6f540-aa74-4461-9b74-83d54ea7ad8a admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:19.456249 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa6f540-aa74-4461-9b74-83d54ea7ad8a admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:19.505017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:19.513058 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24c7a71-0e71-415e-9a05-60ec6848a4be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:19.513841 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c7a71-0e71-415e-9a05-60ec6848a4be admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:19.514332 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c7a71-0e71-415e-9a05-60ec6848a4be admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:19.514788 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24c7a71-0e71-415e-9a05-60ec6848a4be admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:19.515492 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c7a71-0e71-415e-9a05-60ec6848a4be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:19.517735 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24c7a71-0e71-415e-9a05-60ec6848a4be admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:19.527455 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1404/2795] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:32:19 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:32:19.531543 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea727f-487e-45cc-8c6b-6ca7b641ff85 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:19.541626 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fea727f-487e-45cc-8c6b-6ca7b641ff85 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:19.546187 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653429d5-4984-48c9-a393-1911d625e892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:19.546832 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653429d5-4984-48c9-a393-1911d625e892 admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:19.547115 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653429d5-4984-48c9-a393-1911d625e892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:19.547981 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653429d5-4984-48c9-a393-1911d625e892 admin admin] PATH_INFO: `/v3/projects/c846e92dcf2e43a681f979a8ea7da44a/users/4fe7390d3b9743209ddacce6d9ef3630/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:19.549986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653429d5-4984-48c9-a393-1911d625e892 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c846e92dcf2e43a681f979a8ea7da44a, user_id=4fe7390d3b9743209ddacce6d9ef3630, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:19.552623 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653429d5-4984-48c9-a393-1911d625e892 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:19.563894 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1392/2796] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:32:19 2022] PUT /identity/v3/projects/c846e92dcf2e43a681f979a8ea7da44a/users/4fe7390d3b9743209ddacce6d9ef3630/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:32:19.574094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b21bfc-96e1-4d47-b225-82cfb4ae71f5 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:19.574378 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b21bfc-96e1-4d47-b225-82cfb4ae71f5 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:19.574650 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b21bfc-96e1-4d47-b225-82cfb4ae71f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:19.604543 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-44b21bfc-96e1-4d47-b225-82cfb4ae71f5 None None] MFA Rules not processed for user `4fe7390d3b9743209ddacce6d9ef3630`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:32:19.605163 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-44b21bfc-96e1-4d47-b225-82cfb4ae71f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:19.675237 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1405/2797] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:32:19 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:32:19.686450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653429d5-4984-48c9-a393-1911d625e892 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:19.689136 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-653429d5-4984-48c9-a393-1911d625e892 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:19.746206 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653429d5-4984-48c9-a393-1911d625e892 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:19.749787 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8506e170-14a5-4542-8d00-24941410bd9f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:19.750382 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506e170-14a5-4542-8d00-24941410bd9f service cinder] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:19.751209 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506e170-14a5-4542-8d00-24941410bd9f service cinder] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:19.751209 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8506e170-14a5-4542-8d00-24941410bd9f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:19.807551 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8506e170-14a5-4542-8d00-24941410bd9f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:19.809011 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8506e170-14a5-4542-8d00-24941410bd9f service cinder] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:19.818719 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1393/2798] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:32:19 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:32:23.391192 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b21bfc-96e1-4d47-b225-82cfb4ae71f5 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:23.455553 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b21bfc-96e1-4d47-b225-82cfb4ae71f5 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:23.460023 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46415473-f99b-4814-8e4e-11c1f638b445 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:23.460683 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46415473-f99b-4814-8e4e-11c1f638b445 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:23.460966 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46415473-f99b-4814-8e4e-11c1f638b445 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:23.461241 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46415473-f99b-4814-8e4e-11c1f638b445 admin admin] PATH_INFO: `/v3/users/fb2784d053c4408e98e18cc4705daec8` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:23.462669 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46415473-f99b-4814-8e4e-11c1f638b445 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fb2784d053c4408e98e18cc4705daec8)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:23.464597 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46415473-f99b-4814-8e4e-11c1f638b445 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:23.510518 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-46415473-f99b-4814-8e4e-11c1f638b445 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fb2784d053c4408e98e18cc4705daec8'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:23.522566 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-46415473-f99b-4814-8e4e-11c1f638b445 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fb2784d053c4408e98e18cc4705daec8'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:23.523224 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-46415473-f99b-4814-8e4e-11c1f638b445 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fb2784d053c4408e98e18cc4705daec8'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:23.523827 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-46415473-f99b-4814-8e4e-11c1f638b445 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fb2784d053c4408e98e18cc4705daec8'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:23.530859 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-46415473-f99b-4814-8e4e-11c1f638b445 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fb2784d053c4408e98e18cc4705daec8'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:23.536615 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:23.544574 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1406/2799] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:32:23 2022] DELETE /identity/v3/users/fb2784d053c4408e98e18cc4705daec8 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:32:23.550022 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecadaf7c-d3d0-48c6-ac17-56f14f97aeb2 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:23.550502 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecadaf7c-d3d0-48c6-ac17-56f14f97aeb2 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:23.550617 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecadaf7c-d3d0-48c6-ac17-56f14f97aeb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:23.569982 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-ecadaf7c-d3d0-48c6-ac17-56f14f97aeb2 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:32:23.571197 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-ecadaf7c-d3d0-48c6-ac17-56f14f97aeb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:23.608002 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:23.630948 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1394/2800] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:32:23 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:32:23.640676 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46415473-f99b-4814-8e4e-11c1f638b445 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:23.642092 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-46415473-f99b-4814-8e4e-11c1f638b445 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:23.699006 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46415473-f99b-4814-8e4e-11c1f638b445 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:23.702606 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4af65-bb5c-45e0-b917-696588623cb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:23.703218 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4af65-bb5c-45e0-b917-696588623cb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:23.703503 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4af65-bb5c-45e0-b917-696588623cb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:23.703782 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c4af65-bb5c-45e0-b917-696588623cb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:23.712972 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c4af65-bb5c-45e0-b917-696588623cb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:23.714383 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c4af65-bb5c-45e0-b917-696588623cb8 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:23.724448 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1407/2801] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:32:23 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:32:24.002852 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecadaf7c-d3d0-48c6-ac17-56f14f97aeb2 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:24.004347 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-ecadaf7c-d3d0-48c6-ac17-56f14f97aeb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:24.017359 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecadaf7c-d3d0-48c6-ac17-56f14f97aeb2 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:24.021878 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c2e8d-855b-4e15-9d3a-3c718fb8e693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:24.022542 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c2e8d-855b-4e15-9d3a-3c718fb8e693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:24.022820 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c2e8d-855b-4e15-9d3a-3c718fb8e693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:24.023265 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0c2e8d-855b-4e15-9d3a-3c718fb8e693 admin admin] PATH_INFO: `/v3/projects/987079573e6c4d488ede5b7f0eb183f2` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:24.024981 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0c2e8d-855b-4e15-9d3a-3c718fb8e693 admin admin] RBAC: Authorizing `identity:delete_project(project_id=987079573e6c4d488ede5b7f0eb183f2)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:24.027081 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0c2e8d-855b-4e15-9d3a-3c718fb8e693 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:24.073443 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-3a0c2e8d-855b-4e15-9d3a-3c718fb8e693 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '987079573e6c4d488ede5b7f0eb183f2', 'request_id': 'req-3a0c2e8d-855b-4e15-9d3a-3c718fb8e693'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:24.079369 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-3a0c2e8d-855b-4e15-9d3a-3c718fb8e693 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '987079573e6c4d488ede5b7f0eb183f2', 'request_id': 'req-3a0c2e8d-855b-4e15-9d3a-3c718fb8e693'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:24.086755 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-3a0c2e8d-855b-4e15-9d3a-3c718fb8e693 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '987079573e6c4d488ede5b7f0eb183f2', 'request_id': 'req-3a0c2e8d-855b-4e15-9d3a-3c718fb8e693'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:24.099513 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-3a0c2e8d-855b-4e15-9d3a-3c718fb8e693 admin admin] The token cache is being invalidate because project 987079573e6c4d488ede5b7f0eb183f2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:32:24.099795 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-3a0c2e8d-855b-4e15-9d3a-3c718fb8e693 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:24.100452 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-3a0c2e8d-855b-4e15-9d3a-3c718fb8e693 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:24.101937 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1395/2802] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:32:24 2022] DELETE /identity/v3/projects/987079573e6c4d488ede5b7f0eb183f2 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:32:24.105932 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4af65-bb5c-45e0-b917-696588623cb8 service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:24.116474 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c4af65-bb5c-45e0-b917-696588623cb8 service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:24.173126 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-462808d8-487e-4a38-b7cc-b1931de55d84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:24.173742 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462808d8-487e-4a38-b7cc-b1931de55d84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:24.173970 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462808d8-487e-4a38-b7cc-b1931de55d84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:24.174265 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-462808d8-487e-4a38-b7cc-b1931de55d84 admin admin] PATH_INFO: `/v3/users/4fe7390d3b9743209ddacce6d9ef3630` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:24.175434 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462808d8-487e-4a38-b7cc-b1931de55d84 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4fe7390d3b9743209ddacce6d9ef3630)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:24.177402 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-462808d8-487e-4a38-b7cc-b1931de55d84 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:24.222562 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-462808d8-487e-4a38-b7cc-b1931de55d84 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4fe7390d3b9743209ddacce6d9ef3630'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:24.234465 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-462808d8-487e-4a38-b7cc-b1931de55d84 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4fe7390d3b9743209ddacce6d9ef3630'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:24.235152 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-462808d8-487e-4a38-b7cc-b1931de55d84 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4fe7390d3b9743209ddacce6d9ef3630'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:24.235905 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-462808d8-487e-4a38-b7cc-b1931de55d84 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4fe7390d3b9743209ddacce6d9ef3630'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:24.243335 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-462808d8-487e-4a38-b7cc-b1931de55d84 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4fe7390d3b9743209ddacce6d9ef3630'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:24.256489 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1408/2803] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:32:24 2022] DELETE /identity/v3/users/4fe7390d3b9743209ddacce6d9ef3630 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:32:24.523495 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c2e8d-855b-4e15-9d3a-3c718fb8e693 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:24.524952 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-3a0c2e8d-855b-4e15-9d3a-3c718fb8e693 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:24.537914 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0c2e8d-855b-4e15-9d3a-3c718fb8e693 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:24.596219 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e47e6e0-f52d-4abf-a1f6-101061945fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:24.596944 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47e6e0-f52d-4abf-a1f6-101061945fdf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:24.597148 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47e6e0-f52d-4abf-a1f6-101061945fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:24.597419 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e47e6e0-f52d-4abf-a1f6-101061945fdf admin admin] PATH_INFO: `/v3/projects/c846e92dcf2e43a681f979a8ea7da44a` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:24.598565 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47e6e0-f52d-4abf-a1f6-101061945fdf admin admin] RBAC: Authorizing `identity:delete_project(project_id=c846e92dcf2e43a681f979a8ea7da44a)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:24.600498 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e47e6e0-f52d-4abf-a1f6-101061945fdf admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:24.647256 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-8e47e6e0-f52d-4abf-a1f6-101061945fdf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c846e92dcf2e43a681f979a8ea7da44a', 'request_id': 'req-8e47e6e0-f52d-4abf-a1f6-101061945fdf'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:24.652662 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-8e47e6e0-f52d-4abf-a1f6-101061945fdf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c846e92dcf2e43a681f979a8ea7da44a', 'request_id': 'req-8e47e6e0-f52d-4abf-a1f6-101061945fdf'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:24.660608 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-8e47e6e0-f52d-4abf-a1f6-101061945fdf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c846e92dcf2e43a681f979a8ea7da44a', 'request_id': 'req-8e47e6e0-f52d-4abf-a1f6-101061945fdf'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:24.662476 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:24.674080 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-8e47e6e0-f52d-4abf-a1f6-101061945fdf admin admin] The token cache is being invalidate because project c846e92dcf2e43a681f979a8ea7da44a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:32:24.674362 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-8e47e6e0-f52d-4abf-a1f6-101061945fdf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:24.674980 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-8e47e6e0-f52d-4abf-a1f6-101061945fdf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:24.676484 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1396/2804] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:32:24 2022] DELETE /identity/v3/projects/c846e92dcf2e43a681f979a8ea7da44a => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:32:24.682760 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9d5d5-08f8-4ca6-a930-ac19b1e07b7e None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:24.683238 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9d5d5-08f8-4ca6-a930-ac19b1e07b7e None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:24.683359 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba9d5d5-08f8-4ca6-a930-ac19b1e07b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:24.703514 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-0ba9d5d5-08f8-4ca6-a930-ac19b1e07b7e None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:32:24.704796 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-0ba9d5d5-08f8-4ca6-a930-ac19b1e07b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:24.716860 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:24.767324 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1409/2805] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:32:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:32:24.774818 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14449ae-0bb8-487e-ab65-081ef9214130 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:24.775108 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14449ae-0bb8-487e-ab65-081ef9214130 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:24.775385 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c14449ae-0bb8-487e-ab65-081ef9214130 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:24.795335 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-c14449ae-0bb8-487e-ab65-081ef9214130 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:32:24.796574 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-c14449ae-0bb8-487e-ab65-081ef9214130 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:24.804637 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1397/2806] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:32:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:32:24.808677 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9d5d5-08f8-4ca6-a930-ac19b1e07b7e None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:24.818218 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba9d5d5-08f8-4ca6-a930-ac19b1e07b7e None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:24.823331 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d71289-e409-4535-a120-eb0a512c7822 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:24.823629 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d71289-e409-4535-a120-eb0a512c7822 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:24.823913 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d71289-e409-4535-a120-eb0a512c7822 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:24.824186 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d71289-e409-4535-a120-eb0a512c7822 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:24.824921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d71289-e409-4535-a120-eb0a512c7822 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:32:24.825227 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d71289-e409-4535-a120-eb0a512c7822 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:24.826853 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d71289-e409-4535-a120-eb0a512c7822 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:24.843765 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1410/2807] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:32:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:32:24.845905 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14449ae-0bb8-487e-ab65-081ef9214130 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:24.855380 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c14449ae-0bb8-487e-ab65-081ef9214130 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:24.860269 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac8f56-dae9-4483-b1e3-74403ec33e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:24.861129 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac8f56-dae9-4483-b1e3-74403ec33e34 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:24.861226 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac8f56-dae9-4483-b1e3-74403ec33e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:24.861494 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ac8f56-dae9-4483-b1e3-74403ec33e34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:24.862219 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac8f56-dae9-4483-b1e3-74403ec33e34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:24.864146 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84ac8f56-dae9-4483-b1e3-74403ec33e34 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:24.890781 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1398/2808] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:32:24 2022] POST /identity/v3/projects => generated 383 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:32:24.895686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d71289-e409-4535-a120-eb0a512c7822 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:24.905823 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d71289-e409-4535-a120-eb0a512c7822 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:24.960564 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af931f2b-75e9-4e66-b0b8-06d84910defb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:24.960930 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af931f2b-75e9-4e66-b0b8-06d84910defb admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:24.961209 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af931f2b-75e9-4e66-b0b8-06d84910defb admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:24.961531 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af931f2b-75e9-4e66-b0b8-06d84910defb admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:24.962449 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af931f2b-75e9-4e66-b0b8-06d84910defb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:24.964348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af931f2b-75e9-4e66-b0b8-06d84910defb admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:24.986881 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1411/2809] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:32:24 2022] POST /identity/v3/users => generated 292 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:32:24.990958 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac8f56-dae9-4483-b1e3-74403ec33e34 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:25.001085 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ac8f56-dae9-4483-b1e3-74403ec33e34 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:25.005661 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7eb1d9-b212-4db9-b673-1f76139ef5cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:25.006296 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7eb1d9-b212-4db9-b673-1f76139ef5cd admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:25.006575 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7eb1d9-b212-4db9-b673-1f76139ef5cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:25.006846 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7eb1d9-b212-4db9-b673-1f76139ef5cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:25.007536 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7eb1d9-b212-4db9-b673-1f76139ef5cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:25.009322 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7eb1d9-b212-4db9-b673-1f76139ef5cd admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:25.020826 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1399/2810] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:32:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:32:25.025133 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af931f2b-75e9-4e66-b0b8-06d84910defb admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:25.035901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af931f2b-75e9-4e66-b0b8-06d84910defb admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:25.040535 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a39cdd-12a8-4f96-aa93-bf9a4ddcfa85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:25.041140 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a39cdd-12a8-4f96-aa93-bf9a4ddcfa85 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:25.041418 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a39cdd-12a8-4f96-aa93-bf9a4ddcfa85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:25.041689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a39cdd-12a8-4f96-aa93-bf9a4ddcfa85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:25.042376 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a39cdd-12a8-4f96-aa93-bf9a4ddcfa85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:25.043950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a39cdd-12a8-4f96-aa93-bf9a4ddcfa85 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:25.054518 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1412/2811] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:32:25.058646 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7eb1d9-b212-4db9-b673-1f76139ef5cd admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:25.069031 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7eb1d9-b212-4db9-b673-1f76139ef5cd admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:25.073640 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b7159-579e-4da2-91a5-761783002725 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:25.074301 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b7159-579e-4da2-91a5-761783002725 admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:25.074587 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b7159-579e-4da2-91a5-761783002725 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:25.074861 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64b7159-579e-4da2-91a5-761783002725 admin admin] PATH_INFO: `/v3/projects/806ef085ed364a94a6668332486fc3a9/users/ac3942005cb74a659ba390b57df135e9/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:25.090058 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b7159-579e-4da2-91a5-761783002725 admin admin] RBAC: Authorizing `identity:create_grant(project_id=806ef085ed364a94a6668332486fc3a9, user_id=ac3942005cb74a659ba390b57df135e9, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:25.092764 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64b7159-579e-4da2-91a5-761783002725 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:25.106638 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1400/2812] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:32:25 2022] PUT /identity/v3/projects/806ef085ed364a94a6668332486fc3a9/users/ac3942005cb74a659ba390b57df135e9/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:32:25.117139 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d21e7-ca5a-4176-8a22-3dbfa23f80ee None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:25.117434 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d21e7-ca5a-4176-8a22-3dbfa23f80ee None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:25.117740 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d47d21e7-ca5a-4176-8a22-3dbfa23f80ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:25.146435 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-d47d21e7-ca5a-4176-8a22-3dbfa23f80ee None None] MFA Rules not processed for user `ac3942005cb74a659ba390b57df135e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:32:25.147653 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-d47d21e7-ca5a-4176-8a22-3dbfa23f80ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:25.210973 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1413/2813] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:32:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:32:25.215790 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b7159-579e-4da2-91a5-761783002725 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:25.283047 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64b7159-579e-4da2-91a5-761783002725 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:25.287672 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088f288-b739-4cad-952e-cca0d3813f6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:25.288276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088f288-b739-4cad-952e-cca0d3813f6c admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:25.288584 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088f288-b739-4cad-952e-cca0d3813f6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:25.288856 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d088f288-b739-4cad-952e-cca0d3813f6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:25.289513 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d088f288-b739-4cad-952e-cca0d3813f6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:25.291400 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d088f288-b739-4cad-952e-cca0d3813f6c admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:25.318247 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1401/2814] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:32:25 2022] POST /identity/v3/projects => generated 383 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:32:25.322526 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d21e7-ca5a-4176-8a22-3dbfa23f80ee None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:25.334065 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d47d21e7-ca5a-4176-8a22-3dbfa23f80ee None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:25.343092 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:25.394133 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966760b-e9b9-49bc-b43b-fcafc618de55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:25.394756 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966760b-e9b9-49bc-b43b-fcafc618de55 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:25.395039 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966760b-e9b9-49bc-b43b-fcafc618de55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:25.395314 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8966760b-e9b9-49bc-b43b-fcafc618de55 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:25.395986 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8966760b-e9b9-49bc-b43b-fcafc618de55 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:25.397928 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8966760b-e9b9-49bc-b43b-fcafc618de55 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:25.418738 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1414/2815] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:32:25 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:32:25.423346 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088f288-b739-4cad-952e-cca0d3813f6c admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:25.433504 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d088f288-b739-4cad-952e-cca0d3813f6c admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:25.438028 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57063d-d231-4d2d-8c07-8e4913ca502d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:25.438826 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57063d-d231-4d2d-8c07-8e4913ca502d admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:25.439106 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57063d-d231-4d2d-8c07-8e4913ca502d admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:25.439382 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57063d-d231-4d2d-8c07-8e4913ca502d admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:25.440100 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b57063d-d231-4d2d-8c07-8e4913ca502d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:25.441710 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b57063d-d231-4d2d-8c07-8e4913ca502d admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:25.452019 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1402/2816] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:32:25.455797 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966760b-e9b9-49bc-b43b-fcafc618de55 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:25.466266 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8966760b-e9b9-49bc-b43b-fcafc618de55 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:25.471485 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d15f7d-02db-4302-a588-bcddef2f2ff9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:25.472093 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d15f7d-02db-4302-a588-bcddef2f2ff9 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:25.472406 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d15f7d-02db-4302-a588-bcddef2f2ff9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:25.472687 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d15f7d-02db-4302-a588-bcddef2f2ff9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:25.473380 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d15f7d-02db-4302-a588-bcddef2f2ff9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:25.474998 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d15f7d-02db-4302-a588-bcddef2f2ff9 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:25.485188 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1415/2817] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:32:25.489229 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57063d-d231-4d2d-8c07-8e4913ca502d admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:25.499024 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57063d-d231-4d2d-8c07-8e4913ca502d admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:25.504312 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ebfe7-4177-4456-9ec6-56ae435fe284 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:25.504975 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ebfe7-4177-4456-9ec6-56ae435fe284 admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:25.505254 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ebfe7-4177-4456-9ec6-56ae435fe284 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:25.505525 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8ebfe7-4177-4456-9ec6-56ae435fe284 admin admin] PATH_INFO: `/v3/projects/9315e3b2add640dda70cc5be414ead41/users/7f1a94e153e84dfb90d9c060348caf3d/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:25.520644 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ebfe7-4177-4456-9ec6-56ae435fe284 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9315e3b2add640dda70cc5be414ead41, user_id=7f1a94e153e84dfb90d9c060348caf3d, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:25.523317 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8ebfe7-4177-4456-9ec6-56ae435fe284 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:25.536369 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1403/2818] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:32:25 2022] PUT /identity/v3/projects/9315e3b2add640dda70cc5be414ead41/users/7f1a94e153e84dfb90d9c060348caf3d/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:32:25.547129 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2dd077-86cc-4fb3-ab89-1d7e42754e86 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:25.547417 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2dd077-86cc-4fb3-ab89-1d7e42754e86 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:25.548400 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd2dd077-86cc-4fb3-ab89-1d7e42754e86 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:25.576610 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-cd2dd077-86cc-4fb3-ab89-1d7e42754e86 None None] MFA Rules not processed for user `7f1a94e153e84dfb90d9c060348caf3d`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:32:25.577826 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-cd2dd077-86cc-4fb3-ab89-1d7e42754e86 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:25.642486 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1416/2819] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:32:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:32:25.700025 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ebfe7-4177-4456-9ec6-56ae435fe284 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:25.746520 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:25.763850 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8ebfe7-4177-4456-9ec6-56ae435fe284 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:25.769233 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c55c697-0dc2-4971-9b02-1bcb0a0344c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:25.769837 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55c697-0dc2-4971-9b02-1bcb0a0344c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:25.770114 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55c697-0dc2-4971-9b02-1bcb0a0344c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:25.770391 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c55c697-0dc2-4971-9b02-1bcb0a0344c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:25.771075 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c55c697-0dc2-4971-9b02-1bcb0a0344c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:25.772998 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c55c697-0dc2-4971-9b02-1bcb0a0344c0 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:25.799096 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1404/2820] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:32:25 2022] POST /identity/v3/projects => generated 383 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:32:25.803180 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2dd077-86cc-4fb3-ab89-1d7e42754e86 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:25.813990 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd2dd077-86cc-4fb3-ab89-1d7e42754e86 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:25.870807 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3086f-41e8-4cf6-8d5d-be1e2f3481b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:25.871425 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3086f-41e8-4cf6-8d5d-be1e2f3481b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:25.871702 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3086f-41e8-4cf6-8d5d-be1e2f3481b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:25.871974 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b3086f-41e8-4cf6-8d5d-be1e2f3481b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:25.872686 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b3086f-41e8-4cf6-8d5d-be1e2f3481b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:25.874866 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b3086f-41e8-4cf6-8d5d-be1e2f3481b6 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:25.897739 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1417/2821] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:32:25 2022] POST /identity/v3/users => generated 298 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:32:25.901645 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c55c697-0dc2-4971-9b02-1bcb0a0344c0 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:25.912698 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c55c697-0dc2-4971-9b02-1bcb0a0344c0 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:25.917680 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3a78e-d7f2-4ee6-afe8-73120ea2fbc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:25.918286 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3a78e-d7f2-4ee6-afe8-73120ea2fbc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:25.918562 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3a78e-d7f2-4ee6-afe8-73120ea2fbc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:25.918842 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a3a78e-d7f2-4ee6-afe8-73120ea2fbc2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:25.919519 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a3a78e-d7f2-4ee6-afe8-73120ea2fbc2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:25.921113 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a3a78e-d7f2-4ee6-afe8-73120ea2fbc2 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:25.931958 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1405/2822] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:32:25.936272 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3086f-41e8-4cf6-8d5d-be1e2f3481b6 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:25.946766 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b3086f-41e8-4cf6-8d5d-be1e2f3481b6 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:25.951322 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78119cc-6e5d-4d9c-95bd-6d1ea6a4cf52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:25.951974 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78119cc-6e5d-4d9c-95bd-6d1ea6a4cf52 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:25.952250 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78119cc-6e5d-4d9c-95bd-6d1ea6a4cf52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:25.952552 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78119cc-6e5d-4d9c-95bd-6d1ea6a4cf52 admin admin] PATH_INFO: `/v3/projects/926f4ccfbaae4cd78a2cb50709516b85/users/cef40af4d335469698b61ed5b5fac032/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:25.961610 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:25.969905 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78119cc-6e5d-4d9c-95bd-6d1ea6a4cf52 admin admin] RBAC: Authorizing `identity:create_grant(project_id=926f4ccfbaae4cd78a2cb50709516b85, user_id=cef40af4d335469698b61ed5b5fac032, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:25.972751 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78119cc-6e5d-4d9c-95bd-6d1ea6a4cf52 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:25.985796 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1418/2823] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:32:25 2022] PUT /identity/v3/projects/926f4ccfbaae4cd78a2cb50709516b85/users/cef40af4d335469698b61ed5b5fac032/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:32:25.989860 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3a78e-d7f2-4ee6-afe8-73120ea2fbc2 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:25.999589 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a3a78e-d7f2-4ee6-afe8-73120ea2fbc2 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:26.056948 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d529dfec-568b-4a28-a194-615c6d26abd2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:26.057582 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529dfec-568b-4a28-a194-615c6d26abd2 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:26.057862 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529dfec-568b-4a28-a194-615c6d26abd2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:26.058137 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d529dfec-568b-4a28-a194-615c6d26abd2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:26.058857 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d529dfec-568b-4a28-a194-615c6d26abd2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:26.060473 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d529dfec-568b-4a28-a194-615c6d26abd2 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:26.070647 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1406/2824] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:32:25 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:32:26.074871 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78119cc-6e5d-4d9c-95bd-6d1ea6a4cf52 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:26.085337 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78119cc-6e5d-4d9c-95bd-6d1ea6a4cf52 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:26.090210 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf9d2a-667a-41cb-92f8-88422def01d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:26.090870 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf9d2a-667a-41cb-92f8-88422def01d4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:26.091152 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf9d2a-667a-41cb-92f8-88422def01d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:26.091430 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06bf9d2a-667a-41cb-92f8-88422def01d4 admin admin] PATH_INFO: `/v3/projects/926f4ccfbaae4cd78a2cb50709516b85/users/cef40af4d335469698b61ed5b5fac032/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:26.093475 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bf9d2a-667a-41cb-92f8-88422def01d4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=926f4ccfbaae4cd78a2cb50709516b85, user_id=cef40af4d335469698b61ed5b5fac032, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:26.096715 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06bf9d2a-667a-41cb-92f8-88422def01d4 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:26.106856 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1419/2825] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:32:26 2022] PUT /identity/v3/projects/926f4ccfbaae4cd78a2cb50709516b85/users/cef40af4d335469698b61ed5b5fac032/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:32:26.117304 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9dba2-e6bc-4107-aebe-43e12c5f895f None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:26.117585 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9dba2-e6bc-4107-aebe-43e12c5f895f None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:26.117965 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb9dba2-e6bc-4107-aebe-43e12c5f895f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:26.144637 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-bdb9dba2-e6bc-4107-aebe-43e12c5f895f None None] MFA Rules not processed for user `cef40af4d335469698b61ed5b5fac032`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:32:26.145824 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-bdb9dba2-e6bc-4107-aebe-43e12c5f895f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:26.213180 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1407/2826] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:32:26 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:32:26.224960 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf9d2a-667a-41cb-92f8-88422def01d4 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:26.226653 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-06bf9d2a-667a-41cb-92f8-88422def01d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:26.288765 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06bf9d2a-667a-41cb-92f8-88422def01d4 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:26.292868 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e39c52-0938-4a1e-ac99-734582267ce7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:26.293484 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e39c52-0938-4a1e-ac99-734582267ce7 service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:26.293763 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e39c52-0938-4a1e-ac99-734582267ce7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:26.294031 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e39c52-0938-4a1e-ac99-734582267ce7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:26.350668 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e39c52-0938-4a1e-ac99-734582267ce7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:26.352113 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2e39c52-0938-4a1e-ac99-734582267ce7 service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:26.361194 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1420/2827] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:32:26 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:32:27.854173 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9dba2-e6bc-4107-aebe-43e12c5f895f None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:27.863883 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb9dba2-e6bc-4107-aebe-43e12c5f895f None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:27.867386 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c1769-693b-465b-9a27-54bca3a5ddae service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:27.867992 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c1769-693b-465b-9a27-54bca3a5ddae service cinder] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:27.868271 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c1769-693b-465b-9a27-54bca3a5ddae service cinder] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:27.868578 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6c1769-693b-465b-9a27-54bca3a5ddae service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:27.903339 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:27.927613 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c1769-693b-465b-9a27-54bca3a5ddae service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:27.929068 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6c1769-693b-465b-9a27-54bca3a5ddae service cinder] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:27.937691 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1408/2828] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:32:27 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:32:28.490936 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e39c52-0938-4a1e-ac99-734582267ce7 service cinder] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:28.500117 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e39c52-0938-4a1e-ac99-734582267ce7 service cinder] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:28.504676 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e497691a-5957-47eb-986a-5011af73bc6f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:28.505286 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497691a-5957-47eb-986a-5011af73bc6f service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:28.506038 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497691a-5957-47eb-986a-5011af73bc6f service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:28.506038 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e497691a-5957-47eb-986a-5011af73bc6f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:28.515840 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497691a-5957-47eb-986a-5011af73bc6f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:28.518231 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e497691a-5957-47eb-986a-5011af73bc6f service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:28.529568 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1421/2829] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:32:28 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:32:36.649580 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c1769-693b-465b-9a27-54bca3a5ddae service cinder] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:36.714334 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6c1769-693b-465b-9a27-54bca3a5ddae service cinder] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:36.718920 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd503a5-d7ae-408e-80ac-c701e360a4dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:36.719579 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd503a5-d7ae-408e-80ac-c701e360a4dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:36.719861 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd503a5-d7ae-408e-80ac-c701e360a4dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:36.720141 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd503a5-d7ae-408e-80ac-c701e360a4dc admin admin] PATH_INFO: `/v3/users/ac3942005cb74a659ba390b57df135e9` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:36.721348 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd503a5-d7ae-408e-80ac-c701e360a4dc admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac3942005cb74a659ba390b57df135e9)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:36.723568 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edd503a5-d7ae-408e-80ac-c701e360a4dc admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:36.773364 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-edd503a5-d7ae-408e-80ac-c701e360a4dc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac3942005cb74a659ba390b57df135e9'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:36.785606 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-edd503a5-d7ae-408e-80ac-c701e360a4dc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac3942005cb74a659ba390b57df135e9'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:36.786320 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-edd503a5-d7ae-408e-80ac-c701e360a4dc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac3942005cb74a659ba390b57df135e9'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:36.786956 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-edd503a5-d7ae-408e-80ac-c701e360a4dc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac3942005cb74a659ba390b57df135e9'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:36.794598 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-edd503a5-d7ae-408e-80ac-c701e360a4dc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac3942005cb74a659ba390b57df135e9'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:36.813408 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1409/2830] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:32:36 2022] DELETE /identity/v3/users/ac3942005cb74a659ba390b57df135e9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:32:36.818198 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85572ce1-7200-44a4-9ca4-690a7805e9c2 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:36.818713 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85572ce1-7200-44a4-9ca4-690a7805e9c2 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:36.818816 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85572ce1-7200-44a4-9ca4-690a7805e9c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:36.837851 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-85572ce1-7200-44a4-9ca4-690a7805e9c2 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:32:36.839049 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-85572ce1-7200-44a4-9ca4-690a7805e9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:36.896402 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1422/2831] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:32:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:32:36.906159 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd503a5-d7ae-408e-80ac-c701e360a4dc admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:36.907587 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-edd503a5-d7ae-408e-80ac-c701e360a4dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:36.965091 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd503a5-d7ae-408e-80ac-c701e360a4dc admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:36.968784 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96bb5c5-e9b7-4bf8-b7c0-90e162fd8bd6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:36.969418 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bb5c5-e9b7-4bf8-b7c0-90e162fd8bd6 service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:36.969785 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bb5c5-e9b7-4bf8-b7c0-90e162fd8bd6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:36.970064 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96bb5c5-e9b7-4bf8-b7c0-90e162fd8bd6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:36.979035 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96bb5c5-e9b7-4bf8-b7c0-90e162fd8bd6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:36.980488 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96bb5c5-e9b7-4bf8-b7c0-90e162fd8bd6 service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:36.984301 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:36.993276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1410/2832] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:32:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:32:37.253950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85572ce1-7200-44a4-9ca4-690a7805e9c2 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:37.255397 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-85572ce1-7200-44a4-9ca4-690a7805e9c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:37.267717 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85572ce1-7200-44a4-9ca4-690a7805e9c2 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:37.272436 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c1776-042a-492e-9a9d-f3b42c3dd970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:37.273081 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c1776-042a-492e-9a9d-f3b42c3dd970 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:37.273351 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c1776-042a-492e-9a9d-f3b42c3dd970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:37.273623 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900c1776-042a-492e-9a9d-f3b42c3dd970 admin admin] PATH_INFO: `/v3/projects/806ef085ed364a94a6668332486fc3a9` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:37.274894 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c1776-042a-492e-9a9d-f3b42c3dd970 admin admin] RBAC: Authorizing `identity:delete_project(project_id=806ef085ed364a94a6668332486fc3a9)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:37.277141 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-900c1776-042a-492e-9a9d-f3b42c3dd970 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:37.289985 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:37.327521 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-900c1776-042a-492e-9a9d-f3b42c3dd970 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '806ef085ed364a94a6668332486fc3a9', 'request_id': 'req-900c1776-042a-492e-9a9d-f3b42c3dd970'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:37.334201 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-900c1776-042a-492e-9a9d-f3b42c3dd970 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '806ef085ed364a94a6668332486fc3a9', 'request_id': 'req-900c1776-042a-492e-9a9d-f3b42c3dd970'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:37.341919 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-900c1776-042a-492e-9a9d-f3b42c3dd970 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '806ef085ed364a94a6668332486fc3a9', 'request_id': 'req-900c1776-042a-492e-9a9d-f3b42c3dd970'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:37.354386 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-900c1776-042a-492e-9a9d-f3b42c3dd970 admin admin] The token cache is being invalidate because project 806ef085ed364a94a6668332486fc3a9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:32:37.354674 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-900c1776-042a-492e-9a9d-f3b42c3dd970 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:37.355318 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-900c1776-042a-492e-9a9d-f3b42c3dd970 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:37.356858 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1423/2833] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:32:37 2022] DELETE /identity/v3/projects/806ef085ed364a94a6668332486fc3a9 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:32:37.361555 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96bb5c5-e9b7-4bf8-b7c0-90e162fd8bd6 service neutron] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:37.371315 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96bb5c5-e9b7-4bf8-b7c0-90e162fd8bd6 service neutron] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:37.433033 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab398837-ec7b-47a4-ab52-a8051b3c5617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:37.433674 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab398837-ec7b-47a4-ab52-a8051b3c5617 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:37.433953 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab398837-ec7b-47a4-ab52-a8051b3c5617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:37.434228 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab398837-ec7b-47a4-ab52-a8051b3c5617 admin admin] PATH_INFO: `/v3/users/7f1a94e153e84dfb90d9c060348caf3d` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:37.435391 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab398837-ec7b-47a4-ab52-a8051b3c5617 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7f1a94e153e84dfb90d9c060348caf3d)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:37.437423 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab398837-ec7b-47a4-ab52-a8051b3c5617 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:37.491588 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-ab398837-ec7b-47a4-ab52-a8051b3c5617 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7f1a94e153e84dfb90d9c060348caf3d'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:37.503694 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-ab398837-ec7b-47a4-ab52-a8051b3c5617 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7f1a94e153e84dfb90d9c060348caf3d'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:37.504367 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-ab398837-ec7b-47a4-ab52-a8051b3c5617 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7f1a94e153e84dfb90d9c060348caf3d'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:37.504978 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-ab398837-ec7b-47a4-ab52-a8051b3c5617 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7f1a94e153e84dfb90d9c060348caf3d'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:37.512103 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-ab398837-ec7b-47a4-ab52-a8051b3c5617 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7f1a94e153e84dfb90d9c060348caf3d'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:37.524508 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1411/2834] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:32:37 2022] DELETE /identity/v3/users/7f1a94e153e84dfb90d9c060348caf3d => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:32:37.805120 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c1776-042a-492e-9a9d-f3b42c3dd970 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:37.806690 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-900c1776-042a-492e-9a9d-f3b42c3dd970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:37.821078 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900c1776-042a-492e-9a9d-f3b42c3dd970 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:37.881178 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994338d-1808-4c29-a040-d8ec172d6fdb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:37.881733 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994338d-1808-4c29-a040-d8ec172d6fdb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:37.882009 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994338d-1808-4c29-a040-d8ec172d6fdb admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:37.882278 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f994338d-1808-4c29-a040-d8ec172d6fdb admin admin] PATH_INFO: `/v3/projects/9315e3b2add640dda70cc5be414ead41` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:37.883415 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994338d-1808-4c29-a040-d8ec172d6fdb admin admin] RBAC: Authorizing `identity:delete_project(project_id=9315e3b2add640dda70cc5be414ead41)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:37.885336 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f994338d-1808-4c29-a040-d8ec172d6fdb admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:37.929757 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-f994338d-1808-4c29-a040-d8ec172d6fdb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9315e3b2add640dda70cc5be414ead41', 'request_id': 'req-f994338d-1808-4c29-a040-d8ec172d6fdb'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:37.935083 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-f994338d-1808-4c29-a040-d8ec172d6fdb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9315e3b2add640dda70cc5be414ead41', 'request_id': 'req-f994338d-1808-4c29-a040-d8ec172d6fdb'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:37.942889 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-f994338d-1808-4c29-a040-d8ec172d6fdb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9315e3b2add640dda70cc5be414ead41', 'request_id': 'req-f994338d-1808-4c29-a040-d8ec172d6fdb'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:37.954679 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-f994338d-1808-4c29-a040-d8ec172d6fdb admin admin] The token cache is being invalidate because project 9315e3b2add640dda70cc5be414ead41 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:32:37.954948 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-f994338d-1808-4c29-a040-d8ec172d6fdb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:37.955572 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-f994338d-1808-4c29-a040-d8ec172d6fdb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:37.957091 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1424/2835] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:32:37 2022] DELETE /identity/v3/projects/9315e3b2add640dda70cc5be414ead41 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:32:37.961065 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab398837-ec7b-47a4-ab52-a8051b3c5617 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:37.962727 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-ab398837-ec7b-47a4-ab52-a8051b3c5617 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:37.975383 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab398837-ec7b-47a4-ab52-a8051b3c5617 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:38.032506 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c83b4-127d-46cd-b3fa-68614c1656bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:38.033149 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c83b4-127d-46cd-b3fa-68614c1656bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:38.033432 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c83b4-127d-46cd-b3fa-68614c1656bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:38.033708 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459c83b4-127d-46cd-b3fa-68614c1656bb admin admin] PATH_INFO: `/v3/users/cef40af4d335469698b61ed5b5fac032` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:38.034920 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c83b4-127d-46cd-b3fa-68614c1656bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=cef40af4d335469698b61ed5b5fac032)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:38.036940 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459c83b4-127d-46cd-b3fa-68614c1656bb admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:38.057450 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:38.084726 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-459c83b4-127d-46cd-b3fa-68614c1656bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cef40af4d335469698b61ed5b5fac032'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:38.097656 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-459c83b4-127d-46cd-b3fa-68614c1656bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cef40af4d335469698b61ed5b5fac032'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:38.098390 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-459c83b4-127d-46cd-b3fa-68614c1656bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cef40af4d335469698b61ed5b5fac032'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:38.099071 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-459c83b4-127d-46cd-b3fa-68614c1656bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cef40af4d335469698b61ed5b5fac032'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:38.106480 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-459c83b4-127d-46cd-b3fa-68614c1656bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cef40af4d335469698b61ed5b5fac032'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:38.125955 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1412/2836] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:32:37 2022] DELETE /identity/v3/users/cef40af4d335469698b61ed5b5fac032 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:32:38.403646 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994338d-1808-4c29-a040-d8ec172d6fdb admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:38.405318 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-f994338d-1808-4c29-a040-d8ec172d6fdb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:38.418919 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f994338d-1808-4c29-a040-d8ec172d6fdb admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:38.446249 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:38.477711 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a324183c-b8fe-4ee6-b131-f6c41365a7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:38.478369 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324183c-b8fe-4ee6-b131-f6c41365a7f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:38.478640 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324183c-b8fe-4ee6-b131-f6c41365a7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:38.478908 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a324183c-b8fe-4ee6-b131-f6c41365a7f4 admin admin] PATH_INFO: `/v3/projects/926f4ccfbaae4cd78a2cb50709516b85` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:38.480043 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324183c-b8fe-4ee6-b131-f6c41365a7f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=926f4ccfbaae4cd78a2cb50709516b85)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:38.481963 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a324183c-b8fe-4ee6-b131-f6c41365a7f4 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:38.514314 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c83b4-127d-46cd-b3fa-68614c1656bb admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:38.515875 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-459c83b4-127d-46cd-b3fa-68614c1656bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:38.528716 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459c83b4-127d-46cd-b3fa-68614c1656bb admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:38.532072 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-a324183c-b8fe-4ee6-b131-f6c41365a7f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '926f4ccfbaae4cd78a2cb50709516b85', 'request_id': 'req-a324183c-b8fe-4ee6-b131-f6c41365a7f4'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:38.537801 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-a324183c-b8fe-4ee6-b131-f6c41365a7f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '926f4ccfbaae4cd78a2cb50709516b85', 'request_id': 'req-a324183c-b8fe-4ee6-b131-f6c41365a7f4'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:38.546985 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-a324183c-b8fe-4ee6-b131-f6c41365a7f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '926f4ccfbaae4cd78a2cb50709516b85', 'request_id': 'req-a324183c-b8fe-4ee6-b131-f6c41365a7f4'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:38.559180 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-a324183c-b8fe-4ee6-b131-f6c41365a7f4 admin admin] The token cache is being invalidate because project 926f4ccfbaae4cd78a2cb50709516b85 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:32:38.559471 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-a324183c-b8fe-4ee6-b131-f6c41365a7f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:38.560109 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-a324183c-b8fe-4ee6-b131-f6c41365a7f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:38.561683 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1425/2837] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:32:38 2022] DELETE /identity/v3/projects/926f4ccfbaae4cd78a2cb50709516b85 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:32:38.567199 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157cdcbd-c3d2-44d2-9ffa-809f19420db0 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:38.567483 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157cdcbd-c3d2-44d2-9ffa-809f19420db0 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:38.567760 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157cdcbd-c3d2-44d2-9ffa-809f19420db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:38.586865 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc1e6232-73ac-4f40-b390-b1ea821cd48a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:38.587372 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-157cdcbd-c3d2-44d2-9ffa-809f19420db0 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:32:38.587758 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e6232-73ac-4f40-b390-b1ea821cd48a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:38.588033 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e6232-73ac-4f40-b390-b1ea821cd48a admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:38.588306 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc1e6232-73ac-4f40-b390-b1ea821cd48a admin admin] PATH_INFO: `/v3/users/a5fbf90cb88e485fab63c06642f53bec` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:38.588862 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-157cdcbd-c3d2-44d2-9ffa-809f19420db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:38.589484 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e6232-73ac-4f40-b390-b1ea821cd48a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a5fbf90cb88e485fab63c06642f53bec)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:38.591378 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc1e6232-73ac-4f40-b390-b1ea821cd48a admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:38.596691 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1426/2838] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:32:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:32:38.604079 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7293f5-d98a-486c-8357-18399c3a5775 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:38.604400 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7293f5-d98a-486c-8357-18399c3a5775 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:38.604679 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe7293f5-d98a-486c-8357-18399c3a5775 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:38.624972 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-fe7293f5-d98a-486c-8357-18399c3a5775 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:32:38.626312 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-fe7293f5-d98a-486c-8357-18399c3a5775 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:38.634815 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1427/2839] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:32:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 05 02:32:38.639250 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7293f5-d98a-486c-8357-18399c3a5775 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:38.640468 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-cc1e6232-73ac-4f40-b390-b1ea821cd48a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a5fbf90cb88e485fab63c06642f53bec'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:38.648503 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe7293f5-d98a-486c-8357-18399c3a5775 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:38.653137 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-cc1e6232-73ac-4f40-b390-b1ea821cd48a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a5fbf90cb88e485fab63c06642f53bec'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:38.653482 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96c27b-e4a5-4036-8313-ec2dc0ffcd7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:38.653869 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-cc1e6232-73ac-4f40-b390-b1ea821cd48a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a5fbf90cb88e485fab63c06642f53bec'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:38.654088 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96c27b-e4a5-4036-8313-ec2dc0ffcd7f admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:38.654365 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96c27b-e4a5-4036-8313-ec2dc0ffcd7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:38.654487 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-cc1e6232-73ac-4f40-b390-b1ea821cd48a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a5fbf90cb88e485fab63c06642f53bec'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:38.654635 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec96c27b-e4a5-4036-8313-ec2dc0ffcd7f admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:38.655321 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec96c27b-e4a5-4036-8313-ec2dc0ffcd7f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:32:38.655627 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec96c27b-e4a5-4036-8313-ec2dc0ffcd7f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:38.658172 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec96c27b-e4a5-4036-8313-ec2dc0ffcd7f admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:38.663394 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-cc1e6232-73ac-4f40-b390-b1ea821cd48a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a5fbf90cb88e485fab63c06642f53bec'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:38.670870 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1428/2840] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:32:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 05 02:32:38.675895 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96c27b-e4a5-4036-8313-ec2dc0ffcd7f admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:38.677243 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1413/2841] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:32:38 2022] DELETE /identity/v3/users/a5fbf90cb88e485fab63c06642f53bec => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:32:38.677529 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-ec96c27b-e4a5-4036-8313-ec2dc0ffcd7f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:38.681533 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ad9ef-dc2b-42c7-9f8b-0099ad787024 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:38.681773 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ad9ef-dc2b-42c7-9f8b-0099ad787024 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:38.682168 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404ad9ef-dc2b-42c7-9f8b-0099ad787024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:38.690974 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec96c27b-e4a5-4036-8313-ec2dc0ffcd7f admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:38.701272 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-404ad9ef-dc2b-42c7-9f8b-0099ad787024 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:32:38.702475 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-404ad9ef-dc2b-42c7-9f8b-0099ad787024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:38.711624 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:DELETE=18,keystone:SELECT=80,keystone:INSERT=2 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:38.749410 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0e7be-c85f-4c6b-a3c7-c6affebc3b00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:38.750033 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0e7be-c85f-4c6b-a3c7-c6affebc3b00 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:38.750387 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0e7be-c85f-4c6b-a3c7-c6affebc3b00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:38.750619 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d0e7be-c85f-4c6b-a3c7-c6affebc3b00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:38.751427 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d0e7be-c85f-4c6b-a3c7-c6affebc3b00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:38.753349 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71d0e7be-c85f-4c6b-a3c7-c6affebc3b00 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:38.765524 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1414/2842] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:32:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:32:38.775760 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ad9ef-dc2b-42c7-9f8b-0099ad787024 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:38.777295 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-404ad9ef-dc2b-42c7-9f8b-0099ad787024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:38.784703 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1429/2843] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:32:38 2022] POST /identity/v3/projects => generated 369 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:32:38.788728 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0e7be-c85f-4c6b-a3c7-c6affebc3b00 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:38.807847 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:38.838372 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404ad9ef-dc2b-42c7-9f8b-0099ad787024 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:38.855485 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71d0e7be-c85f-4c6b-a3c7-c6affebc3b00 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:38.860147 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c257201-1bb8-448d-ae70-4883c98c8f15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:38.860794 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c257201-1bb8-448d-ae70-4883c98c8f15 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:38.861069 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c257201-1bb8-448d-ae70-4883c98c8f15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:38.861343 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c257201-1bb8-448d-ae70-4883c98c8f15 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:38.862012 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c257201-1bb8-448d-ae70-4883c98c8f15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:38.864043 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c257201-1bb8-448d-ae70-4883c98c8f15 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:38.886038 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1430/2844] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:32:38 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:32:38.887020 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619753c4-e0cf-4ddb-88f9-8c2a85b65493 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:38.887647 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619753c4-e0cf-4ddb-88f9-8c2a85b65493 service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:38.888013 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619753c4-e0cf-4ddb-88f9-8c2a85b65493 service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:38.888290 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619753c4-e0cf-4ddb-88f9-8c2a85b65493 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:38.890375 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c257201-1bb8-448d-ae70-4883c98c8f15 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:38.898993 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619753c4-e0cf-4ddb-88f9-8c2a85b65493 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:38.900391 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-619753c4-e0cf-4ddb-88f9-8c2a85b65493 service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:38.900531 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c257201-1bb8-448d-ae70-4883c98c8f15 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:38.905500 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a7024-34ac-488f-a348-3f82377fc7c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:38.905697 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a7024-34ac-488f-a348-3f82377fc7c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:38.905975 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a7024-34ac-488f-a348-3f82377fc7c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:38.906246 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364a7024-34ac-488f-a348-3f82377fc7c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:38.906957 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a7024-34ac-488f-a348-3f82377fc7c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:38.908673 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-364a7024-34ac-488f-a348-3f82377fc7c8 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:38.909985 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1415/2845] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:32:38 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:32:38.921655 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1431/2846] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:32:38.925537 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619753c4-e0cf-4ddb-88f9-8c2a85b65493 service neutron] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:38.935348 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619753c4-e0cf-4ddb-88f9-8c2a85b65493 service neutron] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:38.940813 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9be54c29-8a2a-4594-b9df-b28956f8a779 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:38.941427 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be54c29-8a2a-4594-b9df-b28956f8a779 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:38.941710 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be54c29-8a2a-4594-b9df-b28956f8a779 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:38.941986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be54c29-8a2a-4594-b9df-b28956f8a779 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:38.942679 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be54c29-8a2a-4594-b9df-b28956f8a779 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:38.944269 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9be54c29-8a2a-4594-b9df-b28956f8a779 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:38.954967 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1416/2847] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:32:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:32:38.959665 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a7024-34ac-488f-a348-3f82377fc7c8 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:38.971521 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364a7024-34ac-488f-a348-3f82377fc7c8 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:38.976699 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd7fe9-0a0b-4ecf-879a-8da3419905f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:38.977377 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd7fe9-0a0b-4ecf-879a-8da3419905f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:38.977777 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd7fe9-0a0b-4ecf-879a-8da3419905f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:38.978050 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bbd7fe9-0a0b-4ecf-879a-8da3419905f9 admin admin] PATH_INFO: `/v3/projects/f506cc5f1df64bcfb582c6b43c01fe86/users/3dd1116bf7a44c14bbf64181c4d60f10/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:38.994155 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd7fe9-0a0b-4ecf-879a-8da3419905f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f506cc5f1df64bcfb582c6b43c01fe86, user_id=3dd1116bf7a44c14bbf64181c4d60f10, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:38.996851 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bbd7fe9-0a0b-4ecf-879a-8da3419905f9 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:39.011550 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1432/2848] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:32:38 2022] PUT /identity/v3/projects/f506cc5f1df64bcfb582c6b43c01fe86/users/3dd1116bf7a44c14bbf64181c4d60f10/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:32:39.023196 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429f343-0302-4c72-8175-63892362f5f0 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:39.023724 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429f343-0302-4c72-8175-63892362f5f0 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:39.023724 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0429f343-0302-4c72-8175-63892362f5f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:39.052098 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-0429f343-0302-4c72-8175-63892362f5f0 None None] MFA Rules not processed for user `3dd1116bf7a44c14bbf64181c4d60f10`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:32:39.053346 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-0429f343-0302-4c72-8175-63892362f5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:39.112973 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=100 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:39.123761 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1417/2849] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:32:39 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:32:39.135780 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd7fe9-0a0b-4ecf-879a-8da3419905f9 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:39.137692 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-4bbd7fe9-0a0b-4ecf-879a-8da3419905f9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:39.194488 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429f343-0302-4c72-8175-63892362f5f0 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:39.195983 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-0429f343-0302-4c72-8175-63892362f5f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:39.197623 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bbd7fe9-0a0b-4ecf-879a-8da3419905f9 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:39.202717 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d051602c-811c-4390-b52f-b506b471f72e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5c09080c507f4c35b81d482cfbaa6a88', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:39.203945 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051602c-811c-4390-b52f-b506b471f72e service glance] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:39.204348 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051602c-811c-4390-b52f-b506b471f72e service glance] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:39.204636 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d051602c-811c-4390-b52f-b506b471f72e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:39.215488 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d051602c-811c-4390-b52f-b506b471f72e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:39.217131 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d051602c-811c-4390-b52f-b506b471f72e service glance] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:39.228257 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1433/2850] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:32:39 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:32:39.268307 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0429f343-0302-4c72-8175-63892362f5f0 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:39.272871 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbebbb3-c6d0-4e97-8f66-bbd641faadb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:39.273499 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbebbb3-c6d0-4e97-8f66-bbd641faadb9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:39.273776 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbebbb3-c6d0-4e97-8f66-bbd641faadb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:39.274052 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbebbb3-c6d0-4e97-8f66-bbd641faadb9 admin admin] PATH_INFO: `/v3/projects/7e03689c17ed437f889489552bc95ee7` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:39.275210 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbebbb3-c6d0-4e97-8f66-bbd641faadb9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e03689c17ed437f889489552bc95ee7)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:39.277131 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbebbb3-c6d0-4e97-8f66-bbd641faadb9 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:39.325748 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-0bbebbb3-c6d0-4e97-8f66-bbd641faadb9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e03689c17ed437f889489552bc95ee7', 'request_id': 'req-0bbebbb3-c6d0-4e97-8f66-bbd641faadb9'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:39.331841 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-0bbebbb3-c6d0-4e97-8f66-bbd641faadb9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e03689c17ed437f889489552bc95ee7', 'request_id': 'req-0bbebbb3-c6d0-4e97-8f66-bbd641faadb9'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:39.339586 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-0bbebbb3-c6d0-4e97-8f66-bbd641faadb9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e03689c17ed437f889489552bc95ee7', 'request_id': 'req-0bbebbb3-c6d0-4e97-8f66-bbd641faadb9'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:39.352163 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-0bbebbb3-c6d0-4e97-8f66-bbd641faadb9 admin admin] The token cache is being invalidate because project 7e03689c17ed437f889489552bc95ee7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:32:39.352497 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-0bbebbb3-c6d0-4e97-8f66-bbd641faadb9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:39.353177 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-0bbebbb3-c6d0-4e97-8f66-bbd641faadb9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:39.354844 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1418/2851] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:32:39 2022] DELETE /identity/v3/projects/7e03689c17ed437f889489552bc95ee7 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:32:39.359765 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297db5d3-4d97-4dae-9244-00d655754426 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:39.360136 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297db5d3-4d97-4dae-9244-00d655754426 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:39.360455 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297db5d3-4d97-4dae-9244-00d655754426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:39.379994 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-297db5d3-4d97-4dae-9244-00d655754426 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:32:39.381218 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-297db5d3-4d97-4dae-9244-00d655754426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:39.443684 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1434/2852] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:32:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:32:39.452411 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c33a7-2cc6-49a9-86cb-fa5a2b6b47e6 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:39.452704 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c33a7-2cc6-49a9-86cb-fa5a2b6b47e6 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:39.452985 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7c33a7-2cc6-49a9-86cb-fa5a2b6b47e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:39.475200 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-fc7c33a7-2cc6-49a9-86cb-fa5a2b6b47e6 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:32:39.476464 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-fc7c33a7-2cc6-49a9-86cb-fa5a2b6b47e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:39.484589 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1419/2853] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:32:39 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:32:39.488842 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297db5d3-4d97-4dae-9244-00d655754426 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:39.498540 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297db5d3-4d97-4dae-9244-00d655754426 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:39.503680 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26388e-75b6-4d2e-aef1-9bafc1907b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:39.504344 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26388e-75b6-4d2e-aef1-9bafc1907b50 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:39.504634 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26388e-75b6-4d2e-aef1-9bafc1907b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:39.504910 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a26388e-75b6-4d2e-aef1-9bafc1907b50 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:39.505611 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26388e-75b6-4d2e-aef1-9bafc1907b50 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:32:39.505917 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26388e-75b6-4d2e-aef1-9bafc1907b50 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:39.507637 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a26388e-75b6-4d2e-aef1-9bafc1907b50 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:39.520420 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1435/2854] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:32:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:32:39.525206 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c33a7-2cc6-49a9-86cb-fa5a2b6b47e6 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:39.535751 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7c33a7-2cc6-49a9-86cb-fa5a2b6b47e6 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:39.542215 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a949e7e-7150-4521-a9ba-09774a4fff6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:39.543073 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a949e7e-7150-4521-a9ba-09774a4fff6c admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:39.543425 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a949e7e-7150-4521-a9ba-09774a4fff6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:39.543720 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a949e7e-7150-4521-a9ba-09774a4fff6c admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:39.544586 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a949e7e-7150-4521-a9ba-09774a4fff6c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:39.547921 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a949e7e-7150-4521-a9ba-09774a4fff6c admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:39.582279 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1420/2855] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:32:39 2022] POST /identity/v3/projects => generated 375 bytes in 57 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:32:39.583174 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26388e-75b6-4d2e-aef1-9bafc1907b50 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:39.588808 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:39.596558 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a26388e-75b6-4d2e-aef1-9bafc1907b50 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:39.663685 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d0140-e067-4f69-b160-6b8b07651251 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:39.664440 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d0140-e067-4f69-b160-6b8b07651251 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:39.664794 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d0140-e067-4f69-b160-6b8b07651251 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:39.665143 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd0d0140-e067-4f69-b160-6b8b07651251 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:39.666215 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d0140-e067-4f69-b160-6b8b07651251 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:39.668218 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd0d0140-e067-4f69-b160-6b8b07651251 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:39.693264 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1436/2856] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:32:39 2022] POST /identity/v3/users => generated 288 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:32:39.697370 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a949e7e-7150-4521-a9ba-09774a4fff6c admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:39.708701 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a949e7e-7150-4521-a9ba-09774a4fff6c admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:39.714204 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c3dcf-fa4a-4327-8375-26002d19e1e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:39.714896 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c3dcf-fa4a-4327-8375-26002d19e1e7 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:39.715244 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c3dcf-fa4a-4327-8375-26002d19e1e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:39.715623 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879c3dcf-fa4a-4327-8375-26002d19e1e7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:39.716448 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879c3dcf-fa4a-4327-8375-26002d19e1e7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:39.718211 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-879c3dcf-fa4a-4327-8375-26002d19e1e7 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:39.731708 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1421/2857] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:32:39.736632 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d0140-e067-4f69-b160-6b8b07651251 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:39.746835 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd0d0140-e067-4f69-b160-6b8b07651251 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:39.751631 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcfdd0c9-6df2-4b35-9d7c-4904510af185 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:39.752234 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfdd0c9-6df2-4b35-9d7c-4904510af185 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:39.752543 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfdd0c9-6df2-4b35-9d7c-4904510af185 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:39.752816 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcfdd0c9-6df2-4b35-9d7c-4904510af185 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:39.753510 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfdd0c9-6df2-4b35-9d7c-4904510af185 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:39.755068 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcfdd0c9-6df2-4b35-9d7c-4904510af185 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:39.765476 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1437/2858] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:32:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:32:39.770196 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c3dcf-fa4a-4327-8375-26002d19e1e7 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:39.780156 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879c3dcf-fa4a-4327-8375-26002d19e1e7 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:39.786078 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361dbc0-cbca-4ad2-92f1-da768a4bb66a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:39.786930 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361dbc0-cbca-4ad2-92f1-da768a4bb66a admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:39.787251 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361dbc0-cbca-4ad2-92f1-da768a4bb66a admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:39.787528 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a361dbc0-cbca-4ad2-92f1-da768a4bb66a admin admin] PATH_INFO: `/v3/projects/35bdca75a848450c85a203dbf1f2e1d3/users/7313f0b72f5449b1a04e06f96959322b/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:39.802048 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a361dbc0-cbca-4ad2-92f1-da768a4bb66a admin admin] RBAC: Authorizing `identity:create_grant(project_id=35bdca75a848450c85a203dbf1f2e1d3, user_id=7313f0b72f5449b1a04e06f96959322b, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:39.804728 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a361dbc0-cbca-4ad2-92f1-da768a4bb66a admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:39.817066 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1422/2859] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:32:39 2022] PUT /identity/v3/projects/35bdca75a848450c85a203dbf1f2e1d3/users/7313f0b72f5449b1a04e06f96959322b/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:32:39.827057 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72daea3e-136c-46b4-a713-764b17dae726 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:39.827380 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72daea3e-136c-46b4-a713-764b17dae726 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:39.827657 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72daea3e-136c-46b4-a713-764b17dae726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:39.856566 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-72daea3e-136c-46b4-a713-764b17dae726 None None] MFA Rules not processed for user `7313f0b72f5449b1a04e06f96959322b`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:32:39.857803 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-72daea3e-136c-46b4-a713-764b17dae726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:39.923416 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1438/2860] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:32:39 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:32:39.934913 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361dbc0-cbca-4ad2-92f1-da768a4bb66a admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:39.936634 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-a361dbc0-cbca-4ad2-92f1-da768a4bb66a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:39.959625 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:39.998245 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a361dbc0-cbca-4ad2-92f1-da768a4bb66a admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:40.002000 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4696e74b-882d-449e-b126-f05515e89a53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:40.002608 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696e74b-882d-449e-b126-f05515e89a53 service cinder] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:40.002888 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696e74b-882d-449e-b126-f05515e89a53 service cinder] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:40.003161 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4696e74b-882d-449e-b126-f05515e89a53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:40.011484 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4696e74b-882d-449e-b126-f05515e89a53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:40.012939 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4696e74b-882d-449e-b126-f05515e89a53 service cinder] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:40.022244 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1423/2861] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:32:39 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:32:49.919140 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=65,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:50.018240 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=17 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:50.291661 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72daea3e-136c-46b4-a713-764b17dae726 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:50.355783 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72daea3e-136c-46b4-a713-764b17dae726 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:50.360494 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee958b5d-c430-48d4-9b2e-534f6d10a65d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:50.362013 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee958b5d-c430-48d4-9b2e-534f6d10a65d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:50.362013 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee958b5d-c430-48d4-9b2e-534f6d10a65d admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:50.362327 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee958b5d-c430-48d4-9b2e-534f6d10a65d admin admin] PATH_INFO: `/v3/users/7313f0b72f5449b1a04e06f96959322b` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:50.363394 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee958b5d-c430-48d4-9b2e-534f6d10a65d admin admin] RBAC: Authorizing `identity:delete_user(user_id=7313f0b72f5449b1a04e06f96959322b)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:50.365379 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee958b5d-c430-48d4-9b2e-534f6d10a65d admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:50.411501 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-ee958b5d-c430-48d4-9b2e-534f6d10a65d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7313f0b72f5449b1a04e06f96959322b'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:50.423033 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-ee958b5d-c430-48d4-9b2e-534f6d10a65d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7313f0b72f5449b1a04e06f96959322b'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:50.424769 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-ee958b5d-c430-48d4-9b2e-534f6d10a65d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7313f0b72f5449b1a04e06f96959322b'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:50.425380 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-ee958b5d-c430-48d4-9b2e-534f6d10a65d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7313f0b72f5449b1a04e06f96959322b'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:50.432250 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-ee958b5d-c430-48d4-9b2e-534f6d10a65d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7313f0b72f5449b1a04e06f96959322b'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:50.445340 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1439/2862] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:32:50 2022] DELETE /identity/v3/users/7313f0b72f5449b1a04e06f96959322b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:32:50.449759 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b9cca-a844-4099-873b-c7f00a68ce55 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:50.450111 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b9cca-a844-4099-873b-c7f00a68ce55 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:50.450453 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37b9cca-a844-4099-873b-c7f00a68ce55 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:50.470820 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-c37b9cca-a844-4099-873b-c7f00a68ce55 None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:32:50.471996 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-c37b9cca-a844-4099-873b-c7f00a68ce55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:50.529646 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1424/2863] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:32:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:32:50.539649 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee958b5d-c430-48d4-9b2e-534f6d10a65d admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:50.541058 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-ee958b5d-c430-48d4-9b2e-534f6d10a65d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:50.599673 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee958b5d-c430-48d4-9b2e-534f6d10a65d admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:50.603811 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df244d9b-cf40-4bc4-a106-20c33d83dfa3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:50.604460 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df244d9b-cf40-4bc4-a106-20c33d83dfa3 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:50.604739 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df244d9b-cf40-4bc4-a106-20c33d83dfa3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:50.605009 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df244d9b-cf40-4bc4-a106-20c33d83dfa3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:50.614454 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df244d9b-cf40-4bc4-a106-20c33d83dfa3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:50.615860 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df244d9b-cf40-4bc4-a106-20c33d83dfa3 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:50.625073 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1440/2864] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:32:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:32:50.898419 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b9cca-a844-4099-873b-c7f00a68ce55 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:50.899909 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-c37b9cca-a844-4099-873b-c7f00a68ce55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:50.914252 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37b9cca-a844-4099-873b-c7f00a68ce55 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:50.918759 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7e0075-7bbb-4a90-bfc0-8a2dad271366 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:50.919392 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e0075-7bbb-4a90-bfc0-8a2dad271366 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:50.919671 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e0075-7bbb-4a90-bfc0-8a2dad271366 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:50.920496 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7e0075-7bbb-4a90-bfc0-8a2dad271366 admin admin] PATH_INFO: `/v3/projects/35bdca75a848450c85a203dbf1f2e1d3` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:50.921834 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e0075-7bbb-4a90-bfc0-8a2dad271366 admin admin] RBAC: Authorizing `identity:delete_project(project_id=35bdca75a848450c85a203dbf1f2e1d3)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:50.924416 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc7e0075-7bbb-4a90-bfc0-8a2dad271366 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:50.970557 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-bc7e0075-7bbb-4a90-bfc0-8a2dad271366 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '35bdca75a848450c85a203dbf1f2e1d3', 'request_id': 'req-bc7e0075-7bbb-4a90-bfc0-8a2dad271366'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:50.976183 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-bc7e0075-7bbb-4a90-bfc0-8a2dad271366 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '35bdca75a848450c85a203dbf1f2e1d3', 'request_id': 'req-bc7e0075-7bbb-4a90-bfc0-8a2dad271366'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:50.983699 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-bc7e0075-7bbb-4a90-bfc0-8a2dad271366 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '35bdca75a848450c85a203dbf1f2e1d3', 'request_id': 'req-bc7e0075-7bbb-4a90-bfc0-8a2dad271366'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:50.995770 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-bc7e0075-7bbb-4a90-bfc0-8a2dad271366 admin admin] The token cache is being invalidate because project 35bdca75a848450c85a203dbf1f2e1d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:32:50.996054 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-bc7e0075-7bbb-4a90-bfc0-8a2dad271366 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:50.996704 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-bc7e0075-7bbb-4a90-bfc0-8a2dad271366 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:32:50.998171 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1425/2865] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:32:50 2022] DELETE /identity/v3/projects/35bdca75a848450c85a203dbf1f2e1d3 => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:32:51.003297 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167061f-760e-4bba-b561-9b1e436f0aed None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:51.003835 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167061f-760e-4bba-b561-9b1e436f0aed None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:51.003835 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9167061f-760e-4bba-b561-9b1e436f0aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:51.023151 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-9167061f-760e-4bba-b561-9b1e436f0aed None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:32:51.024271 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9167061f-760e-4bba-b561-9b1e436f0aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:51.040259 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:51.083237 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1441/2866] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:32:51.093132 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8372341-2a88-4979-9146-87bdb32cb59c None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:51.093609 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8372341-2a88-4979-9146-87bdb32cb59c None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:51.093711 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8372341-2a88-4979-9146-87bdb32cb59c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:51.116802 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-a8372341-2a88-4979-9146-87bdb32cb59c None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:32:51.117979 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-a8372341-2a88-4979-9146-87bdb32cb59c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:51.127080 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1426/2867] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:32:51.131307 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167061f-760e-4bba-b561-9b1e436f0aed None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:51.141308 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9167061f-760e-4bba-b561-9b1e436f0aed None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:51.146455 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f97603-348d-4a3a-8b97-8d516407e914 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:51.147068 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f97603-348d-4a3a-8b97-8d516407e914 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:51.147349 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f97603-348d-4a3a-8b97-8d516407e914 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:51.147625 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37f97603-348d-4a3a-8b97-8d516407e914 admin admin] PATH_INFO: `/v3/domains` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:51.148337 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f97603-348d-4a3a-8b97-8d516407e914 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80443) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 05 02:32:51.148662 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f97603-348d-4a3a-8b97-8d516407e914 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:51.150240 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37f97603-348d-4a3a-8b97-8d516407e914 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:51.161754 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1442/2868] 10.222.0.15 () {58 vars in 1153 bytes} [Fri Aug 5 02:32:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 05 02:32:51.166018 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8372341-2a88-4979-9146-87bdb32cb59c None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:51.175612 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8372341-2a88-4979-9146-87bdb32cb59c None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:51.180280 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a8ed4-9987-40ff-8836-909eda241162 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:51.180905 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a8ed4-9987-40ff-8836-909eda241162 admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:51.181181 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a8ed4-9987-40ff-8836-909eda241162 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:51.181452 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1a8ed4-9987-40ff-8836-909eda241162 admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:51.182101 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a8ed4-9987-40ff-8836-909eda241162 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:51.183968 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1a8ed4-9987-40ff-8836-909eda241162 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:51.210675 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1427/2869] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:32:51 2022] POST /identity/v3/projects => generated 379 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 05 02:32:51.214974 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f97603-348d-4a3a-8b97-8d516407e914 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:51.225119 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37f97603-348d-4a3a-8b97-8d516407e914 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:51.282069 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b7ee66-46f1-45fe-8fa5-36ea6f52c109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:51.282651 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7ee66-46f1-45fe-8fa5-36ea6f52c109 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:51.282882 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7ee66-46f1-45fe-8fa5-36ea6f52c109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:51.283321 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b7ee66-46f1-45fe-8fa5-36ea6f52c109 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:51.283970 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b7ee66-46f1-45fe-8fa5-36ea6f52c109 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:51.285898 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b7ee66-46f1-45fe-8fa5-36ea6f52c109 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:51.317081 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1443/2870] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:32:51 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:32:51.321675 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a8ed4-9987-40ff-8836-909eda241162 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:51.334974 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1a8ed4-9987-40ff-8836-909eda241162 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:51.340251 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96be14-9594-4d30-a4bc-3c1970c4bb45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:51.340906 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96be14-9594-4d30-a4bc-3c1970c4bb45 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:51.341188 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96be14-9594-4d30-a4bc-3c1970c4bb45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:51.341464 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96be14-9594-4d30-a4bc-3c1970c4bb45 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:51.342163 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96be14-9594-4d30-a4bc-3c1970c4bb45 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:51.344507 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96be14-9594-4d30-a4bc-3c1970c4bb45 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:51.360214 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1428/2871] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:32:51.365089 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b7ee66-46f1-45fe-8fa5-36ea6f52c109 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:51.381560 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b7ee66-46f1-45fe-8fa5-36ea6f52c109 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:51.386585 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311dd999-87d5-4e86-bd53-db5615a97066 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:51.387382 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311dd999-87d5-4e86-bd53-db5615a97066 admin admin] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:51.387664 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311dd999-87d5-4e86-bd53-db5615a97066 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:51.387943 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311dd999-87d5-4e86-bd53-db5615a97066 admin admin] PATH_INFO: `/v3/roles` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:51.388771 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311dd999-87d5-4e86-bd53-db5615a97066 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:51.390924 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311dd999-87d5-4e86-bd53-db5615a97066 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:51.403501 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1444/2872] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:32:51 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:32:51.409841 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96be14-9594-4d30-a4bc-3c1970c4bb45 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:51.419792 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96be14-9594-4d30-a4bc-3c1970c4bb45 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:51.425230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b3bf3-4897-4c9c-b12b-f95e93a85079 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:51.425880 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b3bf3-4897-4c9c-b12b-f95e93a85079 admin admin] REQUEST_METHOD: `PUT` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:51.426163 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b3bf3-4897-4c9c-b12b-f95e93a85079 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:51.426441 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0b3bf3-4897-4c9c-b12b-f95e93a85079 admin admin] PATH_INFO: `/v3/projects/59a7ad5acdc34d0782e2c6807a4fd60f/users/5f163bd8d55e47019d7e7ef5ade78b38/roles/33cd9c7fcf9b4bbe9d604952279e8d76` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:51.440980 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b3bf3-4897-4c9c-b12b-f95e93a85079 admin admin] RBAC: Authorizing `identity:create_grant(project_id=59a7ad5acdc34d0782e2c6807a4fd60f, user_id=5f163bd8d55e47019d7e7ef5ade78b38, role_id=33cd9c7fcf9b4bbe9d604952279e8d76)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:51.443592 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0b3bf3-4897-4c9c-b12b-f95e93a85079 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:51.456828 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1429/2873] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:32:51 2022] PUT /identity/v3/projects/59a7ad5acdc34d0782e2c6807a4fd60f/users/5f163bd8d55e47019d7e7ef5ade78b38/roles/33cd9c7fcf9b4bbe9d604952279e8d76 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 05 02:32:51.461872 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf7c4c-7730-4336-94b4-c8ad43a3d59d None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:51.462432 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf7c4c-7730-4336-94b4-c8ad43a3d59d None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:51.462703 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ccf7c4c-7730-4336-94b4-c8ad43a3d59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:51.482788 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-9ccf7c4c-7730-4336-94b4-c8ad43a3d59d None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:32:51.483981 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-9ccf7c4c-7730-4336-94b4-c8ad43a3d59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:51.541189 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1445/2874] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:32:51 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:32:51.551392 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b3bf3-4897-4c9c-b12b-f95e93a85079 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:51.553113 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-2f0b3bf3-4897-4c9c-b12b-f95e93a85079 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:51.574743 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:51.612175 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0b3bf3-4897-4c9c-b12b-f95e93a85079 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:51.615720 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8358a50-68c0-4dc8-8cb5-c464c26f3e2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:51.616319 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8358a50-68c0-4dc8-8cb5-c464c26f3e2a service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:51.616620 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8358a50-68c0-4dc8-8cb5-c464c26f3e2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:51.616890 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8358a50-68c0-4dc8-8cb5-c464c26f3e2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:51.625598 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8358a50-68c0-4dc8-8cb5-c464c26f3e2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:51.627256 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8358a50-68c0-4dc8-8cb5-c464c26f3e2a service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:51.637250 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1430/2875] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:32:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:32:55.444249 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4696d9-a68e-4ce8-b695-c5937b6d1fe9 None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:55.444788 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4696d9-a68e-4ce8-b695-c5937b6d1fe9 None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:55.444921 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4696d9-a68e-4ce8-b695-c5937b6d1fe9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:55.476437 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-fb4696d9-a68e-4ce8-b695-c5937b6d1fe9 None None] MFA Rules not processed for user `5f163bd8d55e47019d7e7ef5ade78b38`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:32:55.477680 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-fb4696d9-a68e-4ce8-b695-c5937b6d1fe9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:32:55.498673 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:32:55.563182 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1446/2876] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:32:55 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:32:55.565269 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8358a50-68c0-4dc8-8cb5-c464c26f3e2a service neutron] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:55.582298 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8358a50-68c0-4dc8-8cb5-c464c26f3e2a service neutron] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:55.596790 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84e44a-bba8-40c1-8a57-5fd32ab3540a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:55.597704 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84e44a-bba8-40c1-8a57-5fd32ab3540a admin admin] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:55.598066 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84e44a-bba8-40c1-8a57-5fd32ab3540a admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:55.598411 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b84e44a-bba8-40c1-8a57-5fd32ab3540a admin admin] PATH_INFO: `/v3/projects` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:55.599170 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b84e44a-bba8-40c1-8a57-5fd32ab3540a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:55.601280 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b84e44a-bba8-40c1-8a57-5fd32ab3540a admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:55.633674 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1431/2877] 10.222.0.15 () {60 vars in 1153 bytes} [Fri Aug 5 02:32:55 2022] POST /identity/v3/projects => generated 377 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:32:55.637689 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4696d9-a68e-4ce8-b695-c5937b6d1fe9 None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:55.650439 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4696d9-a68e-4ce8-b695-c5937b6d1fe9 None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:55.717688 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54dc33b-4895-4e73-8549-d8eed852f033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:55.718318 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54dc33b-4895-4e73-8549-d8eed852f033 admin admin] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:55.718600 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54dc33b-4895-4e73-8549-d8eed852f033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:55.718901 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d54dc33b-4895-4e73-8549-d8eed852f033 admin admin] PATH_INFO: `/v3/users` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:55.719570 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54dc33b-4895-4e73-8549-d8eed852f033 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:55.721932 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d54dc33b-4895-4e73-8549-d8eed852f033 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:55.745134 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1447/2878] 10.222.0.15 () {60 vars in 1144 bytes} [Fri Aug 5 02:32:55 2022] POST /identity/v3/users => generated 295 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 05 02:32:55.749089 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84e44a-bba8-40c1-8a57-5fd32ab3540a admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:55.760817 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b84e44a-bba8-40c1-8a57-5fd32ab3540a admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:55.765467 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bd4059-c89c-486b-8752-62fd057c30d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:55.766086 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd4059-c89c-486b-8752-62fd057c30d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:55.766346 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd4059-c89c-486b-8752-62fd057c30d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:55.766617 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bd4059-c89c-486b-8752-62fd057c30d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:55.767383 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bd4059-c89c-486b-8752-62fd057c30d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:55.769271 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bd4059-c89c-486b-8752-62fd057c30d2 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:55.780454 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1432/2879] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 05 02:32:55.784757 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54dc33b-4895-4e73-8549-d8eed852f033 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:55.795192 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d54dc33b-4895-4e73-8549-d8eed852f033 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:55.800814 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db148c51-2f8d-4de8-a932-cd33f0f7041d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:55.801498 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db148c51-2f8d-4de8-a932-cd33f0f7041d admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:55.801785 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db148c51-2f8d-4de8-a932-cd33f0f7041d admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:55.802056 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db148c51-2f8d-4de8-a932-cd33f0f7041d admin admin] PATH_INFO: `/v3/projects/befac52eb20847e79efa0071b4705d4f/users/74a89ed2bebe4fd99f62c7180a45e283/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:55.818242 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db148c51-2f8d-4de8-a932-cd33f0f7041d admin admin] RBAC: Authorizing `identity:create_grant(project_id=befac52eb20847e79efa0071b4705d4f, user_id=74a89ed2bebe4fd99f62c7180a45e283, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:55.820950 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db148c51-2f8d-4de8-a932-cd33f0f7041d admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:55.838538 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1448/2880] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:32:55 2022] PUT /identity/v3/projects/befac52eb20847e79efa0071b4705d4f/users/74a89ed2bebe4fd99f62c7180a45e283/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:32:55.842488 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bd4059-c89c-486b-8752-62fd057c30d2 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:55.858448 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bd4059-c89c-486b-8752-62fd057c30d2 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:55.925484 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d56f6cd5-9532-4fec-b96d-b284c2943ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:55.926219 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f6cd5-9532-4fec-b96d-b284c2943ae5 admin admin] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:55.926561 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f6cd5-9532-4fec-b96d-b284c2943ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:55.926895 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d56f6cd5-9532-4fec-b96d-b284c2943ae5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:55.927661 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56f6cd5-9532-4fec-b96d-b284c2943ae5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:55.929376 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d56f6cd5-9532-4fec-b96d-b284c2943ae5 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:55.940870 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1433/2881] 10.222.0.15 () {58 vars in 1122 bytes} [Fri Aug 5 02:32:55 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 05 02:32:55.944939 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db148c51-2f8d-4de8-a932-cd33f0f7041d admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:32:55.956190 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db148c51-2f8d-4de8-a932-cd33f0f7041d admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:32:55.960968 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b640b-971a-45f0-b120-a7f8b9361857 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:32:55.961653 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b640b-971a-45f0-b120-a7f8b9361857 admin admin] REQUEST_METHOD: `PUT` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:32:55.962176 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b640b-971a-45f0-b120-a7f8b9361857 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:32:55.962454 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b640b-971a-45f0-b120-a7f8b9361857 admin admin] PATH_INFO: `/v3/projects/befac52eb20847e79efa0071b4705d4f/users/74a89ed2bebe4fd99f62c7180a45e283/roles/e1b75d5eea2a43b2b1b14cf0515350fa` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:32:55.964435 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b640b-971a-45f0-b120-a7f8b9361857 admin admin] RBAC: Authorizing `identity:create_grant(project_id=befac52eb20847e79efa0071b4705d4f, user_id=74a89ed2bebe4fd99f62c7180a45e283, role_id=e1b75d5eea2a43b2b1b14cf0515350fa)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:32:55.967070 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b640b-971a-45f0-b120-a7f8b9361857 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:32:55.978799 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1449/2882] 10.222.0.15 () {60 vars in 1483 bytes} [Fri Aug 5 02:32:55 2022] PUT /identity/v3/projects/befac52eb20847e79efa0071b4705d4f/users/74a89ed2bebe4fd99f62c7180a45e283/roles/e1b75d5eea2a43b2b1b14cf0515350fa => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:33:00.464500 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a573b-c966-4841-81ad-5492194b74e6 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:00.464984 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a573b-c966-4841-81ad-5492194b74e6 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:00.465104 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712a573b-c966-4841-81ad-5492194b74e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:00.507580 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-712a573b-c966-4841-81ad-5492194b74e6 None None] MFA Rules not processed for user `74a89ed2bebe4fd99f62c7180a45e283`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:33:00.508868 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-712a573b-c966-4841-81ad-5492194b74e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:33:00.590932 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1434/2883] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:33:00 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:33:00.606251 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b640b-971a-45f0-b120-a7f8b9361857 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:00.607936 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-d68b640b-971a-45f0-b120-a7f8b9361857 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:33:00.691094 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b640b-971a-45f0-b120-a7f8b9361857 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:00.697068 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a904dfe-34c6-46a6-9190-1060b77612cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:00.697798 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a904dfe-34c6-46a6-9190-1060b77612cc service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:00.698149 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a904dfe-34c6-46a6-9190-1060b77612cc service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:00.698522 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a904dfe-34c6-46a6-9190-1060b77612cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:00.705116 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:00.763917 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a904dfe-34c6-46a6-9190-1060b77612cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:00.765659 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a904dfe-34c6-46a6-9190-1060b77612cc service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:00.776989 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1450/2884] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:33:00 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:33:10.587555 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=94,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:10.772271 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=24 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:26.632972 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a573b-c966-4841-81ad-5492194b74e6 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:26.634447 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-712a573b-c966-4841-81ad-5492194b74e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:33:26.698078 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712a573b-c966-4841-81ad-5492194b74e6 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:26.702511 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0e11a-3a93-4c79-88dd-77e17f899426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:26.703127 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0e11a-3a93-4c79-88dd-77e17f899426 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:26.703405 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0e11a-3a93-4c79-88dd-77e17f899426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:26.703676 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca0e11a-3a93-4c79-88dd-77e17f899426 admin admin] PATH_INFO: `/v3/users/3dd1116bf7a44c14bbf64181c4d60f10` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:26.704838 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca0e11a-3a93-4c79-88dd-77e17f899426 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3dd1116bf7a44c14bbf64181c4d60f10)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:26.706765 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca0e11a-3a93-4c79-88dd-77e17f899426 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:26.753299 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-1ca0e11a-3a93-4c79-88dd-77e17f899426 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3dd1116bf7a44c14bbf64181c4d60f10'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:33:26.765989 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-1ca0e11a-3a93-4c79-88dd-77e17f899426 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3dd1116bf7a44c14bbf64181c4d60f10'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:33:26.766652 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-1ca0e11a-3a93-4c79-88dd-77e17f899426 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3dd1116bf7a44c14bbf64181c4d60f10'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:33:26.767396 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-1ca0e11a-3a93-4c79-88dd-77e17f899426 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3dd1116bf7a44c14bbf64181c4d60f10'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:33:26.775254 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-1ca0e11a-3a93-4c79-88dd-77e17f899426 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3dd1116bf7a44c14bbf64181c4d60f10'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:33:26.787256 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1435/2885] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:33:26 2022] DELETE /identity/v3/users/3dd1116bf7a44c14bbf64181c4d60f10 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:33:26.791828 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5474bca-0933-461d-b950-bf715a61c72e None None] REQUEST_METHOD: `POST` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:26.792317 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5474bca-0933-461d-b950-bf715a61c72e None None] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:26.792461 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5474bca-0933-461d-b950-bf715a61c72e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:26.810797 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.auth.core [None req-f5474bca-0933-461d-b950-bf715a61c72e None None] MFA Rules not processed for user `c5c6e2a1691a410eaac17764c32341d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80443) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:33:26.811996 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-f5474bca-0933-461d-b950-bf715a61c72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:33:26.873294 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1451/2886] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:33:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:33:26.883503 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0e11a-3a93-4c79-88dd-77e17f899426 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:26.884954 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-1ca0e11a-3a93-4c79-88dd-77e17f899426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:33:26.941355 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca0e11a-3a93-4c79-88dd-77e17f899426 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:26.946217 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72cd8b5f-b1a7-475c-8e1c-5ee40596ddc4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:26.946820 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd8b5f-b1a7-475c-8e1c-5ee40596ddc4 service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:26.947100 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd8b5f-b1a7-475c-8e1c-5ee40596ddc4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:26.947373 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72cd8b5f-b1a7-475c-8e1c-5ee40596ddc4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:26.956437 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd8b5f-b1a7-475c-8e1c-5ee40596ddc4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:26.957865 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72cd8b5f-b1a7-475c-8e1c-5ee40596ddc4 service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:26.968042 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1436/2887] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:33:26 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:33:27.246675 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5474bca-0933-461d-b950-bf715a61c72e None None] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:27.248202 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-f5474bca-0933-461d-b950-bf715a61c72e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:33:27.260448 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5474bca-0933-461d-b950-bf715a61c72e None None] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:27.265302 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b1f76-67eb-4a50-9975-c57a561be9e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:27.265961 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b1f76-67eb-4a50-9975-c57a561be9e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:27.266244 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b1f76-67eb-4a50-9975-c57a561be9e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:27.266521 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9b1f76-67eb-4a50-9975-c57a561be9e0 admin admin] PATH_INFO: `/v3/projects/f506cc5f1df64bcfb582c6b43c01fe86` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:27.267726 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9b1f76-67eb-4a50-9975-c57a561be9e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f506cc5f1df64bcfb582c6b43c01fe86)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:27.269691 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e9b1f76-67eb-4a50-9975-c57a561be9e0 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:27.316869 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1e9b1f76-67eb-4a50-9975-c57a561be9e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f506cc5f1df64bcfb582c6b43c01fe86', 'request_id': 'req-1e9b1f76-67eb-4a50-9975-c57a561be9e0'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:33:27.322331 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1e9b1f76-67eb-4a50-9975-c57a561be9e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f506cc5f1df64bcfb582c6b43c01fe86', 'request_id': 'req-1e9b1f76-67eb-4a50-9975-c57a561be9e0'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:33:27.329404 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1e9b1f76-67eb-4a50-9975-c57a561be9e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f506cc5f1df64bcfb582c6b43c01fe86', 'request_id': 'req-1e9b1f76-67eb-4a50-9975-c57a561be9e0'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:33:27.340517 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1e9b1f76-67eb-4a50-9975-c57a561be9e0 admin admin] The token cache is being invalidate because project f506cc5f1df64bcfb582c6b43c01fe86 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:33:27.340805 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1e9b1f76-67eb-4a50-9975-c57a561be9e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:33:27.341421 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-1e9b1f76-67eb-4a50-9975-c57a561be9e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:33:27.342909 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1452/2888] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:33:27 2022] DELETE /identity/v3/projects/f506cc5f1df64bcfb582c6b43c01fe86 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:33:29.825030 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aca755-7489-4019-9ab6-b926414ddf35 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:29.825539 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aca755-7489-4019-9ab6-b926414ddf35 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:29.825652 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7aca755-7489-4019-9ab6-b926414ddf35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:29.845558 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-f7aca755-7489-4019-9ab6-b926414ddf35 None None] MFA Rules not processed for user `5f163bd8d55e47019d7e7ef5ade78b38`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:33:29.846753 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-f7aca755-7489-4019-9ab6-b926414ddf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:33:29.863183 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:29.902851 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1437/2889] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:33:29 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:33:30.209270 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b1f76-67eb-4a50-9975-c57a561be9e0 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:30.210692 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-1e9b1f76-67eb-4a50-9975-c57a561be9e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:33:30.267526 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9b1f76-67eb-4a50-9975-c57a561be9e0 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:30.271588 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d4222-a7d5-4cff-ab36-ed211ec60f05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:30.272207 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d4222-a7d5-4cff-ab36-ed211ec60f05 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:30.272731 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d4222-a7d5-4cff-ab36-ed211ec60f05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:30.273015 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3d4222-a7d5-4cff-ab36-ed211ec60f05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:30.274785 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-7c3d4222-a7d5-4cff-ab36-ed211ec60f05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:33:30.284263 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d4222-a7d5-4cff-ab36-ed211ec60f05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:30.285698 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3d4222-a7d5-4cff-ab36-ed211ec60f05 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:30.293804 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1453/2890] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:33:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:33:33.450118 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aca755-7489-4019-9ab6-b926414ddf35 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:33.451565 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-f7aca755-7489-4019-9ab6-b926414ddf35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:33:33.528010 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7aca755-7489-4019-9ab6-b926414ddf35 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:33.532978 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c975e50-8ec6-4f13-ac29-3e653e97bfd0 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e84ea976b5914aea94c4d8f805139daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:33.533602 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c975e50-8ec6-4f13-ac29-3e653e97bfd0 service placement] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:33.533885 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c975e50-8ec6-4f13-ac29-3e653e97bfd0 service placement] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:33.534161 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c975e50-8ec6-4f13-ac29-3e653e97bfd0 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:33.535936 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-4c975e50-8ec6-4f13-ac29-3e653e97bfd0 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:33:33.548386 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c975e50-8ec6-4f13-ac29-3e653e97bfd0 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:33.549961 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c975e50-8ec6-4f13-ac29-3e653e97bfd0 service placement] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:33.560758 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1438/2891] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:33:33 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:33:40.290140 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=80,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:43.556433 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=47 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:33:48.546821 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d4222-a7d5-4cff-ab36-ed211ec60f05 service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:48.556138 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3d4222-a7d5-4cff-ab36-ed211ec60f05 service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:48.559742 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b76b5-5dc9-4938-8cf7-99ffa92ec5be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:48.560376 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b76b5-5dc9-4938-8cf7-99ffa92ec5be service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:48.560662 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b76b5-5dc9-4938-8cf7-99ffa92ec5be service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:48.560955 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2b76b5-5dc9-4938-8cf7-99ffa92ec5be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:48.562707 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-8d2b76b5-5dc9-4938-8cf7-99ffa92ec5be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:33:48.626469 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b76b5-5dc9-4938-8cf7-99ffa92ec5be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:48.627883 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2b76b5-5dc9-4938-8cf7-99ffa92ec5be service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:48.638401 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1454/2892] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:33:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:33:52.213846 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c975e50-8ec6-4f13-ac29-3e653e97bfd0 service placement] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:52.223176 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c975e50-8ec6-4f13-ac29-3e653e97bfd0 service placement] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:52.226848 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0933b50-3044-4c60-b84a-4bf4a7b2925a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:52.227443 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0933b50-3044-4c60-b84a-4bf4a7b2925a service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:52.227722 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0933b50-3044-4c60-b84a-4bf4a7b2925a service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:52.227993 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0933b50-3044-4c60-b84a-4bf4a7b2925a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:52.229733 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-e0933b50-3044-4c60-b84a-4bf4a7b2925a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:33:52.287359 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0933b50-3044-4c60-b84a-4bf4a7b2925a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:52.288816 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0933b50-3044-4c60-b84a-4bf4a7b2925a service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:52.297924 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1439/2893] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:33:52 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:33:57.038058 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b76b5-5dc9-4938-8cf7-99ffa92ec5be service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:33:57.046783 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2b76b5-5dc9-4938-8cf7-99ffa92ec5be service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:33:57.050334 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4f475-e820-40db-addc-0aa327e7ae21 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:33:57.050934 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4f475-e820-40db-addc-0aa327e7ae21 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:33:57.051211 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4f475-e820-40db-addc-0aa327e7ae21 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:33:57.051481 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c4f475-e820-40db-addc-0aa327e7ae21 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:33:57.053956 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-b7c4f475-e820-40db-addc-0aa327e7ae21 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:33:57.116723 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c4f475-e820-40db-addc-0aa327e7ae21 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:33:57.118121 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7c4f475-e820-40db-addc-0aa327e7ae21 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:33:57.127783 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1455/2894] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:33:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:34:00.202703 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0933b50-3044-4c60-b84a-4bf4a7b2925a service neutron] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:34:00.210251 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0933b50-3044-4c60-b84a-4bf4a7b2925a service neutron] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:34:00.215909 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48953da-e94e-4ca2-ae3c-11cd6f401529 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e84ea976b5914aea94c4d8f805139daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:34:00.216637 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48953da-e94e-4ca2-ae3c-11cd6f401529 service placement] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:34:00.217045 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48953da-e94e-4ca2-ae3c-11cd6f401529 service placement] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:34:00.217328 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e48953da-e94e-4ca2-ae3c-11cd6f401529 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:34:00.219140 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-e48953da-e94e-4ca2-ae3c-11cd6f401529 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:34:00.232260 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48953da-e94e-4ca2-ae3c-11cd6f401529 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:34:00.233962 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e48953da-e94e-4ca2-ae3c-11cd6f401529 service placement] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:34:00.248641 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1440/2895] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:34:00 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:34:03.331517 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4f475-e820-40db-addc-0aa327e7ae21 service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:34:03.343575 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c4f475-e820-40db-addc-0aa327e7ae21 service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:34:03.349452 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd49bc7-4957-452e-b020-8e388c2a0d8a service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e84ea976b5914aea94c4d8f805139daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:34:03.349910 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd49bc7-4957-452e-b020-8e388c2a0d8a service placement] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:34:03.350194 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd49bc7-4957-452e-b020-8e388c2a0d8a service placement] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:34:03.350530 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fd49bc7-4957-452e-b020-8e388c2a0d8a service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:34:03.352279 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-6fd49bc7-4957-452e-b020-8e388c2a0d8a service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:34:03.365286 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd49bc7-4957-452e-b020-8e388c2a0d8a service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:34:03.366881 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fd49bc7-4957-452e-b020-8e388c2a0d8a service placement] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:34:03.387036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1456/2896] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:34:03 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 05 02:34:03.400632 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48953da-e94e-4ca2-ae3c-11cd6f401529 service placement] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:34:03.402150 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-e48953da-e94e-4ca2-ae3c-11cd6f401529 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:34:03.416673 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e48953da-e94e-4ca2-ae3c-11cd6f401529 service placement] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:34:03.429125 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb23025-b5ec-4d3f-b89c-aa1cac80542a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:34:03.429774 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb23025-b5ec-4d3f-b89c-aa1cac80542a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:34:03.430057 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb23025-b5ec-4d3f-b89c-aa1cac80542a admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:34:03.430335 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb23025-b5ec-4d3f-b89c-aa1cac80542a admin admin] PATH_INFO: `/v3/users/d7166065ae65434fbeaff2993a21cc01` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:34:03.431587 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb23025-b5ec-4d3f-b89c-aa1cac80542a admin admin] RBAC: Authorizing `identity:delete_user(user_id=d7166065ae65434fbeaff2993a21cc01)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:34:03.433604 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddb23025-b5ec-4d3f-b89c-aa1cac80542a admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:34:03.482928 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-ddb23025-b5ec-4d3f-b89c-aa1cac80542a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd7166065ae65434fbeaff2993a21cc01'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:34:03.495024 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-ddb23025-b5ec-4d3f-b89c-aa1cac80542a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd7166065ae65434fbeaff2993a21cc01'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:34:03.495685 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-ddb23025-b5ec-4d3f-b89c-aa1cac80542a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd7166065ae65434fbeaff2993a21cc01'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:34:03.496280 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-ddb23025-b5ec-4d3f-b89c-aa1cac80542a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd7166065ae65434fbeaff2993a21cc01'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:34:03.503932 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-ddb23025-b5ec-4d3f-b89c-aa1cac80542a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd7166065ae65434fbeaff2993a21cc01'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:34:03.517117 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1441/2897] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:34:03 2022] DELETE /identity/v3/users/d7166065ae65434fbeaff2993a21cc01 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:34:03.693497 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd49bc7-4957-452e-b020-8e388c2a0d8a service placement] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:34:03.706561 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fd49bc7-4957-452e-b020-8e388c2a0d8a service placement] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:34:03.764692 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09687037-40d6-4618-94ed-337f25f2a3bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:34:03.765454 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09687037-40d6-4618-94ed-337f25f2a3bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:34:03.765746 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09687037-40d6-4618-94ed-337f25f2a3bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:34:03.766026 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09687037-40d6-4618-94ed-337f25f2a3bc admin admin] PATH_INFO: `/v3/projects/b3677b84efd24f76bbbc0f8a762ec3f5` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:34:03.767189 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09687037-40d6-4618-94ed-337f25f2a3bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3677b84efd24f76bbbc0f8a762ec3f5)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:34:03.769153 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09687037-40d6-4618-94ed-337f25f2a3bc admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:34:03.785628 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=100 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:34:03.814998 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-09687037-40d6-4618-94ed-337f25f2a3bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'request_id': 'req-09687037-40d6-4618-94ed-337f25f2a3bc'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:34:03.820936 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-09687037-40d6-4618-94ed-337f25f2a3bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'request_id': 'req-09687037-40d6-4618-94ed-337f25f2a3bc'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:34:03.827788 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-09687037-40d6-4618-94ed-337f25f2a3bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3677b84efd24f76bbbc0f8a762ec3f5', 'request_id': 'req-09687037-40d6-4618-94ed-337f25f2a3bc'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:34:03.842448 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-09687037-40d6-4618-94ed-337f25f2a3bc admin admin] The token cache is being invalidate because project b3677b84efd24f76bbbc0f8a762ec3f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:34:03.842731 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-09687037-40d6-4618-94ed-337f25f2a3bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:34:03.843527 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-09687037-40d6-4618-94ed-337f25f2a3bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:34:03.845045 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1457/2898] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:34:03 2022] DELETE /identity/v3/projects/b3677b84efd24f76bbbc0f8a762ec3f5 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:34:03.848995 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb23025-b5ec-4d3f-b89c-aa1cac80542a admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:34:03.850391 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-ddb23025-b5ec-4d3f-b89c-aa1cac80542a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:34:03.863358 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddb23025-b5ec-4d3f-b89c-aa1cac80542a admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:34:03.914135 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:34:03.920746 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465d436-9a46-41c5-919f-81177eb3fe3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:34:03.921419 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465d436-9a46-41c5-919f-81177eb3fe3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:34:03.921872 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465d436-9a46-41c5-919f-81177eb3fe3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:34:03.922435 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7465d436-9a46-41c5-919f-81177eb3fe3f admin admin] PATH_INFO: `/v3/users/061d1edc56bd4cbca17fa307ee7c035b` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:34:03.923799 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7465d436-9a46-41c5-919f-81177eb3fe3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=061d1edc56bd4cbca17fa307ee7c035b)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:34:03.926075 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7465d436-9a46-41c5-919f-81177eb3fe3f admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:34:03.972831 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-7465d436-9a46-41c5-919f-81177eb3fe3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '061d1edc56bd4cbca17fa307ee7c035b'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:34:03.985299 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-7465d436-9a46-41c5-919f-81177eb3fe3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '061d1edc56bd4cbca17fa307ee7c035b'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:34:03.985999 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-7465d436-9a46-41c5-919f-81177eb3fe3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '061d1edc56bd4cbca17fa307ee7c035b'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:34:03.986607 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-7465d436-9a46-41c5-919f-81177eb3fe3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '061d1edc56bd4cbca17fa307ee7c035b'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:34:03.994497 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-7465d436-9a46-41c5-919f-81177eb3fe3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '061d1edc56bd4cbca17fa307ee7c035b'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:34:04.006855 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1442/2899] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:34:03 2022] DELETE /identity/v3/users/061d1edc56bd4cbca17fa307ee7c035b => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:34:04.174372 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09687037-40d6-4618-94ed-337f25f2a3bc admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:34:04.175828 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-09687037-40d6-4618-94ed-337f25f2a3bc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:34:04.190522 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09687037-40d6-4618-94ed-337f25f2a3bc admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:34:04.248881 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322ecc0-1f7a-461d-8266-fbdd950505ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:34:04.249524 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322ecc0-1f7a-461d-8266-fbdd950505ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:34:04.249800 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322ecc0-1f7a-461d-8266-fbdd950505ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:34:04.250077 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b322ecc0-1f7a-461d-8266-fbdd950505ce admin admin] PATH_INFO: `/v3/projects/71cef2110dfb43dabac1baaed43f2d7c` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:34:04.251216 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b322ecc0-1f7a-461d-8266-fbdd950505ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=71cef2110dfb43dabac1baaed43f2d7c)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:34:04.253130 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b322ecc0-1f7a-461d-8266-fbdd950505ce admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:34:04.299022 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-b322ecc0-1f7a-461d-8266-fbdd950505ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71cef2110dfb43dabac1baaed43f2d7c', 'request_id': 'req-b322ecc0-1f7a-461d-8266-fbdd950505ce'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:34:04.304629 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-b322ecc0-1f7a-461d-8266-fbdd950505ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71cef2110dfb43dabac1baaed43f2d7c', 'request_id': 'req-b322ecc0-1f7a-461d-8266-fbdd950505ce'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:34:04.313865 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-b322ecc0-1f7a-461d-8266-fbdd950505ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71cef2110dfb43dabac1baaed43f2d7c', 'request_id': 'req-b322ecc0-1f7a-461d-8266-fbdd950505ce'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:34:04.326869 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-b322ecc0-1f7a-461d-8266-fbdd950505ce admin admin] The token cache is being invalidate because project 71cef2110dfb43dabac1baaed43f2d7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80443) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:34:04.327156 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-b322ecc0-1f7a-461d-8266-fbdd950505ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:34:04.327840 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-b322ecc0-1f7a-461d-8266-fbdd950505ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:34:04.329410 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1458/2900] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:34:04 2022] DELETE /identity/v3/projects/71cef2110dfb43dabac1baaed43f2d7c => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:34:14.003048 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=27,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:34:14.323709 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=68,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:36:04.631597 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465d436-9a46-41c5-919f-81177eb3fe3f admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:36:04.633558 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-7465d436-9a46-41c5-919f-81177eb3fe3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:36:04.692427 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7465d436-9a46-41c5-919f-81177eb3fe3f admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:36:04.739944 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1ec4f5-03ae-4080-994b-17112e275093 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:36:04.740578 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ec4f5-03ae-4080-994b-17112e275093 service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:36:04.740852 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ec4f5-03ae-4080-994b-17112e275093 service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:36:04.741122 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1ec4f5-03ae-4080-994b-17112e275093 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:36:04.742909 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-8b1ec4f5-03ae-4080-994b-17112e275093 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:36:04.809386 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ec4f5-03ae-4080-994b-17112e275093 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:36:04.810794 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1ec4f5-03ae-4080-994b-17112e275093 service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:36:04.822036 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1443/2901] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:36:04 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:36:06.005357 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322ecc0-1f7a-461d-8266-fbdd950505ce admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:36:06.006853 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-b322ecc0-1f7a-461d-8266-fbdd950505ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:36:06.019006 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b322ecc0-1f7a-461d-8266-fbdd950505ce admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:36:06.022992 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee97b9b-55e1-4a4d-a9a6-ec633df99062 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:36:06.023589 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee97b9b-55e1-4a4d-a9a6-ec633df99062 service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:36:06.023866 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee97b9b-55e1-4a4d-a9a6-ec633df99062 service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:36:06.024136 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ee97b9b-55e1-4a4d-a9a6-ec633df99062 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:36:06.025987 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-7ee97b9b-55e1-4a4d-a9a6-ec633df99062 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:36:06.040158 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee97b9b-55e1-4a4d-a9a6-ec633df99062 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:36:06.041604 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ee97b9b-55e1-4a4d-a9a6-ec633df99062 service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:36:06.052497 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1459/2902] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:36:06 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:36:08.392230 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7ed03-5dfa-4575-892a-03703c0c5108 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:36:08.392736 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7ed03-5dfa-4575-892a-03703c0c5108 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:36:08.392923 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af7ed03-5dfa-4575-892a-03703c0c5108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:36:08.413969 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-1af7ed03-5dfa-4575-892a-03703c0c5108 None None] MFA Rules not processed for user `5f163bd8d55e47019d7e7ef5ade78b38`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:36:08.415174 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-1af7ed03-5dfa-4575-892a-03703c0c5108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:36:08.471959 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1444/2903] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:36:08 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:36:08.784519 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee97b9b-55e1-4a4d-a9a6-ec633df99062 service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:36:08.793681 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ee97b9b-55e1-4a4d-a9a6-ec633df99062 service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:36:08.797308 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426be8a-3c52-4800-b959-c545b177826f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:36:08.797916 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426be8a-3c52-4800-b959-c545b177826f service neutron] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:36:08.798201 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426be8a-3c52-4800-b959-c545b177826f service neutron] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:36:08.798476 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3426be8a-3c52-4800-b959-c545b177826f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:36:08.800211 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-3426be8a-3c52-4800-b959-c545b177826f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:36:08.810662 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426be8a-3c52-4800-b959-c545b177826f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:36:08.812068 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3426be8a-3c52-4800-b959-c545b177826f service neutron] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:36:08.821005 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1460/2904] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:36:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:36:18.465382 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=99 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:36:18.816419 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=12 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:36:39.168483 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7ed03-5dfa-4575-892a-03703c0c5108 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:36:39.169932 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-1af7ed03-5dfa-4575-892a-03703c0c5108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:36:39.182274 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af7ed03-5dfa-4575-892a-03703c0c5108 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:36:39.185740 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f4d6b4-ee35-4677-b41b-0d8770aad349 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:36:39.186338 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4d6b4-ee35-4677-b41b-0d8770aad349 service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:36:39.186615 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4d6b4-ee35-4677-b41b-0d8770aad349 service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:36:39.186886 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f4d6b4-ee35-4677-b41b-0d8770aad349 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:36:39.188582 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-77f4d6b4-ee35-4677-b41b-0d8770aad349 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:36:39.197884 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f4d6b4-ee35-4677-b41b-0d8770aad349 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:36:39.199325 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f4d6b4-ee35-4677-b41b-0d8770aad349 service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:36:39.207276 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1445/2905] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:36:39 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:36:49.203706 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=6 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:38:15.283341 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426be8a-3c52-4800-b959-c545b177826f service neutron] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:38:15.284782 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-3426be8a-3c52-4800-b959-c545b177826f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:38:15.342329 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3426be8a-3c52-4800-b959-c545b177826f service neutron] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:38:15.345897 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e055cb4a-49df-46ff-afea-523e0f8e00e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6a75ac3523564e1bb23469455fdba560', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:38:15.346509 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055cb4a-49df-46ff-afea-523e0f8e00e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:38:15.346790 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055cb4a-49df-46ff-afea-523e0f8e00e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:38:15.347065 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e055cb4a-49df-46ff-afea-523e0f8e00e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:38:15.348846 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-e055cb4a-49df-46ff-afea-523e0f8e00e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:38:15.360162 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e055cb4a-49df-46ff-afea-523e0f8e00e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:38:15.361607 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e055cb4a-49df-46ff-afea-523e0f8e00e4 service cinder] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:38:15.370515 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1461/2906] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:38:15 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:38:25.315368 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da290180-be1e-4673-ac6a-910e2cf6ddf7 None None] REQUEST_METHOD: `POST` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:38:25.315896 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da290180-be1e-4673-ac6a-910e2cf6ddf7 None None] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:38:25.316015 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da290180-be1e-4673-ac6a-910e2cf6ddf7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:38:25.340919 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.auth.core [None req-da290180-be1e-4673-ac6a-910e2cf6ddf7 None None] MFA Rules not processed for user `5f163bd8d55e47019d7e7ef5ade78b38`. Rule list: `[]` (Enabled: `True`). {{(pid=80442) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 05 02:38:25.342124 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-da290180-be1e-4673-ac6a-910e2cf6ddf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:38:25.348916 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1446/2907] 10.222.0.15 () {58 vars in 958 bytes} [Fri Aug 5 02:38:25 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 05 02:38:25.366283 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=26 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:38:26.092803 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e055cb4a-49df-46ff-afea-523e0f8e00e4 service cinder] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:38:26.094204 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-e055cb4a-49df-46ff-afea-523e0f8e00e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:38:26.168722 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e055cb4a-49df-46ff-afea-523e0f8e00e4 service cinder] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:38:26.173720 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920af71-fb17-4cd6-88cf-999dd8acb2fe service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e84ea976b5914aea94c4d8f805139daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:38:26.174336 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920af71-fb17-4cd6-88cf-999dd8acb2fe service placement] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:38:26.174616 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920af71-fb17-4cd6-88cf-999dd8acb2fe service placement] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:38:26.174920 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6920af71-fb17-4cd6-88cf-999dd8acb2fe service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:38:26.176690 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-6920af71-fb17-4cd6-88cf-999dd8acb2fe service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:38:26.188734 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920af71-fb17-4cd6-88cf-999dd8acb2fe service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:38:26.190288 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6920af71-fb17-4cd6-88cf-999dd8acb2fe service placement] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:38:26.200146 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1462/2908] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:38:26 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:38:28.773938 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da290180-be1e-4673-ac6a-910e2cf6ddf7 None None] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:38:28.775444 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-da290180-be1e-4673-ac6a-910e2cf6ddf7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:38:28.795102 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da290180-be1e-4673-ac6a-910e2cf6ddf7 None None] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:38:28.800776 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f82c3-be78-44e4-9dd8-7a907f74017f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:38:28.801395 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f82c3-be78-44e4-9dd8-7a907f74017f service nova] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:38:28.801665 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f82c3-be78-44e4-9dd8-7a907f74017f service nova] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:38:28.801937 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c53f82c3-be78-44e4-9dd8-7a907f74017f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:38:28.803668 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-c53f82c3-be78-44e4-9dd8-7a907f74017f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:38:28.818909 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53f82c3-be78-44e4-9dd8-7a907f74017f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:38:28.821269 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c53f82c3-be78-44e4-9dd8-7a907f74017f service nova] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:38:28.833754 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1447/2909] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:38:28 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:38:36.195824 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=32 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:38:38.834413 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=9 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:38:39.051025 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920af71-fb17-4cd6-88cf-999dd8acb2fe service placement] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:38:39.096727 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6920af71-fb17-4cd6-88cf-999dd8acb2fe service placement] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:38:39.102991 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acece56-0a5a-4e8e-8581-40a49ae98586 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:38:39.103651 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acece56-0a5a-4e8e-8581-40a49ae98586 service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:38:39.103935 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acece56-0a5a-4e8e-8581-40a49ae98586 service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:38:39.104208 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6acece56-0a5a-4e8e-8581-40a49ae98586 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:38:39.106189 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-6acece56-0a5a-4e8e-8581-40a49ae98586 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:38:39.143531 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acece56-0a5a-4e8e-8581-40a49ae98586 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:38:39.145159 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6acece56-0a5a-4e8e-8581-40a49ae98586 service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:38:39.155882 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1463/2910] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:38:39 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:38:41.747592 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f82c3-be78-44e4-9dd8-7a907f74017f service nova] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:38:41.812154 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c53f82c3-be78-44e4-9dd8-7a907f74017f service nova] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:38:41.817258 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4a3d5-f32d-4a77-bbdc-b1de530bc846 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e84ea976b5914aea94c4d8f805139daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:38:41.817882 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4a3d5-f32d-4a77-bbdc-b1de530bc846 service placement] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:38:41.818158 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4a3d5-f32d-4a77-bbdc-b1de530bc846 service placement] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:38:41.818436 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4a3d5-f32d-4a77-bbdc-b1de530bc846 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:38:41.820214 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-9bd4a3d5-f32d-4a77-bbdc-b1de530bc846 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:38:41.853251 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd4a3d5-f32d-4a77-bbdc-b1de530bc846 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:38:41.854949 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd4a3d5-f32d-4a77-bbdc-b1de530bc846 service placement] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:38:41.865939 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1448/2911] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:38:41 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:38:43.365250 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acece56-0a5a-4e8e-8581-40a49ae98586 service nova] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:38:43.377349 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6acece56-0a5a-4e8e-8581-40a49ae98586 service nova] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:38:43.382849 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a5640-18ba-484d-b6bf-401464f048ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '4b5c0958604b436daa44b1f67c9dec26', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'ResellerAdmin', 'service', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:38:43.383629 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a5640-18ba-484d-b6bf-401464f048ff service nova] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:38:43.383908 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a5640-18ba-484d-b6bf-401464f048ff service nova] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:38:43.384182 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b8a5640-18ba-484d-b6bf-401464f048ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:38:43.385985 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-3b8a5640-18ba-484d-b6bf-401464f048ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:38:43.398830 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a5640-18ba-484d-b6bf-401464f048ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:38:43.400409 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b8a5640-18ba-484d-b6bf-401464f048ff service nova] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:38:43.411036 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1464/2912] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:38:43 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:38:51.861043 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=32 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:38:53.406495 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=34 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:40:45.060826 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4a3d5-f32d-4a77-bbdc-b1de530bc846 service placement] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:40:45.079386 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4a3d5-f32d-4a77-bbdc-b1de530bc846 service placement] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:40:45.083257 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868a6ff-6618-4b12-bec7-6ff478d2e9f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f81daf3da9b34e7380c61005019a53bd', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:40:45.083797 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868a6ff-6618-4b12-bec7-6ff478d2e9f2 service neutron] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:45.084095 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868a6ff-6618-4b12-bec7-6ff478d2e9f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:45.084459 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4868a6ff-6618-4b12-bec7-6ff478d2e9f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:45.086870 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-4868a6ff-6618-4b12-bec7-6ff478d2e9f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:45.177777 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868a6ff-6618-4b12-bec7-6ff478d2e9f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:40:45.179251 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4868a6ff-6618-4b12-bec7-6ff478d2e9f2 service neutron] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:40:45.197682 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1449/2913] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:40:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:40:48.277485 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a5640-18ba-484d-b6bf-401464f048ff service nova] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:40:48.278920 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-3b8a5640-18ba-484d-b6bf-401464f048ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:48.292766 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b8a5640-18ba-484d-b6bf-401464f048ff service nova] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:40:48.297758 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e2888-7168-423c-a94b-452d6776cce7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e84ea976b5914aea94c4d8f805139daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:40:48.298400 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e2888-7168-423c-a94b-452d6776cce7 service placement] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:48.298678 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e2888-7168-423c-a94b-452d6776cce7 service placement] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:48.298951 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03e2888-7168-423c-a94b-452d6776cce7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:48.300734 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-f03e2888-7168-423c-a94b-452d6776cce7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:48.312974 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03e2888-7168-423c-a94b-452d6776cce7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:40:48.314573 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03e2888-7168-423c-a94b-452d6776cce7 service placement] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:40:48.333499 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1465/2914] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:40:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:40:51.412690 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868a6ff-6618-4b12-bec7-6ff478d2e9f2 service neutron] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:40:51.425416 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4868a6ff-6618-4b12-bec7-6ff478d2e9f2 service neutron] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:40:51.430599 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53dfef-4511-4901-8f8a-0ad7ddba2326 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e84ea976b5914aea94c4d8f805139daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:40:51.431694 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53dfef-4511-4901-8f8a-0ad7ddba2326 service placement] REQUEST_METHOD: `GET` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:51.431890 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53dfef-4511-4901-8f8a-0ad7ddba2326 service placement] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:51.432166 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b53dfef-4511-4901-8f8a-0ad7ddba2326 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:51.433986 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-1b53dfef-4511-4901-8f8a-0ad7ddba2326 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:51.447757 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b53dfef-4511-4901-8f8a-0ad7ddba2326 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:40:51.449494 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b53dfef-4511-4901-8f8a-0ad7ddba2326 service placement] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:40:51.464972 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1450/2915] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:40:51 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:40:51.475236 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e2888-7168-423c-a94b-452d6776cce7 service placement] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:40:51.477493 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-f03e2888-7168-423c-a94b-452d6776cce7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:51.491651 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03e2888-7168-423c-a94b-452d6776cce7 service placement] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:40:51.497164 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb452fd1-aaf0-4402-ad4a-bd62398cd800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:40:51.497819 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb452fd1-aaf0-4402-ad4a-bd62398cd800 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:51.498100 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb452fd1-aaf0-4402-ad4a-bd62398cd800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:51.498376 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb452fd1-aaf0-4402-ad4a-bd62398cd800 admin admin] PATH_INFO: `/v3/users/5f163bd8d55e47019d7e7ef5ade78b38` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:51.499620 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb452fd1-aaf0-4402-ad4a-bd62398cd800 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5f163bd8d55e47019d7e7ef5ade78b38)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:40:51.501563 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb452fd1-aaf0-4402-ad4a-bd62398cd800 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:40:51.549629 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-fb452fd1-aaf0-4402-ad4a-bd62398cd800 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5f163bd8d55e47019d7e7ef5ade78b38'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:40:51.562977 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-fb452fd1-aaf0-4402-ad4a-bd62398cd800 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5f163bd8d55e47019d7e7ef5ade78b38'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:40:51.563659 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-fb452fd1-aaf0-4402-ad4a-bd62398cd800 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5f163bd8d55e47019d7e7ef5ade78b38'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:40:51.564292 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-fb452fd1-aaf0-4402-ad4a-bd62398cd800 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5f163bd8d55e47019d7e7ef5ade78b38'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:40:51.571434 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-fb452fd1-aaf0-4402-ad4a-bd62398cd800 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5f163bd8d55e47019d7e7ef5ade78b38'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:40:51.584197 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1466/2916] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:40:51 2022] DELETE /identity/v3/users/5f163bd8d55e47019d7e7ef5ade78b38 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:40:51.758576 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53dfef-4511-4901-8f8a-0ad7ddba2326 service placement] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:40:51.769089 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b53dfef-4511-4901-8f8a-0ad7ddba2326 service placement] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:40:51.830829 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1c704-b426-4dcf-9d29-31ce3755bd69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:40:51.831464 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1c704-b426-4dcf-9d29-31ce3755bd69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:51.831745 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1c704-b426-4dcf-9d29-31ce3755bd69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:51.832024 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1c704-b426-4dcf-9d29-31ce3755bd69 admin admin] PATH_INFO: `/v3/projects/59a7ad5acdc34d0782e2c6807a4fd60f` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:51.833474 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d1c704-b426-4dcf-9d29-31ce3755bd69 admin admin] RBAC: Authorizing `identity:delete_project(project_id=59a7ad5acdc34d0782e2c6807a4fd60f)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:40:51.835897 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d1c704-b426-4dcf-9d29-31ce3755bd69 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:40:51.884727 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:40:51.888269 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-48d1c704-b426-4dcf-9d29-31ce3755bd69 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '59a7ad5acdc34d0782e2c6807a4fd60f', 'request_id': 'req-48d1c704-b426-4dcf-9d29-31ce3755bd69'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:40:51.894163 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-48d1c704-b426-4dcf-9d29-31ce3755bd69 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '59a7ad5acdc34d0782e2c6807a4fd60f', 'request_id': 'req-48d1c704-b426-4dcf-9d29-31ce3755bd69'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:40:51.901886 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-48d1c704-b426-4dcf-9d29-31ce3755bd69 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '59a7ad5acdc34d0782e2c6807a4fd60f', 'request_id': 'req-48d1c704-b426-4dcf-9d29-31ce3755bd69'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:40:51.913429 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-48d1c704-b426-4dcf-9d29-31ce3755bd69 admin admin] The token cache is being invalidate because project 59a7ad5acdc34d0782e2c6807a4fd60f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:40:51.913709 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-48d1c704-b426-4dcf-9d29-31ce3755bd69 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:40:51.914370 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-48d1c704-b426-4dcf-9d29-31ce3755bd69 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:40:51.915876 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1451/2917] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:40:51 2022] DELETE /identity/v3/projects/59a7ad5acdc34d0782e2c6807a4fd60f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:40:51.919900 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb452fd1-aaf0-4402-ad4a-bd62398cd800 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:40:51.921304 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-fb452fd1-aaf0-4402-ad4a-bd62398cd800 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:51.934629 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb452fd1-aaf0-4402-ad4a-bd62398cd800 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:40:51.991012 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518555f1-c58a-42a0-9886-f735ba656c35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:40:51.992399 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518555f1-c58a-42a0-9886-f735ba656c35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:51.992690 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518555f1-c58a-42a0-9886-f735ba656c35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:51.992965 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-518555f1-c58a-42a0-9886-f735ba656c35 admin admin] PATH_INFO: `/v3/users/74a89ed2bebe4fd99f62c7180a45e283` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:51.994149 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518555f1-c58a-42a0-9886-f735ba656c35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=74a89ed2bebe4fd99f62c7180a45e283)` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:40:51.996026 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-518555f1-c58a-42a0-9886-f735ba656c35 admin admin] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:40:52.039488 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-518555f1-c58a-42a0-9886-f735ba656c35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '74a89ed2bebe4fd99f62c7180a45e283'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:40:52.049500 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:40:52.052264 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-518555f1-c58a-42a0-9886-f735ba656c35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '74a89ed2bebe4fd99f62c7180a45e283'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:40:52.053283 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-518555f1-c58a-42a0-9886-f735ba656c35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '74a89ed2bebe4fd99f62c7180a45e283'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:40:52.054695 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-518555f1-c58a-42a0-9886-f735ba656c35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '74a89ed2bebe4fd99f62c7180a45e283'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:40:52.062002 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.notifications [None req-518555f1-c58a-42a0-9886-f735ba656c35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '74a89ed2bebe4fd99f62c7180a45e283'} {{(pid=80443) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:40:52.074368 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1467/2918] 10.222.0.15 () {58 vars in 1224 bytes} [Fri Aug 5 02:40:51 2022] DELETE /identity/v3/users/74a89ed2bebe4fd99f62c7180a45e283 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:40:52.244847 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1c704-b426-4dcf-9d29-31ce3755bd69 admin admin] Authenticating user token {{(pid=80442) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:40:52.246271 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.fernet_utils [None req-48d1c704-b426-4dcf-9d29-31ce3755bd69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80442) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:40:52.264613 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1c704-b426-4dcf-9d29-31ce3755bd69 admin admin] Validating token access rules against request {{(pid=80442) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:40:52.320555 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19933630-febf-4ef9-b4ae-0e8032365f33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'c5c6e2a1691a410eaac17764c32341d7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'a0be9d6a2aae470aa8143374d4c4992b', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80442) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:40:52.321184 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19933630-febf-4ef9-b4ae-0e8032365f33 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:40:52.321461 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19933630-febf-4ef9-b4ae-0e8032365f33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:40:52.321733 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19933630-febf-4ef9-b4ae-0e8032365f33 admin admin] PATH_INFO: `/v3/projects/befac52eb20847e79efa0071b4705d4f` {{(pid=80442) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:40:52.322892 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19933630-febf-4ef9-b4ae-0e8032365f33 admin admin] RBAC: Authorizing `identity:delete_project(project_id=befac52eb20847e79efa0071b4705d4f)` {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:40:52.324816 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19933630-febf-4ef9-b4ae-0e8032365f33 admin admin] RBAC: Authorization granted {{(pid=80442) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:40:52.370350 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-19933630-febf-4ef9-b4ae-0e8032365f33 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'befac52eb20847e79efa0071b4705d4f', 'request_id': 'req-19933630-febf-4ef9-b4ae-0e8032365f33'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:40:52.375955 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-19933630-febf-4ef9-b4ae-0e8032365f33 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'befac52eb20847e79efa0071b4705d4f', 'request_id': 'req-19933630-febf-4ef9-b4ae-0e8032365f33'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:40:52.383991 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-19933630-febf-4ef9-b4ae-0e8032365f33 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'befac52eb20847e79efa0071b4705d4f', 'request_id': 'req-19933630-febf-4ef9-b4ae-0e8032365f33'} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:40:52.394966 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-19933630-febf-4ef9-b4ae-0e8032365f33 admin admin] The token cache is being invalidate because project befac52eb20847e79efa0071b4705d4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80442) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 05 02:40:52.395252 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-19933630-febf-4ef9-b4ae-0e8032365f33 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:40:52.395868 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG keystone.notifications [None req-19933630-febf-4ef9-b4ae-0e8032365f33 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80442) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 05 02:40:52.397489 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: [pid: 80442|app: 0|req: 1452/2919] 10.222.0.15 () {58 vars in 1233 bytes} [Fri Aug 5 02:40:52 2022] DELETE /identity/v3/projects/befac52eb20847e79efa0071b4705d4f => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 05 02:41:02.070995 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:DELETE=2,keystone:SELECT=7,keystone:INSERT=1 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:41:02.391980 dv-cinder-815582-13-iscsi devstack@keystone.service[80442]: DEBUG dbcounter [-] [80442] Writing DB stats keystone:DELETE=11,keystone:SELECT=58,keystone:INSERT=2 {{(pid=80442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 05 02:43:44.436492 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518555f1-c58a-42a0-9886-f735ba656c35 admin admin] Authenticating user token {{(pid=80443) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 05 02:43:44.438017 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-518555f1-c58a-42a0-9886-f735ba656c35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:43:44.506694 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-518555f1-c58a-42a0-9886-f735ba656c35 admin admin] Validating token access rules against request {{(pid=80443) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 05 02:43:44.563858 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dc6ef28-4855-48da-91f0-2f3fe892876b service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'e84ea976b5914aea94c4d8f805139daf', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '95d88dece7184bf1842c4f8d275d52cd', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80443) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 05 02:43:44.564504 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6ef28-4855-48da-91f0-2f3fe892876b service placement] REQUEST_METHOD: `GET` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 05 02:43:44.564790 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6ef28-4855-48da-91f0-2f3fe892876b service placement] SCRIPT_NAME: `/identity` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 05 02:43:44.565064 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc6ef28-4855-48da-91f0-2f3fe892876b service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80443) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 05 02:43:44.566789 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.fernet_utils [None req-5dc6ef28-4855-48da-91f0-2f3fe892876b service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80443) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 05 02:43:44.577710 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc6ef28-4855-48da-91f0-2f3fe892876b service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 05 02:43:44.579504 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dc6ef28-4855-48da-91f0-2f3fe892876b service placement] RBAC: Authorization granted {{(pid=80443) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 05 02:43:44.589215 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: [pid: 80443|app: 0|req: 1468/2920] 10.222.0.15 () {60 vars in 1365 bytes} [Fri Aug 5 02:43:44 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 153 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 05 02:43:54.585016 dv-cinder-815582-13-iscsi devstack@keystone.service[80443]: DEBUG dbcounter [-] [80443] Writing DB stats keystone:SELECT=58 {{(pid=80443) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}